I have a quite complicated data collection and reporting system based on zope2.7 and postgresql. All the postgresql stuff is handled by external scripts. I have used page templates throughout. It is running on a Debian Sarge based system, and uses Apache as a front end. This is my first experience developing with Zope, so I have probably done things oddly, but... I have script that generates a large bundle of data dictionary for each "target entity", which is in this case is a person. I then pass this data to a script that converts it to XML. My template repeats over a list of people, and concatenates and sends the XML for them all to the user, where a bit of XSLT creates a paged report. It works for a few people. If I try too many people it fails with an Error reading from remote server message from the Apache. I cannot find any hints in the apache or zope logs. I have tried to monitor the server to see if any resources are running out, but have not found anything. Can anyone suggest how I try to diagnose this failure. I repeat, I am fairly new to Zope, and so need fairly basic help. Dave -- Dave Whiteley The School of Electronic and Electrical Engineering The University of Leeds Leeds d.l.whiteley@ee.leeds.ac.uk 0113 343 2059
Can you check your memory consumption on the server? It could be that your application eats up so much memory that your zope can't handle it and thus times out. If this is the case you'll need to rewrite your app to NOT create a too big data structure of dictionaries. On 1/19/06, David Whiteley <D.L.Whiteley@leeds.ac.uk> wrote:
I have a quite complicated data collection and reporting system based on zope2.7 and postgresql. All the postgresql stuff is handled by external scripts. I have used page templates throughout. It is running on a Debian Sarge based system, and uses Apache as a front end.
This is my first experience developing with Zope, so I have probably done things oddly, but...
I have script that generates a large bundle of data dictionary for each "target entity", which is in this case is a person. I then pass this data to a script that converts it to XML. My template repeats over a list of people, and concatenates and sends the XML for them all to the user, where a bit of XSLT creates a paged report.
It works for a few people. If I try too many people it fails with an Error reading from remote server message from the Apache.
I cannot find any hints in the apache or zope logs. I have tried to monitor the server to see if any resources are running out, but have not found anything.
Can anyone suggest how I try to diagnose this failure.
I repeat, I am fairly new to Zope, and so need fairly basic help.
Dave
-- Dave Whiteley The School of Electronic and Electrical Engineering The University of Leeds Leeds d.l.whiteley@ee.leeds.ac.uk 0113 343 2059
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
-- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com
On Thu, 2006-01-19 at 12:12 +0000, Peter Bengtsson wrote:
Can you check your memory consumption on the server? It could be that your application eats up so much memory that your zope can't handle it and thus times out. If this is the case you'll need to rewrite your app to NOT create a too big data structure of dictionaries.
I do not think this is happening. The command "top" does not indicate that memory is being filled. Dave
-- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com
Dave Whiteley wrote:
On Thu, 2006-01-19 at 12:12 +0000, Peter Bengtsson wrote:
Can you check your memory consumption on the server? It could be that your application eats up so much memory that your zope can't handle it and thus times out. If this is the case you'll need to rewrite your app to NOT create a too big data structure of dictionaries.
I do not think this is happening. The command "top" does not indicate that memory is being filled.
Dave
-- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com
David I missed your fuller explanation. How big are the responses back to the client browsers? Is there a zope.conf directive that limits the size of responses to client browser? If you can get the size then you can try and duplicate with a very large HTML file. And send that as a response to see if its just a size problem? Anyway I hope someone can help you. If you solve this please post to the list. D
participants (4)
-
Dave Whiteley -
David -
David Whiteley -
Peter Bengtsson