I am running Zope 2.5 on a Win2000 server. The server is not a total screamer but is pretty capable I think ( 800 mhz PIII 256 mB ).
From within a python script, I am trying to, while uploading a text file, create some Zope folder objects for each line in the text file. Each line in the text file causes creation of an object and a couple of child objects and in each child object 3-10 more objects ( and in the future the number may increase).
I am finding that each line read takes 1-3 seconds of real time in the script to create the required objects -- I am hoping to upload files and process having between 500-2500 lines using this technique but at this rate it will not be possible. I am currently trying to determine if there is a particular area that is causing the problem but I haven't found anything obvious yet ( using the profiler and manipulating the coded). Is this level of performance expected, am I likely doing something bizarre that is causing this performance problem? If this is expected performance, is there some other technique I should be using? Any guidance accepted.
Brian Sullivan writes:
... I am trying to, while uploading a text file, create some Zope folder objects for each line in the text file. Each line in the text file causes creation of an object and a couple of child objects and in each child object 3-10 more objects ( and in the future the number may increase).
I am finding that each line read takes 1-3 seconds of real time in the script to create the required objects -- I am hoping to upload files and Maybe, you can use ZEO and do the expensive work in the background...
Dieter
I'm not saying your doing anything wrong, but what's the point of all of the various objects? On Fri, 2002-09-20 at 15:59, Brian Sullivan wrote:
I am running Zope 2.5 on a Win2000 server.
The server is not a total screamer but is pretty capable I think ( 800 mhz PIII 256 mB ).
From within a python script, I am trying to, while uploading a text file, create some Zope folder objects for each line in the text file. Each line in the text file causes creation of an object and a couple of child objects and in each child object 3-10 more objects ( and in the future the number may increase).
I am finding that each line read takes 1-3 seconds of real time in the script to create the required objects -- I am hoping to upload files and process having between 500-2500 lines using this technique but at this rate it will not be possible. I am currently trying to determine if there is a particular area that is causing the problem but I haven't found anything obvious yet ( using the profiler and manipulating the coded). Is this level of performance expected, am I likely doing something bizarre that is causing this performance problem? If this is expected performance, is there some other technique I should be using?
Any guidance accepted.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev ) -- Edward Muller
Interlix - President/Owner Web Hosting - PC Service & Support Custom Programming - Network Service & Support Phone: 417-862-0573 Cell: 417-844-2435 http://www.interlix.com
Edward Muller <mailto:edwardam@interlix.com> scribbled on Monday, September 23, 2002 2:01 AM:
I'm not saying your doing anything wrong, but what's the point of all of the various objects?
I am importing a roster of students in a CSV text file-- the top level folders ( 500-2500 or so in number) are student folders -- the bottom levels are information for assigned online lessons.
participants (4)
-
Brian Sullivan -
Brian Sullivan -
Dieter Maurer -
Edward Muller