March 2000 - Zope - Zope lists

Re: [Zope] Server Sizing
by Peter Sabaini 23 Mar '00

23 Mar '00

here you are! (see end of post)(i hope you dont mind my adressing the list). btw. does anybody know of other benchmarking software? (i once tried to grab httperf but the ftp site holding the source is down...) ru, peter. On Wed, 22 Mar 2000, J. Atwood wrote: :Peter, : :Have you ever done these test against just the ZServer? : :JMA : :> From: Peter Sabaini <sabaini(a)niil.at> :> Date: Wed, 22 Mar 2000 13:36:17 +0100 (CET) :> To: Stephan Richter <srichter(a)cbu.edu> :> Cc: zope(a)zope.org :> Subject: RE: [Zope] Server Sizing :> :> On Wed, 22 Mar 2000, Stephan Richter wrote: :> :> :>i agree on apache increasing your performance when serving static :> :>files (for instance images), but wouldn't url rewriting and the proxy :> :>pass module of apache be an even better solution? i just switched from :> :>PCGI to the Rewrite/Proxypass combo because of the additional overhead :> :>of PCGI. :> : :> :Mmmhh, I have to have a look. Okay, I just read the the little tutorial. :> :Does it really speed things up? :> :I guess SSL should not be hard using this solution. I will be thinking :> :about it. :> : :> :Anyone else? :> : :> :> some testing with apache benchmark: :> :> the setup is an apache 1.3.12 sitting on port 1988. :> :> /tstfolder/bmeth is a very simple dtml method ("i am bmeth in :> /tstfolder" <dtml-call "REQUEST.set('testvar', 'hm...')"> :> &dtml-testvar;). :> :> i do 1000 requests at 50 concurrent users, keepalive-connection via :> apache benchmark: :> :> first the result of doing a proxypass to zserver on port 8080: :> :> ------ :> :> /root# /usr/local/apache/bin/ab -n 1000 -c 50 -k -v 2 :> http://druck.kleinezeitung.at:1988/tstfolder/bmeth :> This is ApacheBench, Version 1.3c <$Revision: 1.38 $> apache-1.3 :> Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, :> http://www.zeustech.net/ :> Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/ :> :> Benchmarking druck.kleinezeitung.at (be patient)...INFO: POST header :> == :> --- :> GET /tstfolder/bmeth HTTP/1.0 :> User-Agent: ApacheBench/1.3c :> Connection: Keep-Alive :> Host: druck.kleinezeitung.at :> Accept: */* :> :> :> --- :> Server Software: Zope/Zope :> Server Hostname: druck.kleinezeitung.at :> Server Port: 1988 :> :> Document Path: /tstfolder/bmeth :> Document Length: 25 bytes :> :> Concurrency Level: 50 :> Time taken for tests: 16.817 seconds :> Complete requests: 1000 :> Failed requests: 0 :> Keep-Alive requests: 0 :> Total transferred: 243000 bytes :> HTML transferred: 25000 bytes :> Requests per second: 59.46 :> Transfer rate: 14.45 kb/s received :> :> Connnection Times (ms) :> min avg max :> Connect: 0 1 38 :> Processing: 99 818 877 :> Total: 99 819 915 :> :> ---------------------- :> :> then i modify httpd.conf to get apache to talk to zope via :> PCGI / Zope.cgi (otherwise unchanged): :> :> ----------------------- :> :> /home/Zope# /usr/local/apache/bin/ab -n 1000 -c 50 -k -v 2 :> http://druck.kleinezeitung.at:1988/tstfolder/bmeth :> This is ApacheBench, Version 1.3c <$Revision: 1.38 $> apache-1.3 :> Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, :> http://www.zeustech.net/ :> Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/ :> :> Benchmarking druck.kleinezeitung.at (be patient)...INFO: POST header :> == :> --- :> GET /tstfolder/bmeth HTTP/1.0 :> User-Agent: ApacheBench/1.3c :> Connection: Keep-Alive :> Host: druck.kleinezeitung.at :> Accept: */* :> :> :> --- :> Server Software: Apache/1.3.12 :> Server Hostname: druck.kleinezeitung.at :> Server Port: 1988 :> :> Document Path: /tstfolder/bmeth :> Document Length: 25 bytes :> :> Concurrency Level: 50 :> Time taken for tests: 21.984 seconds :> Complete requests: 1000 :> Failed requests: 0 :> Keep-Alive requests: 1000 :> Total transferred: 273050 bytes :> HTML transferred: 25000 bytes :> Requests per second: 45.49 :> Transfer rate: 12.42 kb/s received :> :> Connnection Times (ms) :> min avg max :> Connect: 0 15 355 :> Processing: 41 1058 6039 :> Total: 41 1073 6394 :> :> -------------------- :> :> :> conclusion: with proxy pass i get around 30% more requests per second :> and around 25% less connection time (and im not able to use keep-alive :> as it seems). :> :> please note that this is only a quick check and not scientific in any :> way, and naturally the benefits will diminish when more complicated :> pages are going to be served. :> :> if there are any other test results please let me know... :> :> peter. ps.: same test to zserver directly (shows further increase in thoughput): /root# /usr/local/apache/bin/ab -n 1000 -c 50 -k -v 2 http://druck.kleinezeitung.at:8080/tstfolder/bmeth This is ApacheBench, Version 1.3c <$Revision: 1.38 $> apache-1.3 Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/ Benchmarking druck.kleinezeitung.at (be patient)...INFO: POST header == --- GET /tstfolder/bmeth HTTP/1.0 User-Agent: ApacheBench/1.3c Connection: Keep-Alive Host: druck.kleinezeitung.at Accept: */* --- Server Software: Zope/Zope Server Hostname: druck.kleinezeitung.at Server Port: 8080 Document Path: /tstfolder/bmeth Document Length: 25 bytes Concurrency Level: 50 Time taken for tests: 14.821 seconds Complete requests: 1000 Failed requests: 0 Keep-Alive requests: 0 Total transferred: 224000 bytes HTML transferred: 25000 bytes Requests per second: 67.47 Transfer rate: 15.11 kb/s received Connnection Times (ms) min avg max Connect: 0 0 31 Processing: 209 722 734 Total: 209 722 765 -- _________________________________________________ peter sabaini, mailto: sabaini(a)niil.at -------------------------------------------------

4 3

ZWiki comments
by Jimmie Houchin 23 Mar '00

23 Mar '00

For a previous message I posted to the list I was prompted to place a comment in the associated ZWiki. I went to the ZWiki to comment and played with the "Sandbox" before posting to learn a few things. From the things I learned here are a couple of comments I wanted to throw out. I know some of these run counter to the thoughts of the Wiki community but they are concerns nevertheless. The nature of Wiki is very unsecured. This is for better or worse. I know the ZWiki on the Zope site does require logging in before editing which helps but does not eliminate the potential of malicious or accidental editing. Anyone logged in can do any kind of editing they wish on a page. They can erase all text. They can insert, delete or otherwise modify comments or content made by other people. These things can be positive or negative depending on the goal or intent of the page. I think editing a page is more applicable to stable open content than it is to a forum oriented page. Examples. If Zope's documentation was managed by ZWiki in a secure manner then a community member could make corrections of typo's or legacy information like references to Principia, etc. The submit button could either be a "Submit for review" or if really trusted "Change". I know this duplicates somewhat what CVS does. Once again depends on goals. If the page is forum oriented, i.e.: an on going conversation like a bulletin board and such then it is more appropriate to "Add comment" than to "Change page". This would present the user with a cleaner interface and a clearer idea of what they are doing. They would not be presented with the entire contents of a page so they could merely append a comment on the end. If the ZWiki on the Zope site starts getting busy we run into other problems. The problems especially affect a forum oriented type page. Just to learn I opened up the "Sandbox" in a new page, I then open the "Sandbox" again in a new page. I edited the first and submitted and then edited the second and submitted. The first was successful. The second fortunately got an error message. I say fortunately because it did not overwrite the previous submission. In a busy forum or BBoard multiple people getting errors would be a bad thing. If in a forum oriented page an "Add comment" button was available then the conflicts and errors would be avoided. This would also enable ZODB's transaction mechanism better with each comment being an object associated with the page. This would also be more secure in that people would adding their value and not altering other peoples. On Philip Greenspun's site http://www.photo.net the BBoard's are somewhat integrated with email. You can subscribe to a bboard and receive email for the added comments. This is a nice feature. Their implementation is quite inelegant and could be improved. Zope/ZWiki could shine here. This allows user to choose how they want to view the messages, either through the web or via email. Just a few thoughts to throw out to the community. Jimmie Houchin

1 0

Uncaught exception in OFS.Image with LocalFS
by Brad Crittenden 23 Mar '00

23 Mar '00

hello: i'm using Zope 2.1.6 and LocalFS 0.1.7. when i try to view an image via a LocalFS object i get an exception in OFS.Image.py at line 187: last_mod =int(self._p_mtime) the error occurs the *first* time i try to access a specific image with a recently launched browser. accessing other images or subsequent hits to the troublesome image in the same browser do not cause the problem. subsequent hits in the same launch of zope from a fresh browser on another machine causes the exception. having modified Image.py to catch the exception and dump some information i see that self._p_mtime is None. i've looked around but cannot determine where _p_mtime is defined or how it is supposed to be set. i see this method in Image was re-written after Zope 2.1.4. similarly, accessing a .wav file via LocalFS causes the following message: 2000-03-23T16:27:13 ERROR(200) ZServer uncaptured python exception, closing chan nel <zhttp_channel connected 127.0.0.1:4864 at b7d340 channel#: 15 requests:1> ( exceptions.AttributeError:'int' object has no attribute 'send' [D:\myzope\ZSer ver\medusa\asyncore.py|poll|64] [D:\myzope\ZServer\medusa\asyncore.py|handle_w rite_event|298] [D:\myzope\ZServer\medusa\asynchat.py|handle_write|144] [D:\myzope\ZServer\medusa\asynchat.py|initiate_send|211] [D:\myzope\ZServer\medusa \http_server.py|send|400] [D:\myzope\ZServer\medusa\asyncore.py|send|231] [<st ring>|send|1]) the wav file is delivered to the browser correctly. as a quick fix to the Image problem, i catch the exception, set last_mod = 0, and continue. this does not seem to have any ill effects. --brad

2 1

Debugger question and writing on filesystem (QUEST)
by Oscar Picasso 23 Mar '00

23 Mar '00

Hi, I have a product: $myzopedir Products EProduct __init__ # empty EProduct.py class EProduct: def writeData(self): f = open('/home/oscar/data/test_out.jpg', 'wb') f.write(self.data) f.close() return 'Export succeed' On Zope, I created a new ZClass, EBook which is Subclassing, CatalogAware, Image and EProduct

1 0

www.zope.org product list request . . .
by Christopher J. Kucera 23 Mar '00

23 Mar '00

A simple request: Could the Product list at zope.org be alphabetized? Every time I go there to find a product, I end up having to use the "find" feature in my browser. Not a big deal, of course; just a suggestion. Thanks! -CJ

3 2

timing error in ZODB lock?
by Garry Hodgson 23 Mar '00

23 Mar '00

i'm getting some funny behavior using a (separate from Zope's) ZODB from External Methods. after much thrashing, i've got my application working. however, every so often, when i click on a submit button that invokes an External Method, i get: Could not lock the database file. There must be another process that has opened the file. the odd thing is that if i click the browser "back" button, then hit my button again, it works. occasionally i need do this back/resubmit thing more than once, but usually once suffices. smells like a race condition to me. has anyone else seen this, or have an idea how i can avoid it? -- Garry Hodgson Every night garry(a)sage.att.com a child is born Software Innovation Services is a Holy Night. AT&T Labs - Sophia Lyon Fahs

1 0

records form variable type
by John Williams 23 Mar '00

23 Mar '00

I have been using the records form variable type, but believe there may be a problem with it. With most browsers all appears OK, however some browsers (e.g. Mozilla) may return form elements out of order. What this means is that when trying to use the records type their is no guarantee that the different elements of a single record will be sent consecutively and therefore the records objects will not be correctly constructed by Zope. I would like to know if this is the fault of browser or if this is an issue which excludes the general use of the records type. If the latter what alternatives would be recommended - I would prefer not to have to create unique form element names as it would add a fair amount of complication. What guarantees can be safely assumed about data arriving from a form - for example if you try using the list type is the order in which the components of the list guaranteed to be the same as the order in which the respective form elements occur in the document? -- Dr. John A.R. Williams

1 0

Welcome Aboard Tres Seaver!!
by Rob Page 23 Mar '00

23 Mar '00

Hello everybody! Please join me in welcoming Tres Seaver to the Digital Creations team!! Tres Seaver joins DC having completed a three year stint as chief-cook-and-bottle-washer of his own software architecture company, Palladion Software. He spent the nineties doing gigs in expert systems, OO toolkits, relational databases, and distributed object systems, working with major players in the energy, banking, and trading sectors. Although comfortable with C++, Delphi, and Java, he vastly prefers working in Python. Tres is a lifelong Texan, charmed away from the Lone Star State by Fredericksburg, and the proud father of two boys. He enjoys dark beer, poker, and baseball, on those rare occasions when his wife chases him away from the 'Net connection so she can read her mail in peace. Tres can be reached at: mailto: tseaver(a)digicool.com Welcome Tres! --Rob -- Rob Page V: 540.371.6909 Digital Creations, Inc. F: 703.995.0412 -- ... The Leader in Open Source Web Development ... ... Don't miss Zope! http://www.zope.org ...

1 0

Changing Roles
by Chris Withers 23 Mar '00

23 Mar '00

Hi, A simple question, but getting a bit irritating... How can I change the roles assigned to a user without knowing their password? The form to do this has password fields which come up blank, and you can't submit the form without filling them in. I don't want to know what the user's password is anyway, I just want to change the assigned roles... ;-) HSCH, Chris PS: Zope 2.1.4 and 2.1.6...

5 7

redirects in standard_error_message
by John Chandler 23 Mar '00

23 Mar '00

My saga with the standard_error_message continues ;-) I'm trapping 404 errors for missing pages, checking the intended URL against a list of URLs which have moved to new locations and returning a link to the new location as part of the error page. What would be useful would be to automatically redirect to a new URL if it occurs, but this is proving a problem. I've been using RESPONSE.redirect() as this has proved useful on other pages, but on standard_error_message this doesn't appear to have any effect - even when the entire contents of the error page is stripped out and replaced by just the call to redirect(). Is it possible for standard_error_message to handle redirects (in which case, what else do I need to do?) or is there another way to go about this? Thanks in advance. John -- John Chandler / Software Developer / New Information Paradigms Ltd [ Linux in the office, AmigaOS in the home, PalmOS in the pocket ] ------------------------------------------------------------------------ The opinions above aren't those of my company... ...but then, they aren't really mine either.

1 0