April 2001 - Zope - Zope lists

ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

:o( The situation is this - I have a database-driven website that backs onto a Postgres 7.1RC1 server - this does not affect the problem, the same thing happens with a 7.0.3 and 7.0.2 server on either the same or different machines. I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem occurs with both. I have been able to reproduct this on a minimal install of 2.3.1 (no other products). What's happening - I have a PythonScript that does this: m = container.machine.SQL_get(machineid=machineid)[0] print container.machine.show_html(context,REQUEST, param1=m.param1, param2=m.param2, param3=m.param3, param4=m.param4, param5=m.param5, param6=m.param6, param7=m.param7, param8=m.param8, param9=m.param9, param0=m.param0) return printed show_html is a DTML document. When called at "high" speed (2-3 times a second) by URL traversal (i.e. GETing http://site.name/Zope/path/pythonscript?machineid=whatever) this causes either (in order of likelihood): 1) The 4 child threads of ZServer to die, leaving only the top-level and child thread, and a core file 2) *One* of the child threads to die, causing the rest of Zope to completely hang (hung inside a SIGSTOP) 3) The entire thing to bomb out *But*, if I reduce the number of named parameters to the DTML method (when of course it doesn't render properly) then everything's OK. The current code dies if there are >8 named parameters. But it seems to vary. I thought that the parameters had to be records from an SQL query, but now I'm not so sure. If anyone has any ideas, I'd be glad to hear them. Failing that, I'm giving up :o) Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+

3 4

Re: Re[4]: Optimizing ZOPE
by alan runyan 05 Apr '01

05 Apr '01

> Not exactly. It's a combination of server load (long requests) and > other objects that are read. I think that the transaction management > of Zope have problems with request on objects that take a long time. > So if a request takes too much time and another request want to access > another object than it might crash. have you tried to use the logging features of ZOPE? z2.py STUPID_FILE_LOGGER=var/Zope.log I got this information from http://www.zope.org/Members/michel/Projects/Interfaces/LOGGING.txt/ I really would like to help try to solve your problems and then we could try to bring them up to Digital Creations. ZOPE is a really decent product and the problems I've seen are people not architecting ZOPE around their problem (this is not intuitive, like some of ZOPE) but solving their problems with ZOPE (more intuitive) disregarding how ZOPE works (things should be abit more bullet proof). > No. I switched off the syncing and the problems are the same. In debug > mode of zope I get error messages on console like 'conflict competing > write ...'. It seems that zope have bugs rendering the DTML sites to > HTML. That problem does not break every request when this message > occurs. I believe the STUPID_FILE_LOGGER will give you more information on this. I should have brought it up earlier. and we should have been discussing this on the ZOPE mailing list so we could have this archived. those conflict competing writes usually have path associated with it. are all of these occuring in the same location in the ZODB? > On Windows sometimes it breaks nothing, sometimes only this request > (thread) breaks and sometimes the complete zope crashes and the > process is killed or sometimes the process runs but handles no > requests. We get this kind of error at least once a day (on good days) > and every hour on bad days depending on load I think. yikes, this is very bad. Andy McKay has helped port ActiveStates website to ZOPE and I wonder if they are experience the same problems. > On Linux it's no problem, because the worse case is that the thread is > killed and started again. Zope is NOT completely killed or hangs. All > 2-3 months the process crashes, but a little shell script restarts it > and all is fine. there is no doubt that ZOPE has more experience and is favored to run on *nix ,from what I understand. > Yes. The main point is that you should use zope's capabilities as less > as possible for such big projects. I use zope nearly only for DTML and > user authorization. Big Files are in filesystem, database is SQL, > backend is python, some functions of zope are patched (username > logging of http_server.py, my own error pages for HTML errors; e.g. > 404, 401, ...). So I don't really use all zope's possibilities, but > it's too slow anyway. the big files should be served from apache and not ZOPE. that is the lesson to be learned I believe. > example: > I wrote some little benchmarking tests. I do a search query with about > 40 objects as result. These objects (complete classes with data and > methods) are return to DTML as a list. DTML access the data to display > with methods like 'getDate', 'getName', 'get....'. The backend > generates these objects and sets the values with methods 'setDate', > 'setName' ,.... . I benchmarked it and the result was that this search > request needs 1829ms (no exact value, because of python benchmark > script; I think it's a little bit faster than this values). Than I began > to optimize and test some methods, functions, ... to get slow > commands. I tried to avoid these complex objects, generate only simple > container classes that contains only plain data. I access these values > from DTML directly with obj.date, obj.name, obj.xxx. I left all > methods and complex things out. I read MIME type information on > download and not at file object generating time. I left out my python > function 'quoteForHTML' that do the HTML Quoting for all special chars > (I will write a python C module these days if I find no other way). > And the result was for the same request it took only 400ms. So I have > to optimize all my code to get it work. That's not simple. The code is > about 11500 lines. And the object oriented handling is thrown away for > DTML requests because of speed problems. Python and Zope are not fast > enough for that complex backend. This code in PHP would be faster and > does not end in crashes. PHP code is so ugly that I don't want it, but > it is stable. > You say the code is 11500 lines long. You are using German characters I assume, I wonder if this is causing any problem? there is a german ZOPE company beehive that you may want to get in touch with. they have some extensive experience and may be able to out, http://www.beehive.de/index.html . this is why I would like to see your problem solved. I have used PHP in the past and am not a big fan. It is stable, fast, and has a larger community. How experience with Python are you? I see you had setName getName, in python you usually directly set/get attributes with instance.property=value and value=instance.property, overloading __setattr__ and __getattr__ if you wanted to do a tiny more than set/get values as well. > Who are you exactly ? It seems that you know a lot about zope. Are you > developing on zope ? I read you brought up ZEO, right ? I'm just some programmer in Texas, USA. I have been reading and playing with ZOPE for almost two years. I am not developing on ZOPE, but may start in the next few months (I just lost my job this week). I have not done anything with ZEO besides getting it up and running in a test environment -- nothing production such as your case. I'm CCing the ZOPE list. ~runyaga

2 1

RE: [Zope] ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

Ok, it still crashes even if you don't call the ZSQL method. *But*, I'm seeing massive inconsistencies here - I just undid ten minutes of changes to get it back to crashing, then redid them back to where I was (not crashing) and *this* time it's crashing. <Sigh> I'll try to get it pinned down a little. Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Mayers, Philip J Sent: 05 April 2001 17:33 To: 'Chris McDonough'; Mayers, Philip J; zope(a)zope.org Subject: RE: [Zope] ZServer *still* dying - help? Sorry - yes, I'm still calling the SQL method, but am passing empty strings for the named parameters instead. I'll try it without calling the method now... Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: 05 April 2001 17:32 To: Mayers, Philip J; zope(a)zope.org Subject: Re: [Zope] ZServer *still* dying - help? Can you clarify? Are you still calling the SQL method? ----- Original Message ----- From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> To: "'Chris McDonough'" <chrism(a)digicool.com>; "Mayers, Philip J" <p.mayers(a)ic.ac.uk>; <zope(a)zope.org> Sent: Thursday, April 05, 2001 12:30 PM Subject: RE: [Zope] ZServer *still* dying - help? > Yes. > > It's now crashing if I pass *any* named parameters. This can't be a corrupt > ZODB (I exported the site as XML, rebuilt the entire of Zope from fresh, > then reinstalled and reimpored) > > Regards, > Phil > > +----------------------------------+ > | Phil Mayers, Network Support | > | Centre for Computing Services | > | Imperial College | > +----------------------------------+ > > -----Original Message----- > From: Chris McDonough [mailto:chrism@digicool.com] > Sent: 05 April 2001 17:11 > To: Mayers, Philip J; zope(a)zope.org > Subject: Re: [Zope] ZServer *still* dying - help? > > > Does the problem happen without the SQL call? E.g., can you just pass > show_html >8 parameters of dummy data and have it crash? > > ----- Original Message ----- > From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> > To: <zope(a)zope.org> > Sent: Thursday, April 05, 2001 12:07 PM > Subject: [Zope] ZServer *still* dying - help? > > > > :o( > > > > The situation is this - I have a database-driven website that backs onto a > > Postgres 7.1RC1 server - this does not affect the problem, the same thing > > happens with a 7.0.3 and 7.0.2 server on either the same or different > > machines. > > > > I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem > > occurs with both. > > > > I have been able to reproduct this on a minimal install of 2.3.1 (no other > > products). > > > > What's happening - I have a PythonScript that does this: > > > > m = container.machine.SQL_get(machineid=machineid)[0] > > print container.machine.show_html(context,REQUEST, > > param1=m.param1, > > param2=m.param2, > > param3=m.param3, > > param4=m.param4, > > param5=m.param5, > > param6=m.param6, > > param7=m.param7, > > param8=m.param8, > > param9=m.param9, > > param0=m.param0) > > return printed > > > > show_html is a DTML document. When called at "high" speed (2-3 times a > > second) by URL traversal (i.e. GETing > > http://site.name/Zope/path/pythonscript?machineid=whatever) this causes > > either (in order of likelihood): > > > > 1) The 4 child threads of ZServer to die, leaving only the top-level and > > child thread, and a core file > > 2) *One* of the child threads to die, causing the rest of Zope to > completely > > hang (hung inside a SIGSTOP) > > 3) The entire thing to bomb out > > > > *But*, if I reduce the number of named parameters to the DTML method (when > > of course it doesn't render properly) then everything's OK. The current > code > > dies if there are >8 named parameters. But it seems to vary. I thought > that > > the parameters had to be records from an SQL query, but now I'm not so > sure. > > > > If anyone has any ideas, I'd be glad to hear them. Failing that, I'm > giving > > up :o) > > > > Regards, > > Phil > > > > +----------------------------------+ > > | Phil Mayers, Network Support | > > | Centre for Computing Services | > > | Imperial College | > > +----------------------------------+ > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > >

1 0

RE: [Zope] Xron on Zope v.2.3.1
by Spicklemire, Jerry 05 Apr '01

05 Apr '01

Jerry S. said: >> I'm seeing some odd symptoms running Xron jobs on the stable release. >> The schedule time seems to be updating itself, but the processes >> don't seem to be running. to which Loren responded: > Anything of interest in STUPID_LOG_FILE? Actually, I intentionally created these processes to be "outputless", since the Xron doc says: "Any output produced by a XronDTMLMethod is written to the log. A XronDTMLMethod does not have to produce output, but if it does produce output, it may need to set the response headers." Since I don't have very complete access to the host, and can't even read the start and stop scripts, let alone configure them, this seemed like the best approach. Now the disadvantages are starting to show up. After seeing your post about installing "Refresh", and re-naming Xron's __init__, restarting Zope, and "Refresh-ing", it seemed to be worth a try. When "Refresh" unzipped it created a subfolder under the Zope "root". Then it didn't do what I expected because no "Refresh" tabs showed up. That's another topic, though. To test the "fact" that the times keep updating, I tried setting a very short interval. Now it's clear they are not updating so it looks like Xron is "locked" after all. I'll let you know if anything changes. Thanks for your reply, Jerry S.

3 3

RE: [Zope] ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

Sorry - yes, I'm still calling the SQL method, but am passing empty strings for the named parameters instead. I'll try it without calling the method now... Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: 05 April 2001 17:32 To: Mayers, Philip J; zope(a)zope.org Subject: Re: [Zope] ZServer *still* dying - help? Can you clarify? Are you still calling the SQL method? ----- Original Message ----- From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> To: "'Chris McDonough'" <chrism(a)digicool.com>; "Mayers, Philip J" <p.mayers(a)ic.ac.uk>; <zope(a)zope.org> Sent: Thursday, April 05, 2001 12:30 PM Subject: RE: [Zope] ZServer *still* dying - help? > Yes. > > It's now crashing if I pass *any* named parameters. This can't be a corrupt > ZODB (I exported the site as XML, rebuilt the entire of Zope from fresh, > then reinstalled and reimpored) > > Regards, > Phil > > +----------------------------------+ > | Phil Mayers, Network Support | > | Centre for Computing Services | > | Imperial College | > +----------------------------------+ > > -----Original Message----- > From: Chris McDonough [mailto:chrism@digicool.com] > Sent: 05 April 2001 17:11 > To: Mayers, Philip J; zope(a)zope.org > Subject: Re: [Zope] ZServer *still* dying - help? > > > Does the problem happen without the SQL call? E.g., can you just pass > show_html >8 parameters of dummy data and have it crash? > > ----- Original Message ----- > From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> > To: <zope(a)zope.org> > Sent: Thursday, April 05, 2001 12:07 PM > Subject: [Zope] ZServer *still* dying - help? > > > > :o( > > > > The situation is this - I have a database-driven website that backs onto a > > Postgres 7.1RC1 server - this does not affect the problem, the same thing > > happens with a 7.0.3 and 7.0.2 server on either the same or different > > machines. > > > > I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem > > occurs with both. > > > > I have been able to reproduct this on a minimal install of 2.3.1 (no other > > products). > > > > What's happening - I have a PythonScript that does this: > > > > m = container.machine.SQL_get(machineid=machineid)[0] > > print container.machine.show_html(context,REQUEST, > > param1=m.param1, > > param2=m.param2, > > param3=m.param3, > > param4=m.param4, > > param5=m.param5, > > param6=m.param6, > > param7=m.param7, > > param8=m.param8, > > param9=m.param9, > > param0=m.param0) > > return printed > > > > show_html is a DTML document. When called at "high" speed (2-3 times a > > second) by URL traversal (i.e. GETing > > http://site.name/Zope/path/pythonscript?machineid=whatever) this causes > > either (in order of likelihood): > > > > 1) The 4 child threads of ZServer to die, leaving only the top-level and > > child thread, and a core file > > 2) *One* of the child threads to die, causing the rest of Zope to > completely > > hang (hung inside a SIGSTOP) > > 3) The entire thing to bomb out > > > > *But*, if I reduce the number of named parameters to the DTML method (when > > of course it doesn't render properly) then everything's OK. The current > code > > dies if there are >8 named parameters. But it seems to vary. I thought > that > > the parameters had to be records from an SQL query, but now I'm not so > sure. > > > > If anyone has any ideas, I'd be glad to hear them. Failing that, I'm > giving > > up :o) > > > > Regards, > > Phil > > > > +----------------------------------+ > > | Phil Mayers, Network Support | > > | Centre for Computing Services | > > | Imperial College | > > +----------------------------------+ > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > >

1 0

RE: [Zope] ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

Yes. It's now crashing if I pass *any* named parameters. This can't be a corrupt ZODB (I exported the site as XML, rebuilt the entire of Zope from fresh, then reinstalled and reimpored) Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: 05 April 2001 17:11 To: Mayers, Philip J; zope(a)zope.org Subject: Re: [Zope] ZServer *still* dying - help? Does the problem happen without the SQL call? E.g., can you just pass show_html >8 parameters of dummy data and have it crash? ----- Original Message ----- From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> To: <zope(a)zope.org> Sent: Thursday, April 05, 2001 12:07 PM Subject: [Zope] ZServer *still* dying - help? > :o( > > The situation is this - I have a database-driven website that backs onto a > Postgres 7.1RC1 server - this does not affect the problem, the same thing > happens with a 7.0.3 and 7.0.2 server on either the same or different > machines. > > I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem > occurs with both. > > I have been able to reproduct this on a minimal install of 2.3.1 (no other > products). > > What's happening - I have a PythonScript that does this: > > m = container.machine.SQL_get(machineid=machineid)[0] > print container.machine.show_html(context,REQUEST, > param1=m.param1, > param2=m.param2, > param3=m.param3, > param4=m.param4, > param5=m.param5, > param6=m.param6, > param7=m.param7, > param8=m.param8, > param9=m.param9, > param0=m.param0) > return printed > > show_html is a DTML document. When called at "high" speed (2-3 times a > second) by URL traversal (i.e. GETing > http://site.name/Zope/path/pythonscript?machineid=whatever) this causes > either (in order of likelihood): > > 1) The 4 child threads of ZServer to die, leaving only the top-level and > child thread, and a core file > 2) *One* of the child threads to die, causing the rest of Zope to completely > hang (hung inside a SIGSTOP) > 3) The entire thing to bomb out > > *But*, if I reduce the number of named parameters to the DTML method (when > of course it doesn't render properly) then everything's OK. The current code > dies if there are >8 named parameters. But it seems to vary. I thought that > the parameters had to be records from an SQL query, but now I'm not so sure. > > If anyone has any ideas, I'd be glad to hear them. Failing that, I'm giving > up :o) > > Regards, > Phil > > +----------------------------------+ > | Phil Mayers, Network Support | > | Centre for Computing Services | > | Imperial College | > +----------------------------------+ > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://lists.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev ) >

2 1

Re(2): Re(2): [Zope] Cascading Style Sheets in N etscape 6
by ws-news＠gmx.at 05 Apr '01

05 Apr '01

> Sure. In my CSS I have set up this variable: > > .OAA { background-color: green; font-size: 20pt; > font-weight: bold; color: gold; > font-family: Arial, Helvetica, sans-serif; > font-style: italic; } > > I refer to it in the code of my <standard_html_header> as: > > <TD class="OAA" align="center">OUTDOOR ADVENTURE ACTIVITIES</TD> > > Works fine in Netscape 4.75, but not at all in Netscape 6. I have created other > similar variables and Netscape 6 doesn't recognise any of them. The only part > of my CSS is does recognise is: Two things spring to my mind: 1) I heard that Netscape does not like spaces in the definition of stylesheets, especially around the colon. 2) Some versions of Netscape require JavaScript to be enabled to handle CSS, I don't know if this is true for version 6. hth werner -- GMX - Die Kommunikationsplattform im Internet. http://www.gmx.net

4 3

Site Root alternatives ?
by Bernd Dorn 05 Apr '01

05 Apr '01

Hi everybody Is it possible to rewrite urls created by zope in a specific folder without putting a site root into this folder. The reason why i need this is that I don't want the manager of this subfolder(site) to see the siteroot object in this folder. I've got an Apache with proxypass running in front of the zope installation. Maby there is another way to code many virtual hosts. I think of a method which rewrites urls to a specific property of a folder or so. thanks in advance

3 3

Re: [Zope] keeping zope running after closing ssh conection
by Dieter Maurer 05 Apr '01

05 Apr '01

David Kelly writes: > I have just installed zope on a linux ix86 box remotely using > ssh...all went perfectly, managed to start zope and connect up to > the control panel...all when my ssh connection was still open...as > soon as I stopped it I lost contact with zope. > Is there a way to start zope so that it stays running after I close > the ssh connection? Probably, it already helps to start Zope without the "-D" (debug mode) option. If it does not or you want the debug mode, then certainly a "nohup" (--> man nohup) will help. Dieter

2 1

path...
by After Dark 05 Apr '01

05 Apr '01

Hello!! Could somebody tell me if this would work? How should I do to make it work? <dtml-call "REQUEST.set ('path_dir','http://medsaude.lab.bsi.com.br/especialidade')"> <dtml-with path_dir> <dtml-call expr="manage_addFolder( id=pasta, title=titulo)"> </dtml-with> Thanks! ________________________________________________ Don't E-Mail, ZipMail! http://www.zipmail.com/

3 6