- Zope - Zope lists

Re: [Zope] Get Column Names from SQL Query?
by Dieter Maurer 05 Apr '01

05 Apr '01

Thomas B. Passin writes: > But it will be in your book, right? Currently, I do not expect it. The book should come with complete examples, ready to be examined and run. Incorporating an external database seems to be too demanding. Gadfly, on the other hand, seems to be not thread safe. Thus, I should probably not use this, either. This probably means, I will skip relational database integration (which is covered in the Zope book). Dieter

1 0

Virtual Hosting on ZServer Updated
by Capesius, Alan 05 Apr '01

05 Apr '01

Here's an update to my virtual hosting on ZServer solution. The AccessRule has been enhanced to allow access to aliased host names that are not in the host.domain.com form but rather in a host format. This is useful if you use a hosts file with a name for a server (e.g. server01 instead of www.domain.com) The change prevents an index error in the accessrule. Request not in domain.com form will revert to the default site. The solution uses TinyTable, Virtual Host Monster and AccessRule and a DTML method to process all inbound requests by domain name similar to the way in which SiteRoot script things. The best part is that once set, the AccessRule does not need to be modified to add new hosts. Host to folder mapping is performed via entries in the TinyTable, the rest of the configuration is static. Tested with Zope 2.3.0 and TinyTable 0-8-2. Virtual Host Monster and AccessRule support are built into 2.3.0 Here it is: Create a folder in Root called VHosts Inside VHosts create a folder for each Virtual host Inside each new Virtual host's folder , create a Virtual Host Monster called VHM Inside VHosts, create a TinyTable called HostsTable Give the Tiny Table the following columns : domain, folder Create records for domain to folder mapping as shown here: "domain1.com", "Folder1" "domain2.com", "Folder2" Where the domain names are the virtual names for your server and the folder names are the folders created inside VHosts. Entries are CASE SENSITIVE and MUST match the folder names created in the earlier step. Enter all domains in lower case. Inside VHosts create the following DTML Method: Name: gethostfolder <dtml-in "VHosts.HostsTable(domainname)"> <dtml-return folder> <dtml-else> <dtml-return "'NULL'"> </dtml-in> In the Root, create a DTML called AccessRule AccessRule in Root Folder =================== <dtml-try> <dtml-let hostname="_.string.split(_.string.lower(_.string.split(HTTP_HOST, ':')[0]),'.')[-2:]" domainname="hostname[0] + '.' + hostname[1]" vhmcode="VHosts.gethostfolder(_.None, _, host=domainname)"> <dtml-if "vhmcode<>'NULL'"> <dtml-if "_.string.split(_.string.lower(PATH_INFO), '/')[-1:]==['manage'] or _.string.split(_.string.lower(PATH_INFO), '/')[-1:]==['manage_main'] or _.string.split(_.string.lower(PATH_INFO), '/')[-1:]==['manage_workspace'] "> <dtml-if "TraversalRequestNameStack[-2:]<>[vhmcode,'VHosts']"> <dtml-call "REQUEST['TraversalRequestNameStack'].extend([vhmcode, 'VHosts'])"> </dtml-if> <dtml-else> <dtml-call "REQUEST['TraversalRequestNameStack'].extend(['VHM', vhmcode, 'VHosts'])"> </dtml-if> </dtml-if> </dtml-let> <dtml-except> </dtml-try> It should look like this: Root- AccessRule VHosts- HostsTable gethostfolder Folder1- VHM index_html Folder2- VHM index_html Security Settings: gethostfolder method: no anonymous access, proxy as manager, manager has full rights. HostsTable: No anonymous access, manager full rights AccessRule: Proxy as manager Now, to enable the system, Use the Root folder's Add->SetAccessRule option and enter "AccessRule" (without quotes) and click Set. Requests for domain1.com will be drawn from Folder1, 2 from 2 etc.. Managent of the virtual domain will show only the VHosts folder contents for the selected site. Management of the root site will show the root. Access to unsupported domains will fall back to root. (perhaps to be a redirect to a 404 page in the future) Display the mappings with /VHosts/HostsTable or via the management interface. Use http://hostname/_SUPPRESS_ACCESSRULE/manage to deactivate the AccessRule if you have any problems accessing the system. All feedback welcome. To the list please. I will add the config to my tips site shortly. Alan Capesius, MCSE Tech World, Inc. http://twsite.bizland.com/zopetips.htm

1 0

RE: [Zope] Finding out how many rows is selected in database
by paul_s_johnson＠urscorp.com 05 Apr '01

05 Apr '01

If a ZSQL method returns no rows its value is None, right? why not: <dtml-if zsql_queryname> Hey, something was returned by ZSQL method! <dtml-else> Hey, nothing was returned by ZSQL method. </dtml-if> >On 05 Apr 2001 09:57:14 -0500, Steve Drees wrote: >> > I need to do one thing if any rows is returned and another if there is >> > no records in the database >> >> http://zope.nipltd.com/public/lists/zope-archive.nsf/ByKey/BEBF9A98F9A59B3F > >Thanx but it only helped a bit ... >See he has the same problem as me - if need to do one thing if there are >records returned and another if no records are returned. >Actually I need to add a new item to my database with one number higher >than the item with the highest number, e.g. if there are an item in the >database with number 2 then the new one must have number 3. >And if there are no items then the new one must have number 1. > >ANy good ideas ? >The ones I got earlyer doesn't work > >Gitt Use of an AUTO_INCREMENT field makes maintaining this easier. It will automatically create a value 1 greater than the existing maximum. _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

1 0

path...
by After Dark 05 Apr '01

05 Apr '01

--- the forwarded message follows --- ________________________________________________ Don't E-Mail, ZipMail! http://www.zipmail.com/

1 0

RE: [Zope] Xron on Zope v.2.3.1
by Spicklemire, Jerry 05 Apr '01

05 Apr '01

Hi again, After searching for recent posts related to Zope v.2.3.1, the Catalog, and BTree, I came across this one, from Chris M., which includes a small patch: http://lists.zope.org/pipermail/zope/2001-April/087015.html After applying the patch to: /lib/python/SearchIndex/GlobbingLexicon.py Xron has regained consciousness and started running jobs again, and has resumed writing coherent log entries. Thanks for Xron, and the tips! Jerry S.

1 0

ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

:o( The situation is this - I have a database-driven website that backs onto a Postgres 7.1RC1 server - this does not affect the problem, the same thing happens with a 7.0.3 and 7.0.2 server on either the same or different machines. I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem occurs with both. I have been able to reproduct this on a minimal install of 2.3.1 (no other products). What's happening - I have a PythonScript that does this: m = container.machine.SQL_get(machineid=machineid)[0] print container.machine.show_html(context,REQUEST, param1=m.param1, param2=m.param2, param3=m.param3, param4=m.param4, param5=m.param5, param6=m.param6, param7=m.param7, param8=m.param8, param9=m.param9, param0=m.param0) return printed show_html is a DTML document. When called at "high" speed (2-3 times a second) by URL traversal (i.e. GETing http://site.name/Zope/path/pythonscript?machineid=whatever) this causes either (in order of likelihood): 1) The 4 child threads of ZServer to die, leaving only the top-level and child thread, and a core file 2) *One* of the child threads to die, causing the rest of Zope to completely hang (hung inside a SIGSTOP) 3) The entire thing to bomb out *But*, if I reduce the number of named parameters to the DTML method (when of course it doesn't render properly) then everything's OK. The current code dies if there are >8 named parameters. But it seems to vary. I thought that the parameters had to be records from an SQL query, but now I'm not so sure. If anyone has any ideas, I'd be glad to hear them. Failing that, I'm giving up :o) Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+

3 4

Re: Re[4]: Optimizing ZOPE
by alan runyan 05 Apr '01

05 Apr '01

> Not exactly. It's a combination of server load (long requests) and > other objects that are read. I think that the transaction management > of Zope have problems with request on objects that take a long time. > So if a request takes too much time and another request want to access > another object than it might crash. have you tried to use the logging features of ZOPE? z2.py STUPID_FILE_LOGGER=var/Zope.log I got this information from http://www.zope.org/Members/michel/Projects/Interfaces/LOGGING.txt/ I really would like to help try to solve your problems and then we could try to bring them up to Digital Creations. ZOPE is a really decent product and the problems I've seen are people not architecting ZOPE around their problem (this is not intuitive, like some of ZOPE) but solving their problems with ZOPE (more intuitive) disregarding how ZOPE works (things should be abit more bullet proof). > No. I switched off the syncing and the problems are the same. In debug > mode of zope I get error messages on console like 'conflict competing > write ...'. It seems that zope have bugs rendering the DTML sites to > HTML. That problem does not break every request when this message > occurs. I believe the STUPID_FILE_LOGGER will give you more information on this. I should have brought it up earlier. and we should have been discussing this on the ZOPE mailing list so we could have this archived. those conflict competing writes usually have path associated with it. are all of these occuring in the same location in the ZODB? > On Windows sometimes it breaks nothing, sometimes only this request > (thread) breaks and sometimes the complete zope crashes and the > process is killed or sometimes the process runs but handles no > requests. We get this kind of error at least once a day (on good days) > and every hour on bad days depending on load I think. yikes, this is very bad. Andy McKay has helped port ActiveStates website to ZOPE and I wonder if they are experience the same problems. > On Linux it's no problem, because the worse case is that the thread is > killed and started again. Zope is NOT completely killed or hangs. All > 2-3 months the process crashes, but a little shell script restarts it > and all is fine. there is no doubt that ZOPE has more experience and is favored to run on *nix ,from what I understand. > Yes. The main point is that you should use zope's capabilities as less > as possible for such big projects. I use zope nearly only for DTML and > user authorization. Big Files are in filesystem, database is SQL, > backend is python, some functions of zope are patched (username > logging of http_server.py, my own error pages for HTML errors; e.g. > 404, 401, ...). So I don't really use all zope's possibilities, but > it's too slow anyway. the big files should be served from apache and not ZOPE. that is the lesson to be learned I believe. > example: > I wrote some little benchmarking tests. I do a search query with about > 40 objects as result. These objects (complete classes with data and > methods) are return to DTML as a list. DTML access the data to display > with methods like 'getDate', 'getName', 'get....'. The backend > generates these objects and sets the values with methods 'setDate', > 'setName' ,.... . I benchmarked it and the result was that this search > request needs 1829ms (no exact value, because of python benchmark > script; I think it's a little bit faster than this values). Than I began > to optimize and test some methods, functions, ... to get slow > commands. I tried to avoid these complex objects, generate only simple > container classes that contains only plain data. I access these values > from DTML directly with obj.date, obj.name, obj.xxx. I left all > methods and complex things out. I read MIME type information on > download and not at file object generating time. I left out my python > function 'quoteForHTML' that do the HTML Quoting for all special chars > (I will write a python C module these days if I find no other way). > And the result was for the same request it took only 400ms. So I have > to optimize all my code to get it work. That's not simple. The code is > about 11500 lines. And the object oriented handling is thrown away for > DTML requests because of speed problems. Python and Zope are not fast > enough for that complex backend. This code in PHP would be faster and > does not end in crashes. PHP code is so ugly that I don't want it, but > it is stable. > You say the code is 11500 lines long. You are using German characters I assume, I wonder if this is causing any problem? there is a german ZOPE company beehive that you may want to get in touch with. they have some extensive experience and may be able to out, http://www.beehive.de/index.html . this is why I would like to see your problem solved. I have used PHP in the past and am not a big fan. It is stable, fast, and has a larger community. How experience with Python are you? I see you had setName getName, in python you usually directly set/get attributes with instance.property=value and value=instance.property, overloading __setattr__ and __getattr__ if you wanted to do a tiny more than set/get values as well. > Who are you exactly ? It seems that you know a lot about zope. Are you > developing on zope ? I read you brought up ZEO, right ? I'm just some programmer in Texas, USA. I have been reading and playing with ZOPE for almost two years. I am not developing on ZOPE, but may start in the next few months (I just lost my job this week). I have not done anything with ZEO besides getting it up and running in a test environment -- nothing production such as your case. I'm CCing the ZOPE list. ~runyaga

2 1

RE: [Zope] ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

Ok, it still crashes even if you don't call the ZSQL method. *But*, I'm seeing massive inconsistencies here - I just undid ten minutes of changes to get it back to crashing, then redid them back to where I was (not crashing) and *this* time it's crashing. <Sigh> I'll try to get it pinned down a little. Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Mayers, Philip J Sent: 05 April 2001 17:33 To: 'Chris McDonough'; Mayers, Philip J; zope(a)zope.org Subject: RE: [Zope] ZServer *still* dying - help? Sorry - yes, I'm still calling the SQL method, but am passing empty strings for the named parameters instead. I'll try it without calling the method now... Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: 05 April 2001 17:32 To: Mayers, Philip J; zope(a)zope.org Subject: Re: [Zope] ZServer *still* dying - help? Can you clarify? Are you still calling the SQL method? ----- Original Message ----- From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> To: "'Chris McDonough'" <chrism(a)digicool.com>; "Mayers, Philip J" <p.mayers(a)ic.ac.uk>; <zope(a)zope.org> Sent: Thursday, April 05, 2001 12:30 PM Subject: RE: [Zope] ZServer *still* dying - help? > Yes. > > It's now crashing if I pass *any* named parameters. This can't be a corrupt > ZODB (I exported the site as XML, rebuilt the entire of Zope from fresh, > then reinstalled and reimpored) > > Regards, > Phil > > +----------------------------------+ > | Phil Mayers, Network Support | > | Centre for Computing Services | > | Imperial College | > +----------------------------------+ > > -----Original Message----- > From: Chris McDonough [mailto:chrism@digicool.com] > Sent: 05 April 2001 17:11 > To: Mayers, Philip J; zope(a)zope.org > Subject: Re: [Zope] ZServer *still* dying - help? > > > Does the problem happen without the SQL call? E.g., can you just pass > show_html >8 parameters of dummy data and have it crash? > > ----- Original Message ----- > From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> > To: <zope(a)zope.org> > Sent: Thursday, April 05, 2001 12:07 PM > Subject: [Zope] ZServer *still* dying - help? > > > > :o( > > > > The situation is this - I have a database-driven website that backs onto a > > Postgres 7.1RC1 server - this does not affect the problem, the same thing > > happens with a 7.0.3 and 7.0.2 server on either the same or different > > machines. > > > > I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem > > occurs with both. > > > > I have been able to reproduct this on a minimal install of 2.3.1 (no other > > products). > > > > What's happening - I have a PythonScript that does this: > > > > m = container.machine.SQL_get(machineid=machineid)[0] > > print container.machine.show_html(context,REQUEST, > > param1=m.param1, > > param2=m.param2, > > param3=m.param3, > > param4=m.param4, > > param5=m.param5, > > param6=m.param6, > > param7=m.param7, > > param8=m.param8, > > param9=m.param9, > > param0=m.param0) > > return printed > > > > show_html is a DTML document. When called at "high" speed (2-3 times a > > second) by URL traversal (i.e. GETing > > http://site.name/Zope/path/pythonscript?machineid=whatever) this causes > > either (in order of likelihood): > > > > 1) The 4 child threads of ZServer to die, leaving only the top-level and > > child thread, and a core file > > 2) *One* of the child threads to die, causing the rest of Zope to > completely > > hang (hung inside a SIGSTOP) > > 3) The entire thing to bomb out > > > > *But*, if I reduce the number of named parameters to the DTML method (when > > of course it doesn't render properly) then everything's OK. The current > code > > dies if there are >8 named parameters. But it seems to vary. I thought > that > > the parameters had to be records from an SQL query, but now I'm not so > sure. > > > > If anyone has any ideas, I'd be glad to hear them. Failing that, I'm > giving > > up :o) > > > > Regards, > > Phil > > > > +----------------------------------+ > > | Phil Mayers, Network Support | > > | Centre for Computing Services | > > | Imperial College | > > +----------------------------------+ > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > >

1 0

RE: [Zope] Xron on Zope v.2.3.1
by Spicklemire, Jerry 05 Apr '01

05 Apr '01

Jerry S. said: >> I'm seeing some odd symptoms running Xron jobs on the stable release. >> The schedule time seems to be updating itself, but the processes >> don't seem to be running. to which Loren responded: > Anything of interest in STUPID_LOG_FILE? Actually, I intentionally created these processes to be "outputless", since the Xron doc says: "Any output produced by a XronDTMLMethod is written to the log. A XronDTMLMethod does not have to produce output, but if it does produce output, it may need to set the response headers." Since I don't have very complete access to the host, and can't even read the start and stop scripts, let alone configure them, this seemed like the best approach. Now the disadvantages are starting to show up. After seeing your post about installing "Refresh", and re-naming Xron's __init__, restarting Zope, and "Refresh-ing", it seemed to be worth a try. When "Refresh" unzipped it created a subfolder under the Zope "root". Then it didn't do what I expected because no "Refresh" tabs showed up. That's another topic, though. To test the "fact" that the times keep updating, I tried setting a very short interval. Now it's clear they are not updating so it looks like Xron is "locked" after all. I'll let you know if anything changes. Thanks for your reply, Jerry S.

3 3

RE: [Zope] ZServer *still* dying - help?
by Mayers, Philip J 05 Apr '01

05 Apr '01

Sorry - yes, I'm still calling the SQL method, but am passing empty strings for the named parameters instead. I'll try it without calling the method now... Regards, Phil +----------------------------------+ | Phil Mayers, Network Support | | Centre for Computing Services | | Imperial College | +----------------------------------+ -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: 05 April 2001 17:32 To: Mayers, Philip J; zope(a)zope.org Subject: Re: [Zope] ZServer *still* dying - help? Can you clarify? Are you still calling the SQL method? ----- Original Message ----- From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> To: "'Chris McDonough'" <chrism(a)digicool.com>; "Mayers, Philip J" <p.mayers(a)ic.ac.uk>; <zope(a)zope.org> Sent: Thursday, April 05, 2001 12:30 PM Subject: RE: [Zope] ZServer *still* dying - help? > Yes. > > It's now crashing if I pass *any* named parameters. This can't be a corrupt > ZODB (I exported the site as XML, rebuilt the entire of Zope from fresh, > then reinstalled and reimpored) > > Regards, > Phil > > +----------------------------------+ > | Phil Mayers, Network Support | > | Centre for Computing Services | > | Imperial College | > +----------------------------------+ > > -----Original Message----- > From: Chris McDonough [mailto:chrism@digicool.com] > Sent: 05 April 2001 17:11 > To: Mayers, Philip J; zope(a)zope.org > Subject: Re: [Zope] ZServer *still* dying - help? > > > Does the problem happen without the SQL call? E.g., can you just pass > show_html >8 parameters of dummy data and have it crash? > > ----- Original Message ----- > From: "Mayers, Philip J" <p.mayers(a)ic.ac.uk> > To: <zope(a)zope.org> > Sent: Thursday, April 05, 2001 12:07 PM > Subject: [Zope] ZServer *still* dying - help? > > > > :o( > > > > The situation is this - I have a database-driven website that backs onto a > > Postgres 7.1RC1 server - this does not affect the problem, the same thing > > happens with a 7.0.3 and 7.0.2 server on either the same or different > > machines. > > > > I have tried using PoPy/ZPoPyDA or psycopg/ZPsycopgDA - the same problem > > occurs with both. > > > > I have been able to reproduct this on a minimal install of 2.3.1 (no other > > products). > > > > What's happening - I have a PythonScript that does this: > > > > m = container.machine.SQL_get(machineid=machineid)[0] > > print container.machine.show_html(context,REQUEST, > > param1=m.param1, > > param2=m.param2, > > param3=m.param3, > > param4=m.param4, > > param5=m.param5, > > param6=m.param6, > > param7=m.param7, > > param8=m.param8, > > param9=m.param9, > > param0=m.param0) > > return printed > > > > show_html is a DTML document. When called at "high" speed (2-3 times a > > second) by URL traversal (i.e. GETing > > http://site.name/Zope/path/pythonscript?machineid=whatever) this causes > > either (in order of likelihood): > > > > 1) The 4 child threads of ZServer to die, leaving only the top-level and > > child thread, and a core file > > 2) *One* of the child threads to die, causing the rest of Zope to > completely > > hang (hung inside a SIGSTOP) > > 3) The entire thing to bomb out > > > > *But*, if I reduce the number of named parameters to the DTML method (when > > of course it doesn't render properly) then everything's OK. The current > code > > dies if there are >8 named parameters. But it seems to vary. I thought > that > > the parameters had to be records from an SQL query, but now I'm not so > sure. > > > > If anyone has any ideas, I'd be glad to hear them. Failing that, I'm > giving > > up :o) > > > > Regards, > > Phil > > > > +----------------------------------+ > > | Phil Mayers, Network Support | > > | Centre for Computing Services | > > | Imperial College | > > +----------------------------------+ > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > >

1 0