- Zope-Dev - Zope lists

Logging after ConflictError Retries
by Malcolm Cleaton 10 Jun '05

10 Jun '05

After a ConflictError causes a request to be retried, a few things go a bit wrong with error handling and logging in the Zope server. 1. If the request is abandoned after repeated ConflictErrors, no error at all appears in the error log. The following change to Zope/App/startup.py appears to fix this, although I'm not sufficiently experienced in the depths of Zope to be sure there are no downsides: 162,163c162 < if REQUEST.supports_retry(): < raise ZPublisher.Retry(t, v, traceback) --- > raise ZPublisher.Retry(t, v, traceback) If a Retry error is raised again here even though we don't support any more retries, the ZServer calls the exception hook again with the Retry error, we throw it again and the error logging is missed. Simply not raising the Retry error again once we don't support any more retries means we fall through to the rest of the exception handling hook, and the ConflictError itself is logged, which I think is right. 2. If there is at least one ConflictError and then the request finishes with an error (either more ConflictErrors or something else), the Z2 log shows the request as having been answered with status 200, although actually a status 500 error response has been served. I've managed to work out what's causing this, but fixing may be more fiddly. What happens is, once the request is abandoned because of the error, when control comes back to publish_module_standard in Publish.py, response.exception() is called on the original response, not on the latest retry. Then, when HTTPResponse _finish() is called, it traces down to the latest retry to find the status code for the logging, which is now the wrong one. I can think of a few things which might fix this, but they all feel like they might also break many other subtle things, and I've got The Fear; can somebody more experienced in the core comment on the Right Way? I've submitted this to the Collector: http://www.zope.org/Collectors/Zope/1805 Thanks, Malcolm. -- [] j a m k i t web solutions for charities malcolm cleaton T: 020 7549 0520 F: 020 7490 1152 M: 07986 563852 W: www.jamkit.com

2 5

[Proposal] Drop Mount.py from ZODB 3.5
by Tim Peters 10 Jun '05

10 Jun '05

http://www.zope.org/Collectors/Zope/1800 describes some of the code problems with Zope's current way of mounting databases. ZODB 3.4 (still) has a Mount.py module, unused and untested by ZODB. Jim and I were both surprised today to discover that Zope (2.8) still imports it, so we can't drop it for ZODB 3.4 (Zope 2.8, and the ZODB 3.4 it uses, are both in beta). We'd like to continue getting non-ZODB code out of the ZODB project, so would like to drop Mount.py from ZODB 3.5. Are any of zodb-dev's "standalone" ZODB users making use of Mount.py? I would be surprised by that too, since Mount.py relies on other code (like Acquisition) that's already been removed from the ZODB 3.3 and 3.4 lines. I've been surprised before, though ...

6 7

spider cache blowout [was RE: [ZODB-Dev] Generational Caching]
by Dylan Jay 09 Jun '05

09 Jun '05

> -----Original Message----- > From: Chris McDonough [mailto:chrism@plope.com] > Sent: Wednesday, 8 June 2005 11:56 AM > To: Dylan Jay > Cc: zodb-dev(a)zope.org > Subject: Re: [ZODB-Dev] Generational Caching > > One way to potentially soften the impact of cache busting by spiders > might be to allow Zope to choose a particular ZODB connection based on > request parameters (like sessionid or requesting ip address, or most > likely user agent in the case of "legitimate" spiders). This is a > modification to Zope that would be largely independent of ZODB, > however, so might be more appropriate to discuss on zope-dev. I think this sounds like a very smart idea. I'll forward this to the zope-dev list. > On Wed, 2005-06-08 at 10:20 +1000, Dylan Jay wrote: > > I've been thinking about the problems of memory use. One use case > > that > seems > > hard is web crawlers. That will wake up a lot of objects for just a > single > > read possibly getting rid of many often used objects from the zodb > cache. > > Has anyone investigated the idea of a generational cache? > > > > Another idea I had was asymetric cache sizes. I believe that zope > > uses a single thread if all requests are serial and just uses the > > other > connections > > when similtanious requests are handled. Since some threads will be > > less > used > > than others perhaps there could be cache settings so memory can be > > minimised. > > > -- Dylan Jay --- http://www.meetmemap.com - makes giving directions easy http://www.pretaweb.com - Update-it-yourself, low cost websites http://www.eatmanifesto.com - against all dumbing down of food Y!:dylan_jay ICQ:520341 MSN:djsq@hotmail.com Ph:+61423198306

1 0

Re: [Zope-Checkins] CVS: Packages/Signals - WinSignalHandler.py:1.1.2.2
by Tim Peters 07 Jun '05

07 Jun '05

[Mark Hammond] > Update of /cvs-repository/Packages/Signals > In directory cvs.zope.org:/tmp/cvs-serv23505 > > Modified Files: > Tag: Zope-2_7-branch > WinSignalHandler.py > Log Message: > As at pywin32-204, we must ensure pywintypes is the first win32 module > imported in our process, otherwise we can end up with 2 pywintypesxx.dll > instances in our process resulting in: > TypeError: The object is not a PySECURITY_ATTRIBUTES object Mark, should Zope's nt_svcutils/service.py also be changed to import pywintypes first? Its import block looks like this now: import sys, os, time, threading, signal import win32api, win32event, win32file, win32pipe, win32process, win32security import win32service, win32serviceutil, servicemanager import pywintypes, winerror, win32con I had "funny problems" getting the Windows ZRS installer to register the ZRS service on older machines, primarily the python.exe - Entry Point Not Found The procedure entry point ?PyWinObject_AsDEVMODE@@YAHPAU_object@@PAPAU_devicemodeA@@H@Z could not be located in the dynamic link library pywintypes23.dll popup box on a machine with an older pywintypes23.dll in the system32 directory.

2 1

proxydict problems in 2.8b2 with Localizer
by Lennart Regebro 07 Jun '05

07 Jun '05

I get "TypeError: object does not support item assignment" in lin 46 och class_init.py. The offending code is "d['_implicit__name__'] = 1" and this is because d is a proxydict. This in turn is caused by Localizer having a class as a class attribute: manage_attributesForm = LocalDTMLFile Apparently, Zope thinks that this class attribute needs a name, but there isn't one. This: manage_attributesForm._needs_name__ = 0 gets rid of the error, but I don't exactly like it. Can anybody shed some light on this, so I can figure out what would be The Right Thing to do? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

3 4

Re: [Zope-Coders] ZClass problem in 2.8 (Was: Re: [Zope-dev] Upcoming Zope 2.8 release)
by Andreas Jung 07 Jun '05

07 Jun '05

--On 7. Juni 2005 16:10:55 +1000 Anthony Baxter <anthony(a)interlink.com.au> wrote: > On Tuesday 07 June 2005 14:27, Andreas Jung wrote: >> This is likely a task for Jim. I don't have any about ZClasses (and I >> won't them). If necessary this problem might be fixed in a later >> release. This problem is not as serious as I could hold up the final 2.8 >> release. This release has to go out now. > > Are working ZClasses no longer a requirement for Zope? (This is not a > flame, just a question). There's plenty of people out there with > ZClass-based products, so if 2.8 is going to ship with broken ZClass, > there should probably be a reasonably prominent warning in the release > notes about this. According to Jim ZClasses are working. A possibly isolated bug in ZClasses is bad but there are in general lots of such bugs in Zope. So this is not a release stopper for me now. We have discussed ZClasses already and about how ZClasses can be maintained in the future. Since I see little commitment to ZClasses (except from Jim) ZClasses are not really a blocker for *this* 2.8.0 release. We defered this release already a bunch of times and it is now time to get 2.8.0 with Five and MVCC support to people. This is much, much more important for Zope than having to care about ZClasses. People can stick with Zope 2.7 if there is a problem for them with ZClasses in the hope that someone fixes outstanding ZClasses in a further 2.8 release. I don't care getting some beatings for my opinon that ZClasses are a neat ancient toy but not the tool of choice for nowadays Zope applications. We need a strong ZODB with MVCC and we need Five to bridge the world to Zope 3. And therefore ZClasses are absolutely not a reason to block the 2.8.0 release. -aj

2 1

Re: [Zope-Checkins] SVN: Zope/branches/Zope-2_8-branch/ preparing 2.8.0 release for tomorrow
by Tim Peters 06 Jun '05

06 Jun '05

[Andreas Jung] > Log message for revision 30622: > preparing 2.8.0 release for tomorrow Andreas, which release will this be? If it's 2.8 final, I need to make a ZODB 3.4 to match it. According to http://www.zope.org/Wikis/DevSite/Projects/Zope2.8/MilestonePlan there wasn't another Zope 2.8 release scheduled until 2005/06/11, so I'm feeling a little lost here.

6 26

OT: Survey facing design patterns and communication
by Nico 06 Jun '05

06 Jun '05

Hello everybody! We are a group of students at "Freie Universitaet Berlin". As part of our computer science studies we are going to do a survey facing the use of design patterns in communication. Examples of design patterns are "Abstract Factory", "Singleton", "Composite", "Iterator" and "Listener". If you know what we are talking about, you are welcome to take part in our survey. It takes about 5 minutes to fill out the form. Just jump to: http://study.beatdepot.de If you agree, we will send you the results of our survey. Thanks in advance for your participation! And sorry for the interruption of your discussion.

1 0

application server standards
by John Doe 02 Jun '05

02 Jun '05

Hi All, Im busy conducting an analysis on some python web appplication servers. I have a few questions with regard to Zope: 1> How scalable is Zope (& how)? 2> With regard to "web application standards" how does it comply: - HTTP protocol support - server-side code execution - client-side code execution - easy integration of javascript for client side checking - any database adapters provided by the framework - communication standards integration - management tools and remote controls 3> How well does Zope rate in the security department? Thanks _____________________________________________________________________ For super low premiums, click here http://www.dialdirect.co.za/quote

2 1

Re: Re: [Zope-dev] CorruptedDataError sniff !
by Eric Brun 02 Jun '05

02 Jun '05

> > Packing is the last thing you should be trying when you have > corruption. In fact I discover the corruption during the pack. There's no mechanical, safe way to recover. Please read > this: > > http://zope.org/Wikis/ZODB/FileStorageBackup This is a great document. I think the origin of the corruption is my RAID controler so I have ask to the server owner to switch for a new server. > > and start by using fstest, then fsrefs, as described there. > > > I run Zope 2.6.2 , ZEO 2 and ZODB 3.1 > > Just noting that it's harder to get help with old releases. I have mount my zodb on a Zope2.7.6 and I'm working on this release to solve my problem. fstest say all is ok. fsrefs say that : " oid 0x37d8e5 BTrees._IIBTree.IIBTree last updated: 2005-05-28 15:48:11.159195, tid=0x35D95942F9CD111L refers to invalid object: oid 0x5d4787 missing: 'BTrees._IIBTree.IIBucket' oid 0x37d8ec BTrees._IOBTree.IOBucket last updated: 2005-05-07 00:56:12.524043, tid=0x35D1BF8356F9844L refers to invalid object: oid 0x39c22b missing: 'BTrees._IIBTree.IIBTree' ........ ...... .... etc "

1 0