- Zope-Dev - Zope lists

ZSQL/ZODB corruption after upgrade
by dan＠control.com 09 Feb '03

09 Feb '03

I'm working on upgrading our Zope 2.3.2/CMF 1.1beta/LoginManager based site to Zope 2.4.4/CMF1.2/exUserFolder (eventually Zope 2.6.1/CMF1.3, but I've been advised to do it version by version). Right now almost everything works on 2.4.4. All of the bits of the LoginManager user folder have be deleted, including ZPatterns, our ZClass based user object, etc. I've added exUserFolder, which seems to work correctly (all of the actual user data remains in a PostgreSQL database). But there's one odd problem... If I open a ZSQL method (any ZSQL method, new or old, inside the area that used to be controlled by LoginManager or not) it seems OK. Using the method works. But if I click on the Advanced tab in the ZMI, I get the following: Zope Error Zope has encountered an error while publishing this resource. Error Type: Could not load oid <gibberish> , pickled data in traceback info may contain clues Error Value: None ... Traceback (innermost last): File /var/local/control/V4/site/zope/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /var/local/control/V4/site/zope/lib/python/ZPublisher/Publish.py, line 187, in publish File /var/local/control/V4/site/zope/lib/python/Zope/__init__.py, line 226, in zpublisher_exception_hook (Object: sqlTest) File /var/local/control/V4/site/zope/lib/python/ZPublisher/Publish.py, line 171, in publish File /var/local/control/V4/site/zope/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_advancedForm) File /var/local/control/V4/site/zope/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_advancedForm) File /var/local/control/V4/site/zope/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: manage_advancedForm) File /var/local/control/V4/site/zope/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: manage_advancedForm) File /var/local/control/V4/site/zope/lib/python/App/special_dtml.py, line 244, in _exec (Object: manage_advancedForm) File /var/local/control/V4/site/zope/lib/python/Shared/DC/ZRDB/DA.py, line 548, in manage_product_zclass_info (Object: sqlTest) File /var/local/control/V4/site/zope/lib/python/ZODB/Connection.py, line 544, in setstate File /var/local/control/V4/site/zope/lib/python/ZODB/Connection.py, line 227, in _persistent_load (Info: ('\x00\x00\x00\x00\x00\x05*\xf6', '(cExtensionClass\nExtensionClass\nq\x01(U\x1eCComMember_PropertySheetsClassq\x02(cZClasses.ZClass\nPersistentClass\nq\x03cProducts.ZPatterns.PropertySheets\nVirtualSheets\nq\x04cZClasses.Property\nZInstanceSheets\nq\x05tq\x06}q\x07(U\x04iconq\x08U\x00U\n_p_changedq\tK\x01U\x07__doc__q\nU\x1aCComMember Property Sheetsq\x0bU\rsimple_topicsq\x0c(U\x08\x00\x00\x00\x00\x00.\xde\x02q\r(U\x11ZClasses.Propertyq\x0eU\x0eZInstanceSheetq\x0fttQU\x11__propset_attrs__q\x10(U\x11member_statisticsq\x11U\x07addressq\x12U\rsimple_topicsq\x13U\x15survey_qualificationsq\x14U\rsubscriptionsq\x15U\npromotionsq\x16tq\x17U\x07addressq\x18(U\x08\x00\x00\x00\x00\x00.\xde\x00q\x19(h\x0eU\x0eZInstanceSheetq\x1attQU\x06_p_oidq\x1bU\x08\x00\x00\x00\x00\x00\x05*\xf6q\x1cU\x15survey_qualificationsq\x1d(U\x08\x00\x00\x00\x00\x00p\xd1\x80q\x1e(h\x0eU\x0eZInstanceSheetq\x1fttQh\x15(U\x08\x00\x00\x00\x00\x00r%\xdfq (h\x0eU\x0eZInstanceSheetq!ttQU\t_p_serialq"U\x08\ x03C\x8d\x17\xda\x88MDq#U\x11member_statisticsq$(U\x08\x00\x00\x00\x00\x00\x13\x0b\xa7q%(h\x0eU\x0eZInstanceSheetq&ttQU\n__module__q\'Nh\x16(U\x08\x00\x00\x00\x00\x00r%\xe1q((h\x0eU\x0eZInstanceSheetq)ttQutq*t.N.')) Could not load oid <gibberish> pickled data in traceback info may contain clues: (see above) Obviously not all of the LoginManager stuff was correctly deleted. How can I get this junk out of the ZODB? Help, Dan Pierson

3 2

Persisting PIL.Image instances in Zope?
by Michael R. Bernstein 09 Feb '03

09 Feb '03

This is a repost from the zope(a)zope.org mailing list, as I got no responses there. For a number of reasons, I find myself wanting to persist instances of PIL.Image in the ZODB. Ideally, such a subclass of PIL.Image and Persistent would also be API-compatible with OFS.Image, but I'd be willing to live without this. Does anyone already have something like this developed with the bugs worked out? I'd rather not reinvent this particular wheel if I don't have to. -- Michael R. Bernstein <webmaven(a)lvcm.com>

1 0

robustness in management interface.
by Romain Slootmaekers 09 Feb '03

09 Feb '03

Hi, The zope management interface has some robustness problems: whenever you call manage_workspace (the normal way of managing a folder through the HTML Zope management interface) on a folder X, and some object y in that folder gives an error (fi, it has no title attribute, ) the whole folder becomes unmanageble. The only thing you can do at that point is to manually delete the problematic object by typing: http://..../X/manage_delObjects?ids=y It seems to me that an object in a folder should not interfere with the management of the folder (at least, you should be able to throw the object out of the folder) probably, a try/except or <dtml-try> in the right place fix this. have fun, Sloot.

4 4

Some gcc warnings building zope 2.6.1
by Luca - De Whiskey's - De Vitis 09 Feb '03

09 Feb '03

Hi, I got these warnings building zope (you might be interested in fixing some/all of them): BTrees/BucketTemplate.c:214: warning: `bucket_append' defined but not used BTrees/BucketTemplate.c:214: warning: `bucket_append' defined but not used BTrees/BucketTemplate.c:214: warning: `bucket_append' defined but not used lib/python/Shared/DC/xml/pyexpat/expat/xmlparse/xmlparse.c:2341: warning: `errorProcessor' defined but not used In file included from lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok.c:260: lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c: In function `normal_getAtts': lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c:1394: warning: `open' might be used uninitialized in this function In file included from lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok.c:653: lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c: In function `little2_getAtts': lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c:1394: warning: `open' might be used uninitialized in this function In file included from lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok.c:792: lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c: In function `big2_getAtts': lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok_impl.c:1394: warning: `open' might be used uninitialized in this function lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok.c: In function `initScan': lib/python/Shared/DC/xml/pyexpat/expat/xmltok/xmltok.c:1494: warning: subscript has type `char' lib/python/Shared/DC/xml/pyexpat/dcpyexpat.c: In function `my_StartElementHandler': lib/python/Shared/DC/xml/pyexpat/dcpyexpat.c:73: warning: `attrs_k' might be used uninitialized in this function lib/python/Shared/DC/xml/pyexpat/dcpyexpat.c: In function `initdcpyexpat': lib/python/Shared/DC/xml/pyexpat/dcpyexpat.c:718: warning: unused variable `rev' ciao, -- Luca - De Whiskey's - De Vitis | Elegant or ugly code as well aliases: Luca ^De [A-Z][-A-Za-z]*[iy]'?s$ | as fine or rude sentences have Infinite loop: see `Loop, infinite'. | something in common: they Loop, infinite: see `Infinite loop'. | don't depend on the language.

1 0

just 2 bits on stupid_clean
by Luca - De Whiskey's - De Vitis 09 Feb '03

09 Feb '03

Hi, to let the 'find' in stupid_clean remove even file names with spaces you may replace it with: find . -name '*.o' -o -name '*.so' -o -name '*.py[co]' -o -name 'core*' | while read file do rm -f "$file" done It's not clear to me why you put that command in a separate file, but the clean target of the main Makefile could easily look like: BUILDED_FILE=-name '*.o' -o -name '*.so' -o -name '*.py[co]' -o -name 'core*' clean: find . $(BUILDED_FILE) | \ while read file ;\ do rm -f "$file" ;\ done rm -rf lib/python/build I added last call to rm since no Makefile removes lib/python/build. ciao, -- Luca - De Whiskey's - De Vitis | Elegant or ugly code as well aliases: Luca ^De [A-Z][-A-Za-z]*[iy]'?s$ | as fine or rude sentences have Infinite loop: see `Loop, infinite'. | something in common: they Loop, infinite: see `Infinite loop'. | don't depend on the language.

1 0

(no subject)
by Anitha George 09 Feb '03

09 Feb '03

Hi all I am trying to develop a Document Management System in zope.The features that have to be implemented managing folders,maintaining versions of an object,uploading a file,etc.I believe Zope supports all these features. I am planning to build an interface above the Zope ZMI and use these features. For this I have to understand which are the library files which carry out this function of managing folders and maintaining versions. Could any of you please help me out in understanding the Zope API i.e which are the libraries and files used for the above mentioned features so that I can implement it in my appication. Please help me out.I would be really grateful.Thanks in advance.Awaiting a quick response. Regards, Anitha _________________________________________________________________ The new MSN 8: advanced junk mail protection and 2 months FREE* http://join.msn.com/?page=features/junkmail

4 3

Does zope still need a python compiled with "--without-pymalloc" ?
by Dario Lopez-Kästen 08 Feb '03

08 Feb '03

Hi, well, the subject says it all. Why was it needed at all? I still compile my python --without-pymalloc from the pre-python-2.1.3 days when zope suffered from bugs in python. I nowadays use Zope-2.5.1 and python 2.1.3, mostly. Thanks, /dario - -------------------------------------------------------------------- Dario Lopez-Kästen, dario(a)ita.chalmers.se IT Systems & Services System Developer/System Administrator Chalmers University of Tech.

3 3

Re: [Zope-dev] What makes Zope twirl?
by Gilles 08 Feb '03

08 Feb '03

Hello, I am working since a long time with zope and was continuously worried about a few problems, unfortunately none of them was fixed along the years: - zserver can not 'recover' busy thread - log show nothing in case of blocking: log is written when the request is completed, and the log is not flushed at every request. I don't thing Big-M will help. - when all thread are busy there is no way to access zope, even to restart it. I try to fix this several year ago (I am not an expert of zserver) with timeout-socket: no luck So if you find a solution to avoid the lock, please email me. I just know the monitoring/restarting solution. I can just tell that having a very basic zope system seams to help: the one I speak bellow use Zope + Psyco db adapter product. Nothing else, it run behind apache and until now I had no blocking situation, that's since 4 months. The annoying thing about this is when you tell other IT peoples: Zope is very nice, powerful, free, but there is maybe a stability problem. Then later on you see thoses guys going for another solution. I am working for the European-Space-Agency and I can tell that at my site (Italie) there is only one extranet site Zope powered, made by me, and I promote zope since years(or zope 1.0). Obviously I am not a good 'promoter' gilles ----- Original Message ----- From: "Paul Winkler" <pw_lists(a)slinkp.com> To: <zope-dev(a)zope.org> Sent: Thursday, February 06, 2003 9:24 PM Subject: [Zope-dev] What makes Zope twirl? > > > > > Or: when zope goes into a nonresponsive state, > what can you do to diagnose the cause? > > The even that prompts this question: > > Our production system (2 zeo clients) went down today. > Platform: Linux 2.4, Zope 2.5.1 from source (wo_pcgi), > Python 2.1.3 from source, running behind Apache > for one site, and a custom java proxy for another site > (don't ask). ZServer is not exposed to anything > except the servers running Apache and the Java proxy. > > All the zope processes were still running, > CPU usage was low (almost nil for python), * > there was plenty of free physical memory & swap. > Yet Zope was not responding to requests. > A look at the access logs revealed that > zope had not logged anything since the time > we noticed the outage. Nothing > unusual before that except AltaVista crawling our site > (a measly 2 requests / second). > > A restart seemed to fix everything, though one > of the zeo servers went down again (same symptoms) > about 20 minutes after starting. Restarted it again > and both servers have been fine for hours now. > > This seems to be rare; I haven't seen it before on > this particular server, but I saw a similar wedge > on our dev machine about 3 weeks ago. > > I've looked at ALL the logs (access log, zeo log, > zope stdout / stderr log) and found nothing at all > unusual, just the aforementioned AltaVista crawl > and a couple of RAM Cache errors from non-pickleable > objects that I need to dis-associate from the cache. > But none of this is new. > > Is it time for "Big M"? WOuld that give me anything > useful? > > > * this does not sound like other zope "spins" > I have heard of, in which python eats 99% CPU > indefinitely due to (probably) an application error. > see for example: > http://www.zopezen.org/Members/zopista/News_Item.2003-01-28.1025 > > > -- > > Paul Winkler > http://www.slinkp.com > Look! Up in the sky! It's CAPTAIN STETOSCOPE! > (random hero from isometric.spaceninja.com) > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > > >

4 3

What makes Zope twirl?
by Paul Winkler 08 Feb '03

08 Feb '03

Or: when zope goes into a nonresponsive state, what can you do to diagnose the cause? The even that prompts this question: Our production system (2 zeo clients) went down today. Platform: Linux 2.4, Zope 2.5.1 from source (wo_pcgi), Python 2.1.3 from source, running behind Apache for one site, and a custom java proxy for another site (don't ask). ZServer is not exposed to anything except the servers running Apache and the Java proxy. All the zope processes were still running, CPU usage was low (almost nil for python), * there was plenty of free physical memory & swap. Yet Zope was not responding to requests. A look at the access logs revealed that zope had not logged anything since the time we noticed the outage. Nothing unusual before that except AltaVista crawling our site (a measly 2 requests / second). A restart seemed to fix everything, though one of the zeo servers went down again (same symptoms) about 20 minutes after starting. Restarted it again and both servers have been fine for hours now. This seems to be rare; I haven't seen it before on this particular server, but I saw a similar wedge on our dev machine about 3 weeks ago. I've looked at ALL the logs (access log, zeo log, zope stdout / stderr log) and found nothing at all unusual, just the aforementioned AltaVista crawl and a couple of RAM Cache errors from non-pickleable objects that I need to dis-associate from the cache. But none of this is new. Is it time for "Big M"? WOuld that give me anything useful? * this does not sound like other zope "spins" I have heard of, in which python eats 99% CPU indefinitely due to (probably) an application error. see for example: http://www.zopezen.org/Members/zopista/News_Item.2003-01-28.1025 -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's CAPTAIN STETOSCOPE! (random hero from isometric.spaceninja.com)

3 3

RE: [Zope-dev] Zope Server Control
by sean.upton＠uniontrib.com 07 Feb '03

07 Feb '03

The buttons work; you are not clicking with enough pressure. Try again until your wrist hurts. ;) I agree, this looks nice. I also wonder about adding total memory usage for each Zope ZEO client. Also, this layout could be tweaked to have a more vertical look and likely work in a PyQT app on the Zaurus or similar handheld. Sean -----Original Message----- From: Paul Winkler [mailto:pw_lists@slinkp.com] Sent: Friday, February 07, 2003 1:47 PM To: zope-dev(a)zope.org Subject: Re: [Zope-dev] Zope Server Control On Fri, Feb 07, 2003 at 03:16:46PM -0500, Shane Hathaway wrote: > Okay, I added some features to the mockup: > > http://hathaway.freezope.org/Images/controller_snapshot2.png I dig it. (clicking on the mockup buttons) Ungh. Can't seem to make it work. (drool drool) -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's AMERICAN TWIN THE MAYOR OF REVENGE! (random hero from isometric.spaceninja.com) _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )

1 0