February 2002 - Zope-Dev

Transaction error on Zopesite DB
by Scott Burton 08 Feb '02

08 Feb '02

I keep getting a transaction error which renders my entire ODB unwritable on Zopesite.com just about everyday. I can go in and repair it with fsrecover fine. It comes back up just great and I can write to the DB again. A day later same transaction error. I have thousands and thousands of instances of multiple products in the ODB. The actual DB size is only about 200 megs. I am sure there could be many many reasons for this happening. I am just wondering where to start? Scott _________________________________________________________________ Get your FREE download of MSN Explorer at http://explorer.msn.com/intl.asp.

3 2

Newbie: manage_add DTML access to product variables
by John Hall 08 Feb '02

08 Feb '02

I'm fairly new to Zope and Python, so please forgive me if this is a stupid question. I'm trying to add a new exUserFolder authentication plugin using LDAP. I've copied the Radius plugin for the most part and have almost everything working except I wanted to have a list of possible methods (ways of using the LDAP database to authenticate a user) that the Zope Admin chooses from on the manage_add DTML page. I can't figure out how to keep the list in the python code for the object where it would be easy to update when I add new methods, but still access the list in my manage_add DTML page in a <dtml-in> loop. When the manage_add DTML is rendered, my object does not yet exist (the admin's response to the manage_add page is passed to a python function that actually creates the object). I have two questions, then. 1. How do I format an object to use in a <dtml-in> loop? (I'm thinking it needs to be a list of dict's). 2. How do I access a function or variable in a Product's python code directly from DTML (or how do I add a callable method in Zope's DTML namespace from a Product's python code?) I think my major problem here is lack of understanding of how Products are accesible within the DTML namespace. Thanks in advance, JMH

3 3

2.5.0 locale problems
by Igor Stroh 08 Feb '02

08 Feb '02

Hi there, are there any known problems with zope 2.5.0 and locale module? This piece of code [1] produces an error when I try to refresh/install a product that contains the code, though it works just fine if I just execute it in the python shell. The same product works well in zope 2.4.2... [1]: import locale locale.setlocale(locale.LC_ALL, '') error returned: Traceback (innermost last): File /usr/lib/zope/lib/python/App/RefreshFuncs.py, line 183, in performSafeRefresh File /usr/lib/zope/lib/python/App/RefreshFuncs.py, line 170, in performRefresh File /usr/lib/zope/lib/python/OFS/Application.py, line 758, in reimport_product File /usr/lib/zope/lib/python/OFS/Application.py, line 531, in import_product File /usr/lib/zope/lib/python/Products/SPIntranet/__init__.py, line 60, in ? File /usr/lib/zope/lib/python/Products/SPIntranet/SPIntranetBaseFolder.py, line 74, in ? File /usr/lib/zope/lib/python/Products/SPIntranet/SPIntranetBaseDocument.py, line 129, in ? File /usr/lib/python2.1/locale.py, line 374, in setlocale Error: locale setting not supported Python version: 2.1.2 Any hints greatly appreciated. regards, Igor

2 1

copy & paste 'leakage'
by Martijn Faassen 08 Feb '02

08 Feb '02

Hey, I'm running into a weird problem I'm not sure how to tackle. I've noticed that under some circumstances it takes a long time to copy and paste a ParsedXML object. This seems to happen in a clean Zope, at least in the Zope root, though it doesn't seem to happen in folders. I've also had it happen in Folderish objects in an app, though *sometimes* the problem wouldn't occur. Quite peculiar. I noticed that it wasn't only slow; it was generated huge amounts of useless volume for the ZODB as seen in the database management screen; objects a couple of K big generally cause a meg or two of leak when the copy process is 'slow'. I concluded the copy process is this slow because Zope is somehow copying far more data than intended. But I don't know what; I need to get a clue in order to tackle this problem, and this is as far as I've gotten. I've speculated somekind of weird acquisition wrapper issues may be involved (certainly possible with ParsedXML), which cause other objects to be copied, or possibly the same XML nodes to be copied, multiple times, even though I can't find them. But perhaps someone else has run into this problem before and can give me some idea on where to start looking. Regards, Martijn

3 3

Possible PUT_factory enhancement
by Chris Withers 08 Feb '02

08 Feb '02

Hi, PUT_factory's are cool, but you always have to write them as external methods, which sucks. What would people feel if I made an enhancement to Hookable_PUT.py that let you return either an object _or_ a metatype? cheers, Chris

1 0

Using psycopg cursor in a product
by de ZORZI Frederic 08 Feb '02

08 Feb '02

Hi all, Is it possible to use cursors and their functions (dictfetchall, fetchone...) with zpsycopg connection ? Thanks, Fred. -- Frederic de ZORZI - PimenTech http://www.pimentech.net

2 2

freezing your Zope for fun and profit thru the monitor port
by Leonardo Rochael Almeida 08 Feb '02

08 Feb '02

Hi, Well, using the monitor port to do nasty things to Zope isn't really rocket science, but here is an unexpected result: rockman:/opt/zope/243-xuf# python2.1 ZServer/medusa/monitor_client.py localhost 8099 [... some messages and copyright notices later ...] Welcome to <secure_monitor_channel connected 127.0.0.1:49470 at 80c0fe4> >>> import Zope, ZPublisher, pdb >>> pdb.run("ZPublisher.Zope('')") rockman:/opt/zope/243-xuf# When you try to do anything under pdb over the monitor port and it will result in the same situation: Zope CPU use goes thru the roof and it freezes. It accepts connections thru whatever network ports are open but never aswer any of them. This happens with versions 2.4.3 and 2.5.0, that I've tested. Probably in all the others too. What is going on and why can't we run pdb thru the monitor port? I ask this because I'm seeing a similar behaviour hapenning randomly but occasionally (every couple of weeks, actualy) to another Zope. It freezes, accepting connections but never answering any of them. Actually, this case is a little bit different, in which a non-HTTP request to port 8080 returns an error imediatelly from medusa, but anything that requires calling into zope just hangs there, waiting for an answer. Having pdb working thru the monitor port would be great, in order to discover where Zope requests are hanging, however just having a python traceback of what all the threads are doing would be very nice already. Cheers, Leo

1 0

Dynpersist.so and makefile.pre.in
by Ed Colmar 07 Feb '02

07 Feb '02

Hey! I know I've done this before, but for some reason it's eluding me. I'm on a brand new box with a fresh 2.4.3 zope. I am trying to get sql authentication working with loginmanager/Zpatterns I can't seem to find a "makefile.pre.in" on my system. I have python and python-devel both from RPM, and a regular install of zope. I tried using a makfile.pre.in from some other package (found on the web) but got tons of errors. Where would I find a copy of this file for my platform? Which incedentally is Mandrake 8.1. Anyone have one that might work. Do I need to build python from the source? Thanks! -ed-

8 13

Adding gzip compression to HTTPResponse.py
by Brad Clements 07 Feb '02

07 Feb '02

I'm looking for architectural suggestions for adding gzip compression to HTTPResponse for text types. First, I just wanted to compress xml-rpc output, since I'm returing lots of table data as XML text (not objects), then loading that text/xml into a DOM for XSLT processing. I hacked the attached code into HTTPResponse, at the end of setBody. It works for xml-rpc responses and I suppose any text output, so long as the response object has a header named "dogzip" set. I know "dogzip" is a stupid name, but this is just a testing thing. Representative compressions: compress oldlen 150366 new len 11926 compress oldlen 204382 new len 14170 compress oldlen 12746 new len 1364 As you can see, very useful compressions for xml-rpc output. But for HTML output, what's really needed is I think a special kind of Cache Object. One that combines HTTP Caching with Ram caching to keep gzip compressed objects "in memory". Some HTML pages are really quite large, and gzip compression can make a noticable difference. Just the javascript code sizes themselves are .. really big. For xml-rpc, obviously every response must be compressed if it's "worth it", and I can see that having to set a response property on a per request basis is appropriate for xml-rpc. But for text file objects, Page Templates and stuff.. How does setBody work with Ram Cache objects? I have some ideas... Anyone think this is worthwhile? Also, RESPONSE.setBody really should have access to REQUEST.headers. What's the clean way to do that? Just pass the request object to response object's init method? Here's quick gzip compression hack-in, based on code posted by Neil Schemenauer Thanks Neil. Added about line 265 in HTTPResponse.py in Zope 2.5 B3 try: dogzip = self.headers['dogzip'] del self.headers['dogzip'] if dogzip and split(content_type,'/')[0] == 'text': body = self.body startlen = len(body) import zlib, struct _gzip_header = ("\037\213" # magic "\010" # compression method "\000" # flags "\000\000\000\000" # time "\002" "\377") co = zlib.compressobj(6,zlib.DEFLATED,-zlib.MAX_WBITS, zlib.DEF_MEM_LEVEL,0) chunks = [_gzip_header, co.compress(body), co.flush(),struct.pack("<ll",zlib.crc32(body),startlen)] z = join(chunks,"") newlen = len(z) print "compress oldlen ",startlen,"new len",newlen if newlen < startlen: self.body = z self.setHeader('content-length', newlen) self.setHeader('content-encoding','gzip') except: pass Brad Clements, bkc(a)murkworks.com (315)268-1000 http://www.murkworks.com (315)268-9812 Fax netmeeting: ils://ils.murkworks.com AOL-IM: BKClements

4 6

Dependency problem with SimpleItem
by Romain Slootmaekers 06 Feb '02

06 Feb '02

Yo dudes, I have problems with dependencies on Zope 2.4.3: If I try to import OFS.SimpleItem directly, I get following problem. >>> from OFS import SimpleItem Traceback (most recent call last): File "<stdin>", line 1, in ? File "D:\ZopeDevel\lib\python\OFS\SimpleItem.py", line 95, in ? import re, sys, Globals, App.Management, Acquisition, App.Undo File "D:\ZopeDevel\lib\python\Globals.py", line 90, in ? import Acquisition, ComputedAttribute, App.PersistentExtra, os File "D:\ZopeDevel\lib\python\App\PersistentExtra.py", line 87, in ? from Persistence import Persistent ImportError: cannot import name Persistent >>> If you do 'import Zope' first, you don't have this problem. But I can't do that because I use my SimpleItem in a process other than the zope server. and then I get problems with the lock on the Zope database. I just want to construct a SimpleItem, and store it somewhere else than the database that the zope server uses.... Anyone any ideas on this? TIA, Sloot.

2 1