September 2003 - Zope-Dev

Catalog performance
by zhimin＠iss.nus.edu.sg 30 Oct '03

30 Oct '03

John Barratt wrote: > If you can't use catalog metadata as Seb suggests (eg. you are actually > accessing many attributes, large values, etc.) and if indeeed memory is > the problem (which seems likely) then you can ghostify the objects that > were ghosts to begin with, and it will save memory (unless all those > objects are already in cache). > > The problem with this strategy though is that doc.getObject() method > used in your code activates the object and hence you won't know if it > was a ghost already or not. To get around this you can shortcut this > method and do something like : > > docs = container.portal_catalog(meta_type='Document', ...) > for doc in docs: > obj = doc.aq_parent.unrestrictedTraverse(doc.getPath()) > was_ghost = obj._p_changed is None > value = obj.attr > if was_ghost:obj._p_deactivate() Just my 2 cents observation... I ran this code and monitored the page "Cache extreme detail" in ZMI > ControlPanel > DebugInfo. With this method, the object was not loaded. However the intermediate objects that the unrestrictedTraverse() passed by were loaded into memory. e.g. If doc.getPath() is '/x/y/z/myobject', myobject was not loaded but x, y, and z were loaded into memory. I also tried the method suggested by Seb. This did not load myobject as well as x, y, and z into memory: http://mail.zope.org/pipermail/zope-dev/2003-September/020450.html The information on deactivating object into ghost state is very helpful. Thanks! cheers, zhi min

10 37

Re: CVS: Zope/doc/PLATFORMS - BSD.txt:1.1.2.1
by Jochen Knuth 08 Oct '03

08 Oct '03

Hi, Chris McDonough schrieb: > Update of /cvs-repository/Zope/doc/PLATFORMS > In directory cvs.zope.org:/tmp/cvs-serv28347 > > Added Files: > Tag: Zope-2_7-branch > BSD.txt > Log Message: > Add thread stack size fix docs by Andrew Sawyers. > > > === Added File Zope/doc/PLATFORMS/BSD.txt === > Steps to building python for use with Zope on FreeBSD to avoid > segmentation faults (by Andrew Sawyers for Pythons up to 2.3). > > The default thread stack size for FreeBSD is too small; when building > Python for use with Zope it is often necessary to increase the thread > stack size to avoid segmentation faults. There are two ways which you > can increase the default python thread stack size. > > Way #1: In your Python source directory: > > Way #2: In your Python source directory: Way #3: Use Python from the ports system (the fixes are there since 06 Feb 2003 ) Ciao, Jochen -- -------------------------------------------------- Jochen Knuth WebMaster http://www.ipro.de IPRO GmbH Phone ++49-7152-93330 Steinbeisstr. 6 Fax ++49-7152-933340 71229 Leonberg EMail: J.Knuth(a)ipro.de

2 1

ZODB 3.2 feedback
by Jeremy Hylton 30 Sep '03

30 Sep '03

Has anyone had a chance to test ZODB 3.2b3? We're hoping to do a release candidate tomorrow, and it would be good to know if anyone has tried to the beta release. If you've got a current CVS checkout of Zope 2.7, that's got the same code. Jeremy

4 3

Zope 2.7b2 INSTANCE_HOME
by Ng Pheng Siong 28 Sep '03

28 Sep '03

Hi, I'm updating ZServerSSL to work with Zope 2.7.0b2. I did the following to install Zope: $ configure --prefix=~/pkg/zope270b2 $ make; make install $ ~/pkg/zope270b2/bin/mkzopeinstance.py The instance is in ~/pkg/inst_zope/. Next, apply ZServerSSL patches, copy stuff over... Then, away we go! $ ~/pkg/inst_zope/bin/runzope But: IOError: [Errno 2] No such file or directory: '/usr/local/home/ngps/pkg/zope270b2/ssl/dh1024.pem' The offending code is this: ssl_ctx.set_tmp_dh('%s/ssl/dh1024.pem' % INSTANCE_HOME) So INSTANCE_HOME is pointing to ~/pkg/zope270b2. Shouldn't it be pointing to ~/pkg/inst_zope? BTW, $ (cd ~/pkg/zope270b2; ln -s ../inst_zope/ssl; ../inst_zope/bin/runzope) 2003-09-28T00:45:15 INFO(0) ZServer (ZServerSSL/0.12) HTTPS server started at Sun Sep 28 00:45:15 2003 Hostname: vista.netmemetic.com Port: 8443 Woo-hoo! -- Ng Pheng Siong <ngps(a)netmemetic.com>

3 4

How to get object count in a folder?
by Choo Zhi Min 27 Sep '03

27 Sep '03

Hi, I want to get the object count in a folder (Zope/Plone folder). Doing len(myfolder.objectValues()) will load every object in that folder into memory while all I need is just a count of them. Any better way to do this to avoid unnecessary memory usage? Thanks! Zhi Min

2 1

VOcabulary stop words
by Paulo Lobo 26 Sep '03

26 Sep '03

I need to changer my stop words in my vocabulary!! I've tryed to change that file, Lexicon.py, where the stop words are stores, but it doesnt works!!!! When i re-index all the data my customized stop words are indexed too!

2 2

AW: [Summary] Caching prob with AHCM and headers
by Germer, Carsten 26 Sep '03

26 Sep '03

Thanks Bjorn, now I remember the last-modified issue. As I remember it, someone said that the line is commented out for a reason not known... that's why I didn't change it :) /Carsten > -----Ursprüngliche Nachricht----- > Von: Bjorn Stabell [mailto:bjorn@exoweb.net] > Gesendet: Freitag, 12. September 2003 12:14 > An: zope-dev(a)zope.org > Cc: Janko Hauser; pixel(a)bitmechanic.com; Jens(a)zope.com; > Germer, Carsten > Betreff: [Summary] Caching prob with AHCM and headers > > > Just for the record to help others in the same situation... > > PROBLEM > Apache (1.3.28 and 2.0.47) will not cache content with just an Expires > header, but it will correctly cache content with a > Last-Modified header. > This problem has been reported before in 1999 by James Cooper, but the > bug request seems to have been forgotten/ left behind. > > It makes sense for dynamic content to produce Expires headers, not > Last-Modified headers, so this is a problem. > > Looking at the code for Zope, it seems that the standard HTTP > accelerator product used to produce a Last-Modified header, but no > longer does so, thus making it useless with the current versions of > Apache. > > The problem has been re-reported to the Apache group with patches: > http://nagoya.apache.org/bugzilla/show_bug.cgi?id=23129 (for Apache > 1.3.28) > http://nagoya.apache.org/bugzilla/show_bug.cgi?id=23130 (for Apache > 2.0.47) > > > WORK-AROUNDS > 1) Produce a Last-Modified header yourself by using > 2) Patch Zope's standard HTTP accelerator product so that it > produces a > Last-Modified header (the line is commented out now) > > SOLUTIONS > 3) Patch Apache (see bug report links above for patches) > 4) Wait until the problem is hopefully fixed in Apache > > > Bye, > -- > Bjorn Stabell bjorn(a)exoweb.net > Tel +86 (10) 65918490 >

7 21

error_log missing things?
by Chris Withers 25 Sep '03

25 Sep '03

Hi Shane, I see from the CVS logs that you originated the error_log tool so I thought I'd try you for ideas, and CC zope-dev in case anyone there can help... I've been having some fun'n'games with Oracle: http://mail.zope.org/pipermail/zope-db/2003-September/002149.html The weird thing, that's since occurred to me, is that none of these errors are finding their way into the event log via the error_log object. In fact, they're not showing up in the error_log at all :-S any ideas? Chris

2 2

Can anyone help to work with Xron on Linux?
by I-Ling Lin 25 Sep '03

25 Sep '03

I tried Xron on Windows XP environment, which works perfectly. Then, I have been trying transport my work to Linux environemnt and work with Xron on Linux for a couple of weeks and checked many possible resources, but no luck. The problem is that, I do see Xron DTML Method object in the manage mode and add the object fine. But, I cannot get the scheduled object working regularly. The error message from the log file says something like: ERROR(200) Catalog uncatalogObjet unsucessfully attempted to uncatalog an object with a uid of ... PROBLEM(100) Products.Xron.Loggerr Trigger event: ... Trigger time: ... Failed to trigger event. ... ... --------- PROBLEM(100) Products.Xron.Loggerr Failed to disarm event I really don't know how to continue... Can anyone help me, please, pls.... Lin --------------------------------- Post your free ad now! Yahoo! Canada Personals

2 1

Problems with ZODB and persistence
by Emiliano Marmonti 25 Sep '03

25 Sep '03

Hello all Finally could find where and how to add indexes in the actual way (think so). Now I have another problem that have no idea how to fix it. Could add objects into a ZODB separate database, could add the catalog and the index, but when the database has one element, with every operation (inclusive opening it) this message appears from Zope: 'App.PersistentExtra' module has no attribute 'Autor' >From Python File C:\Archivos de programa\Zope\lib\python\ZODB\Connection.py, line 534, in etstate File C:\Archivos de programa\Zope\lib\python\ZODB\Connection.py, line 178, in_persistent_load (Info: ('\x00\x00\x00\x00\x00\x00\x00\x0e', ('App.PersistentExtra', 'Autor'))) File C:\Archivos de programa\Zope\lib\python\ZODB\Connection.py, line 138, in __getitem__ (Info: ('\x00\x00\x00\x00\x00\x00\x00\x0e', '((U\x13App.PersistentExtraq\x01U\x05Autorq\x02tq\x03Nt.}q\x04(U\x02idq\x05U\x0822596451q\x06U\x04nameq\x07U\x0f Juana Silviaq\x08U\robservacionesq\tU\x0bpruebaq\nu.')) File C:\Archivos de programa\Zope\lib\python\ZODB\DB.py, line 122, in _classFa ctory AttributeError: 'App.PersistentExtra' module has no attribute 'Autor' Simply, I have no idea what is happening, have searched over App.PersistentExtra but...what is???? Somebody knows where could I find an example (that works and is updated) for doing this kind of tasks? My code is: ----------------------------- import sys import ZODB import Persistence from Persistence import Persistent from ZODB.FileStorage import FileStorage from Products.ZCatalog.Catalog import Catalog from Products.PluginIndexes.FieldIndex.FieldIndex import FieldIndex class Autor(Persistent): id='' name='' observaciones='' def __init__(self,id,nombre,comments): self.name = nombre self.id = id self.observaciones = comments def setName(self,nombre): self.name = nombre def setId(self,id): self.id = id def setObs(self,comments): self.observaciones = comments def getName(self): return self.name def getId(self): return self.id class Autores: def __init__( self, file='dcAuthor.fs' ): self.file= file self.db = ZODB.DB( FileStorage( file ) ) self.co = self.db.open() self.root= self.co.root() if self.root.has_key( 'cat' ): self.cat= self.root['cat'] else: self.cat = Catalog() ### This is, how I get it to work self.cat.aq_parent= self.root self.root['cat']= self.cat ### Add indexes to the Catalog-Class ### The names must match the fields of the Person-Class! indice = FieldIndex('id') self.cat.addIndex('id',indice ) otroIndice = FieldIndex('name') self.cat.addIndex('name' ,otroIndice ) ### self.cat.addIndex('observaciones','FieldIndex' ) get_transaction().commit() def setAutor( self, autor ): uid= id( autor ) self.root[uid]= autor print "Guardada como:"+str(uid) ### Let the Catalog know from this object self.cat.catalogObject( autor, uid ) get_transaction().commit() def searchAutor( self, **kw ): r= self.cat.searchResults( kw ) paths= self.cat.paths root = self.root k= [] for i in r: id= i.data_record_id_ k.append( root[paths[id]] ) return k def close ( self ): self.db.close() def AddAutor(nombre,documento,obs): autor = Autor(documento,nombre,obs) autores = Autores() autores.setAutor(autor) autores.close() def GetAutor(expresion): autores = Autores() listaAutores=autores.searchAutor(name=expresion) autores.close() listaretorno=[] for au in listaAutores: listaretorno.append(au.getName()) return listaretorno ---------------------------------------- I've seen that if I no close() the database, only obtain Error 500 from the server. GetAutor and AddAutor are called from DTML. Well, thanks a lot again. Emiliano.

2 1