November 2004 - Zope-Dev

Zope2 OFS/CopySupport's _get_id()
by Alexandre Boeglin 22 Nov '04

22 Nov '04

Hello, While I was reading the _get_id function, I felt it was really strange : #### def _get_id(self, id): # Allow containers to override the generation of # object copy id by attempting to call its _get_id # method, if it exists. n=0 if (len(id) > 8) and (id[8:]=='copy_of_'): n=1 orig_id=id while 1: if self._getOb(id, None) is None: return id id='copy%s_of_%s' % (n and n+1 or '', orig_id) n=n+1 #### currently, when copying and pasting an object, 'copy[0-9]*_of_' will be prepended to the id (if the id is already in use in the current folder). Thus, copying 'x' will create 'copy_of_x', 'copy2_of_x', etc. and copying 'copy_of_x' will create 'copy_of_copy_of_x', 'copy2_of_copy_of_x', etc. What I don't get, is what the two lines between 'n=0' and 'orig_id=id' are supposed to do. What they do is this : if an object id is 16 chars long, and it ends with 'copy_of_' (like 'XXXXXXXXcopy_of_'), its first copy will be called 'copy2_of_XXXXXXXXcopy_of_' instead of 'copy_of_XXXXXXXXcopy_of_'... What I think the author intended to do, is that, when you copy an object called 'copy_of_x', the copy will be named 'copy2_of_x' instead of 'copy_of_copy_of_x'. Thus, here's a function that does the job : #### import re copy_re=re.compile('^copy[0-9]*_of_') def _get_id(self, id): # Allow containers to override the generation of # object copy id by attempting to call its _get_id # method, if it exists. copy_match=self.copy_re.match(id) if (copy_match) and (copy_match.end() < len(id)): n=1 orig_id=self.copy_re.sub('', id) else: n=0 orig_id=id while 1: if self._getOb(id, None) is None: return id id='copy%s_of_%s' % (n and n+1 or '', orig_id) n=n+1 #### Then, I don't know what is the preferred naming for new objects, but I fear that 'copy_of_copy_of_copy_of_copy_of_copy_of_copy_of_object' will quickly be too long, if objects are copied by an automated process that doesn't show the Ids to the user or don't allow their modification. What are your feelings about this ? Regards, Alexandre Boeglin

2 1

re: [Zope-dev] Zope on 64-bit Linux
by John Snowdon 22 Nov '04

22 Nov '04

Hi Larry, We are using Zope/ZEO 2.7.x on a small cluster of AMD Opteron machines to host an online learning environment for our medical students (around 1100 in all), providing on-the-fly timetables, study and lecture notes, module booking, downloadable resources, discussion forums, etc.. Machines are Sun V20z dual 248 Opterons, each with 4Gb of RAM, dual gigabit ethernet and 10krpm scsi disks. This is all hosted on a private gigabit network, with a local LDAP authentication server. Access to the sites is via a load-balancing gateway running 'Pound'. The Opteron nodes (3 of the above spec, at the moment) are running SuSE 9.1/Pro/X86_64, with the SuSE provided python64 binaries and libs. All the extensions and py modules we use are compiled against /lib64. The Opteron nodes host the sites, using Zope 2.7.2, connecting to a bigger, but slower Sun fileserver, which serves the data fs via ZEO. Performance is blistering; but we could easily improve it with squid. We've benchmarked the Opterons against dual Xeon systems (2.8, 3.0) and they are *way* faster. If you want any more details, just let me know... >Anyone out there successfully deploying and running Zope/CMF on 64-bit >Linux? I'm looking at deploying AMD Opteron server for hosting large >Zope site and wanted to take advantage of the speed and addressing >capabilities if I could. Specifically I'd like to use RedHat Fedora >Core 3 to run ZODB server and ZEO Clients. Any information would be >greatly appreciated. > >Thanks in advance, >Larry Bates John Snowdon - IT Support Specialist -==========================================- School of Medical Education Development Faculty of Medical Sciences Computing University of Newcastle Phone : 0191 246 4549 Email : j.p.snowdon(a)ncl.ac.uk

1 0

Zope on 64-bit Linux
by Larry Bates 19 Nov '04

19 Nov '04

Anyone out there successfully deploying and running Zope/CMF on 64-bit Linux? I'm looking at deploying AMD Opteron server for hosting large Zope site and wanted to take advantage of the speed and addressing capabilities if I could. Specifically I'd like to use RedHat Fedora Core 3 to run ZODB server and ZEO Clients. Any information would be greatly appreciated. Thanks in advance, Larry Bates

2 1

exception hiding in _delObject
by Florent Guillaume 19 Nov '04

19 Nov '04

In _delObject and manage_beforeDelete there's a try/except that catches nearly everything (except BeforeDeleteException and the infamous ConflictError). It then proceeds to log a message, but continues: try: object.manage_beforeDelete(object, self) except BeforeDeleteException, ob: raise except ConflictError: # Added for CPS raise except: LOG('Zope',ERROR,'manage_beforeDelete() threw', error=sys.exc_info()) pass The rationale is, I guess, that when you delete an object you really want it gone. This is IMO very harmful because it hides any bug in the catalog or the indexes (especially during unit tests where LOG is ignored). I've been (again) bitten by it. I'd like to condition the pass to the fact that the current user is Manager. Otherwise I'd like it to fail (and reraise). So a Manager will still be able to delete objects when there's a bug, but not others. Comments ? Florent -- Florent Guillaume, Nuxeo (Paris, France) CTO, Director of R&D +33 1 40 33 71 59 http://nuxeo.com fg(a)nuxeo.com

3 5

Announce: November Zope Bug Day!
by Chris Withers 19 Nov '04

19 Nov '04

Hi All, Well, October came and went with no bug day. Apologies to all :-S However, the November bug day will shortly be upon us! What? Zope Bug Day working from http://collector.zope.org/Zope When? Friday 26th November - from when you wake up until when the day ends! Where? #zope-dev on irc.zope.org Come along and help if you've got a chance! Read this if you want to know how: http://dev.zope.org/CVS/BugDays cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 1

Re: [Zope-Checkins] CVS: Packages/ZPublisher - Converters.py:1.23.2.3 HTTPRequest.py:1.90.2.7 HTTPResponse.py:1.75.2.7
by Chris Withers 19 Nov '04

19 Nov '04

Andreas Jung wrote: > Update of /cvs-repository/Packages/ZPublisher > In directory cvs.zope.org:/tmp/cvs-serv30970/lib/python/ZPublisher > > Modified Files: > Tag: Zope-2_7-branch > Converters.py HTTPRequest.py HTTPResponse.py > Log Message: > 'latin1' -> 'iso-8859-15' > > > === Packages/ZPublisher/Converters.py 1.23.2.2 => 1.23.2.3 === > --- Packages/ZPublisher/Converters.py:1.23.2.2 Mon May 17 13:31:31 2004 > +++ Packages/ZPublisher/Converters.py Mon Nov 8 01:49:18 2004 > @@ -20,7 +20,7 @@ > def field2string(v): > if hasattr(v,'read'): return v.read() > elif isinstance(v,UnicodeType) : > - return v.encode('latin1') > + return v.encode('iso-8859-15') > else: > return str(v) Should this really be hard coded at all? http://collector.zope.org/Zope/1490 Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

1 0

Re: [Zope] Re: Give 'Extensions' a configurable directory in zope.conf
by Florent Guillaume 19 Nov '04

19 Nov '04

> * /lib/python/Products/ExternalMethod/ExternalMethod.py > > - little typos (not related, but since I was there <wink>) It's a good practice to fix typos and such in a separate patch/checkin, so that those reading the diffs or patches can concentrate on what's really done. > * /lib/python/App/Extensions.py > > - in getPath() check if directive 'extensions' is overriden in zope.conf, > and use it instead. > > The relevant code added to getPath() is depicted below. > > <code> > if (prefix=="Extensions") and (cfg.extensions is not None): > r=_getPath(cfg.extensions, '', name, suffixes) > if r is not None: return r > </code> It's also nice to use modern python coding style (even when copy/pasting code): if prefix == "Extensions" and cfg.extensions is not None: r = _getPath(cfg.extensions, '', name, suffixes) if r is not None: return r > However, I did not understood the purpose of the construction > "if r is not None: return r". > > That was the last statement in getPath(). If r==None then getPath() > wouldn't return None all the same ? It's in a loop. The first working path is returned. > I believe this is the last bit of doubt before submitting the patch. > > BTW, maybe I should have posted this to Zope-Dev instead ? Yep :) I Cc zope-dev, and followup there. But now that you put it in the collector it's ok. Thanks for the patch. Florent -- Florent Guillaume, Nuxeo (Paris, France) CTO, Director of R&D +33 1 40 33 71 59 http://nuxeo.com fg(a)nuxeo.com

2 2

zope.org SVN Sandbox area created for contributors
by Gary Poster 18 Nov '04

18 Nov '04

SUMMARY: The Zope.org Subversion repository now has a sandbox area for collaboration by contributors. This area has no constraints for checkins except those listed in the contributors agreement, and is intended to promote experimentation and easy, quick sharing. Details and how-to are below. DETAILS: After the discussion of demo packages (http://mail.zope.org/pipermail/zope3-dev/2004-November/012739.html) and the constraints Jim mentioned for full-fledged inclusion in the Zope 3 repository (http://mail.zope.org/pipermail/zope3-dev/2004-November/012740.html) we have set up a SVN sandbox for easy collaboration on prototypes and other experimentation by Zope contributors: /repos/main/Sandbox. This lowers the bar for sharing significantly. The demos discussed in the thread above could be checked in without further modification, for instance. If they are modified to meet the standards for inclusion in the Zope 3 repository, development should move to the Zope 3 repository, or, for large or stand-alone efforts, to their own top-level project. The genesis of the sandbox came from Zope 3; however, developers using Zope 2 should not feel left out. Zope 2 development is also welcome to use the Sandbox area. Please see Jim's README in the top of the sandbox for his guidelines on use of the area: http://svn.zope.org/Sandbox/README.txt?rev=28473&view=auto HOW TO: If you are a contributor who wants to set up your corner of the sandbox, you'll want to make a directory there: svn mkdir -m "<checkin message>" svn+ssh://<zope.org user name>@svn.zope.org/repos/main/Sandbox/<your new sandbox name> Replace the <checkin message>, <zope.org user name>, and <your new sandbox name>. The sandbox name should have your name in it, the name of your project in it, or both. For instance, my command was svn mkdir -m "Making my corner of the sandbox" svn+ssh://poster@svn.zope.org/repos/main/Sandbox/poster Subversion should reply with "Committed revision <number>." Then check out your new sandbox: svn co svn+ssh://<your user name>@svn.zope.org/repos/main/Sandbox/<your new sandbox name> <local name on your machine for the checkout> For instance, my command was svn co svn+ssh://poster@svn.zope.org/repos/main/Sandbox/poster sandbox Further Subversion information is available in the zope.org Subversion wiki: http://dev.zope.org/Subversion/ Please use and enjoy! Gary

1 0

RE: [Zope-dev] Zope-2.7.3, Ape-1.0+ (from cvs) and mysql 4.0.20 raises UnpicklingError
by jcc＠umd.es 18 Nov '04

18 Nov '04

I think this is not hte problem since Ape creates the database tables and its columns from scratch. You only must create the database. Anyway, after inspecting the tables I show a lot of blob columns. -----Mensaje original----- De: Andy Dustman [mailto:farcepest@gmail.com] Enviado el: jueves, 18 de noviembre de 2004 18:33 Para: jcc(a)umd.es Asunto: Re: [Zope-dev] Zope-2.7.3, Ape-1.0+ (from cvs) and mysql 4.0.20 raises UnpicklingError What column type are you using in MySQL? I would expect that you need BLOB, but I have no experience with APE. On Thu, 18 Nov 2004 18:23:27 +0100, jcc(a)umd.es <jcc(a)umd.es> wrote: > Hi all, > > I have spent over two days testing the Ape product, and all the time I > become the error UnpicklingError, unpickling stack underflow . > > Here are my results: > > - Using a filesystem database works fine. > - Since mysql creates the tables as myisam (non-transactional) per > default after some failed tests I tweaked the code, so that the tables > are created as InnoDB. > - I have tried a fresh installed zope. > - I have put some LOG statements into the code and here is the log: > > ------> > 2004-11-18T18:00:58 INFO(0) ZODB conflict error at > /sql/manage_addProduct/OFSP/addDTMLMethod (1 conflicts since startup > at > 2004-11-18T17:59:31) > ------ > 2004-11-18T18:00:59 INFO(0) apelib.zodb3.connection.setstate p = (dp1 > S'class_name' p2 S'OFS.Folder.Folder' p3 sS'mapper_name' p4 S'folder' p5 > s.(dp6 S'modtime' p7 L1100797193L sS'items' p8 (lp9 sS'id' p10 S'sql' > p11 sS'security' p12 (lp13 (S'executable-owner' S'' S'' > S'acl_users/jcoruna' tp14 a(S'local-role' S'Owner' S'' S'jcoruna' tp15 > asS'remainder' p16 S"array('c')" p17 sS'properties' p18 (lp19 (S'title' > p20 S'string' p21 S'' tp22 as. > ------ > 2004-11-18T18:00:59 INFO(0) zodb3.serializers.RemainingState.deserialize > state = array('c') > ------ > 2004-11-18T18:00:59 ERROR(200) ZODB Couldn't load state for '5' > Traceback (most recent call last): > File > "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/zodb3/connection.py", > line 360, in setstate > event = osio.deserialize(oid, obj, classification, state) > File "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/core/io.py", > line 160, in deserialize > mapper.serializer.deserialize(event, state) > File > "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/core/serializers.py", > line 121, in deserialize > s.deserialize(event, state) > File > "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/zodb3/serializers.py", > line 293, in deserialize > s = u.load() > UnpicklingError: unpickling stack underflow > <------------ > > I think that the problem is that ape tries to unpickle the string > "array('c')" and fails. > > Any clues? > > Sorry for the long post, but I think it's worth the length. > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope ) > -- Computer interfaces should never be made of meat. Using GMail? Setting Reply-to address to <> disables this annoying feature.

1 0

Zope-2.7.3, Ape-1.0+ (from cvs) and mysql 4.0.20 raises UnpicklingError
by jcc＠umd.es 18 Nov '04

18 Nov '04

Hi all, I have spent over two days testing the Ape product, and all the time I become the error UnpicklingError, unpickling stack underflow . Here are my results: - Using a filesystem database works fine. - Since mysql creates the tables as myisam (non-transactional) per default after some failed tests I tweaked the code, so that the tables are created as InnoDB. - I have tried a fresh installed zope. - I have put some LOG statements into the code and here is the log: ------> 2004-11-18T18:00:58 INFO(0) ZODB conflict error at /sql/manage_addProduct/OFSP/addDTMLMethod (1 conflicts since startup at 2004-11-18T17:59:31) ------ 2004-11-18T18:00:59 INFO(0) apelib.zodb3.connection.setstate p = (dp1 S'class_name' p2 S'OFS.Folder.Folder' p3 sS'mapper_name' p4 S'folder' p5 s.(dp6 S'modtime' p7 L1100797193L sS'items' p8 (lp9 sS'id' p10 S'sql' p11 sS'security' p12 (lp13 (S'executable-owner' S'' S'' S'acl_users/jcoruna' tp14 a(S'local-role' S'Owner' S'' S'jcoruna' tp15 asS'remainder' p16 S"array('c')" p17 sS'properties' p18 (lp19 (S'title' p20 S'string' p21 S'' tp22 as. ------ 2004-11-18T18:00:59 INFO(0) zodb3.serializers.RemainingState.deserialize state = array('c') ------ 2004-11-18T18:00:59 ERROR(200) ZODB Couldn't load state for '5' Traceback (most recent call last): File "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/zodb3/connection.py", line 360, in setstate event = osio.deserialize(oid, obj, classification, state) File "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/core/io.py", line 160, in deserialize mapper.serializer.deserialize(event, state) File "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/core/serializers.py", line 121, in deserialize s.deserialize(event, state) File "/usr/lib/zope/lib/python/Products/Ape/lib/apelib/zodb3/serializers.py", line 293, in deserialize s = u.load() UnpicklingError: unpickling stack underflow <------------ I think that the problem is that ape tries to unpickle the string "array('c')" and fails. Any clues? Sorry for the long post, but I think it's worth the length.

1 0