February 2005 - Zope-Dev

Event & Timer Service for Zope 2.8
by Andrew Veitch 26 Jul '05

26 Jul '05

I noticed there was a thread last month on an event service for Zope. Did that reach any conclusion? From what I can see the present products are: - http://www.zope.org/Members/lstaffor/Xron - Zope 2.6 only, not being developed - http://zope.org/Members/naumen/NauScheduler - shipped with one of the Zope CMS's works fine with 2.7 - http://dev.legco.biz/products/ZopeScheduler and http://dev.legco.biz/products/timerservice - works fine with 2.7 too - http://cvs.zope.org/Products/Event/ - event service without a time service, not sure of development status - http://mail.zope.org/pipermail/zope-cmf/2005-January/021747.html - Dieter's project to be based on Python's sched module - http://api.nuxeo.org/CPS3/public/ CPSCore.EventServiceTool.EventServiceTool-class.html - CPS's event service - http://cvs.sourceforge.net/viewcvs.py/*checkout*/mailmanager/ mailmanager/MailCheckThread.py?rev=1.15 - our custom scheduler for MailManager - Zope X3's event service It would be great to some consolidation of all of this into the core. I would also strongly favour a timer service along with the event service. I know that the argument has always been that operating systems provide time services but this is not very convenient for cross platform development and on some Windows platforms it's difficult. A -- Logical Progression Ltd, 20 Forth Street, Edinburgh EH1 3LH, UK Tel: +44 (0)131 550 3733 Web: http://www.logicalprogression.net/

5 14

ZCatalog getObject broken
by Roché Compaan 21 Mar '05

21 Mar '05

Last year in March the following checkin was made that changed ZCatalog's getObject to use restrictedTraverse instead of unrestrictedTraverse. See: http://mail.zope.org/pipermail/zope-checkins/2004-March/026846.html In my opininion this is wrong, and just cost me a good three hours to figure out why big parts of one of our apps broke after an upgrade to Zope 2.7.3. What's worse is that there is nowhere a trace of this change in HISTORY.txt or CHANGES.txt. Anybody with a site structure that has less restrictive access deeper into the site would agree that getObject should do an unrestrictedTraverse. restrictedTraverse returns None as soon as it traverses an object a user does not have access to, regardless if the user has access to the object referred to by the full path. To illustrate imagine the following: You have a site with a folder containg documents at '/documents'. Inside that folder you have a whole bunch of documents where users have a local role of owner to give them permission to access only their own documents. You use a Catalog query to get the list of documents belonging to a particular user and want to use getObject to retrieve the objects found. But, it won't work because restrictedTraverse already fails when traversing the 'documents' folder. I would propose that getObject does an unrestrictedTraverse of the path and then checks if the user has permission to access that the object. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za

8 31

Conflict errors on startup, revisited
by Paul Winkler 25 Feb '05

25 Feb '05

This is a topic that comes up occasionally, but since the symptom seems to be rare and hard to provoke, it never gets resolved. Well it's biting me again and I'm determined to fix it, but would like some input from the list. Related collector issues: http://www.zope.org/Collectors/Zope/300 http://www.zope.org/Collectors/Zope/1201 The issue: On rare occasions I have seen ConflictErrors raised during product installation. Today, I can finally provoke them at will with a pretty minimal setup. The setup: Zope 2.7.3, using ZEO, with DirectoryStorage on the ZEO server. Hardware: dual-processor PIII 800, some kinda scsi disk, ext3, some old redhat flavor of linux. To provoke it I need merely do ./bin/zopectl run foo.py ... where foo.py is empty. Products/ now contains only one dummy product, which I've named Conflictor, which contains only an empty __init__.py. I get a ConflictError during registration of Conflictor. Interestingly I can only provoke this ConflictError in this particular INSTANCE_HOME. I have several other instances and am not seeing the symptom there. I started trivially hacking OFS/Application.py to add some debugging output (a diff against 2.7.3 is attached), and here's what I get: [pwinkler@dev-zope-knox01 PaulMiniInstanceHome]$ ls Products/ [pwinkler@dev-zope-knox01 PaulMiniInstanceHome]$ mkdir Products/Conflicter [pwinkler@dev-zope-knox01 PaulMiniInstanceHome]$ touch Products/Conflicter/__in it__.py [pwinkler@dev-zope-knox01 PaulMiniInstanceHome]$ touch foo.py [pwinkler@dev-zope-knox01 PaulMiniInstanceHome]$ ./bin/zopectl run foo.py installing product PluginIndexes...OK! installing product Conflicter... BZZT Traceback (most recent call last): File "<string>", line 1, in ? File "/usr/local/lib/python2.3/site-packages/PIL/__init__.py", line 51, in app File "/usr/local/lib/python2.3/site-packages/PIL/__init__.py", line 47, in startup File "/zope/Zope-2.7.3-SoftwareHome/lib/python/Zope/App/startup.py", line 96, in startup File "/zope/ZopeSoftwareHome/lib/python/OFS/Application.py", line 279, in init ialize initializer.initialize() File "/zope/ZopeSoftwareHome/lib/python/OFS/Application.py", line 306, in init ialize self.install_products() File "/zope/ZopeSoftwareHome/lib/python/OFS/Application.py", line 561, in inst all_products return install_products(app) File "/zope/ZopeSoftwareHome/lib/python/OFS/Application.py", line 597, in inst all_products folder_permissions, raise_exc=debug_mode) File "/zope/ZopeSoftwareHome/lib/python/OFS/Application.py", line 803, in inst all_product get_transaction().commit() File "/zope/Zope-2.7.3-SoftwareHome/lib/python/ZODB/Transaction.py", line 252, in commit File "/zope/Zope-2.7.3-SoftwareHome/lib/python/ZODB/Connection.py", line 738, in tpc_vote File "/zope/Zope-2.7.3-SoftwareHome/lib/python/ZEO/ClientStorage.py", line 841 , in tpc_vote File "/zope/Zope-2.7.3-SoftwareHome/lib/python/ZEO/ClientStorage.py", line 825 , in _check_serials ZODB.POSException.ConflictError: database conflict error (serial this txn starte d with 0x035b25f36751f988 2005-02-10 18:59:24.215675, serial currently committed 0x035b743c6d186822 2005-02-24 17:00:25.569220) I guess what I'm asking, before I hack more on OFS/Application.py, is this: * any ideas re. what on earth could be causing this ConflictError? the product doesn't DO anything fer chrissakes. (Maybe registration is finishing too fast??) * Is the PIL stuff in the traceback a red herring or what? -- Paul Winkler http://www.slinkp.com

5 16

Re: [Zope-dev] zope and python2.3.5
by Radosław Stachowiak 24 Feb '05

24 Feb '05

On Mon, 21 Feb 2005 21:08:01 +0100, Andreas Jung <lists(a)andreas-jung.com> wrote: > > zope-2.7.4 and zopex3-3.0.0 stops 'configure' with error on python 2.3.5. > > is it safe to force zope to use python 2.3.5 instead of 2.3.4 ? > > It does *not* force you to use 2.3.4. There is a --with-python option if > you look carefully at the configure options. At the time of Zope 2.7.4 release there > was no Python 2.3.4. That's why you can't expect support for Python 2.3.5. I wrote about forcing zope, not forcing me :) as for the option, as i wrote before we will use this approach. Maybe zope configure shouldnt stop on newer, but from the same branch, version of python? -- radoslaw.

3 2

Announce: February Zope Bug Day!
by Chris Withers 22 Feb '05

22 Feb '05

Hi All, My my how time flies ;-) It's the end of February and that means another bug day. I'll probably be a little busy, but I'll be trying to squash at least a few bugs... What? Zope Bug Day working from http://www.zope.org/Collectors/Zope When? Friday 26th February - from when you wake up until when the day ends! Where? #zope-dev on irc.zope.org Come along and help if you've got a chance! Read this if you want to know how: http://www.zope.org/DevHome/CVS/BugDays cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

1 1

zope and python2.3.5
by Radosław Stachowiak 21 Feb '05

21 Feb '05

Hello zope-2.7.4 and zopex3-3.0.0 stops 'configure' with error on python 2.3.5. is it safe to force zope to use python 2.3.5 instead of 2.3.4 ? i ask, because, on possitive answer, we (Gentoo Linux) change default zope installation to use python2.3.5 At present default python on Gentii from 2.3 branch is 2.3.4 but it will be replaced by 2.3.5 in some time, leading to broken zope installs on gentoo. looking forward your opinions. -- radek(a)gentoo.org.

3 3

QueueCatalog Tool Inadvertantly Triggers Indexing
by Ken Wasetis 21 Feb '05

21 Feb '05

I've recently installed QueueCalalog (with PloneQueueCatalog) and either I don't understand how it is intended to work (lacks documentation), or it isn't working the way it's intended to. My objects, which are similar to the ATFile content type of Archetypes, have PDF or MS Word files attached and bog down Zope if indexing is done on the SearchableText index for these immediately, while users are logged in and doing work during the day. When I configure QueueCatalog to select all of my indexes except SearchableText as ones that should update immediately, it seems to successfully queue a new first object I've created in Plone (and not convert and index the object by doing a portal_transform on its 'file' attachment attribute. This is fine for the first object, but as soon as I attempt to create a second such object, the queue gets processed. The way I understand queue processing is, there are two things that would trigger the processing of the queue: 1) A site manager logs into the ZMI, goes to the portal_catalog's Queue tab and clicks the 'Process' button. 2) The Process class of the QueueCatalog product is a thread and (by default) is hardcoded to sleep for 60 seconds at a time. When it wakes up, it will process the queue. With that in mind, I modified the Process.py to increase the interval fro 60 to 6000 seconds, but my queue still gets immediately processed upon the creation of a second object. Is this a bug, or am I misusing or misunderstanding the tool's design? Thanks in advance for any help - I couldn't find any good pointers on how to use the product. Ken Wasetis SPR Inc. kwasetis(a)sprinc.com

3 4

method attribute __roles__ in Zope 2.8
by Andreas Jung 21 Feb '05

21 Feb '05

I can across the following problem while trying to fix the broken FTP service for Zope 2.8: ObjectManager.manage_FTPstat() tries to access self.manage_FTPlist.__roles__ whose value is ('Manager',') in Zope 2.7. In 2.8 this attribute is not available. Can someone explain how and where is attribute in set Zope 2.7 and why it is no longer available in Zope 2.8 (has it anything to do with new-style classes in 2.8). Being-completely-clueless, Andreas

3 7

Patch for attribute permisions problems in Zope 2.7.3
by Santi Camps 21 Feb '05

21 Feb '05

Hi all again, We have been written last week about some attribute permission problems with Zope 2.7.3 beta due to a patch applied by Tres. First of all, Tres, apologies for my too fast written test case and my too late test of Zope 2.7.3. Now, with some more time, I've tested and debugged on Zope 2.7.3 and found exactly what's happen. Supose we have a structure of objects like this: A.__of__(B) "A" inherits from Acquisition.Implicit, has security assertions, but has not __allow_access_to_unprotected_subojects__ We want to access, from a Zope Page Template, an attribute of "B" that is not present in "A" Accessing B.our_attribute attribute works fine. But accessing A.__of__(B).our_attribute fails, and should work. The problem is the call to "validate" done in "guarded_getattr" method of ImplPython.py. The actual call is "if validate(inst, inst, name, v)", but the validate function says: Arguments: accessed -- the object that was being accessed container -- the object the value was found in name -- The name used to access the value value -- The value retrieved though the access. roles -- The roles of the object if already known. Now, "accessed" and "container" are always the same, and in some cases should be different. I attach a patch to solve this case that works for me. I'm not sure if my code is the best way to solve the problem but, as I said, it seems to work fine. Of course, If the patch is accepted, the same change should be done in the C version. Thanks Santi Camps http://www.earcon.com --- ImplPython.py 2004-08-07 19:15:48.000000000 +0200 +++ /usr/local/zope273/lib/python/AccessControl/ImplPython.py 2004-10-29 10:56:11.000000000 +0200 @@ -534,6 +534,12 @@ # exceptions are caught early. try: v = getattr(inst, name) + container = inst + while hasattr(container,'aq_explicit') and \ + not(hasattr(container.aq_explicit, name)) and \ + hasattr(container, 'aq_parent'): + # Find real container when attribute is acquired + container = container.aq_parent except AttributeError: if default is not _marker: return default @@ -551,6 +557,6 @@ return v validate = SecurityManagement.getSecurityManager().validate - if validate(inst, inst, name, v): + if validate(inst, container, name, v): return v raise Unauthorized, name

2 2

guarded_getattr
by Stefan H. Holek 17 Feb '05

17 Feb '05

Tres, I'd very much appreciate your opinion on http://mail.zope.org/pipermail/zope-dev/2005-January/024237.html http://mail.zope.org/pipermail/zope-dev/2005-January/024242.html Plone is breaking left and right and I gotta do something about it... Thanks, Stefan -- The time has come to start talking about whether the emperor is as well dressed as we are supposed to think he is. /Pete McBreen/

3 9