March 2010 - Zope-Dev

Re: [Zope-dev] Zope3 sessions and database conflicts
by kevin gill 04 Mar '10

04 Mar '10

> Hi, > For quite some time I see messages like this in my z3.log: > > 2010-03-02T16:27:14 WARNING ZopePublication Competing writes/reads > at > /BSPSite/act/++vh++http:zis.act.at:80/bankneu/++/images/sponsor_logo.png: > database conflict error (oid 0x063f, class BTrees.OOBTree.OOBucket, serial > this txn started with 0x038484dc7d5ac044 2010-03-02 14:52:29.379960, > serial > currently committed 0x038484ff3c6b5455 2010-03-02 15:27:14.160763) > > I followed an advice from the zope-dev list and added some debug messages > in > ZODB.Connection.py where the objects are registered for writing. > > The following debug messages (I print the key/values of the object in > question) occur before and after the database conflict error: > > ------------------- > 2010-03-02T16:27:14 DEBUG zbsp keys: > ['6ZZzgjNK0p.bIIlruXb4JkDo-T0J-XipPcVFGtcj0 > LH6dMdI9akYvg', ......... , '7MmOPQOlkAHoa3T > nydH9IIgKBqoVyn3Q.yH6OXJeLj7epObIy3M5Lg'] > ----------- > 2010-03-02T16:27:14 DEBUG zbsp values: [<zope.session.session.SessionData > object at 0x43723bec>, <zope.session.session.SessionData object at > 0x4372356c>, <zope.session.session.SessionData object at 0x437233ec>, > ......... > <zope.session.session.SessionData object at 0x436b586c>, > <zope.session.session.SessionData object at 0x436b532c>, > <zope.session.session.SessionData object at > 0x43640b6c>,<zope.session.session.SessionData object at 0x436b572c>] > ------------------- > > So it seems these are the session data containers. > > I wonder why they are written? Perhaps this happens when somebody else is > logging into the system (so a new session is added) and others are > concurrently reading from the session? However, this would mean that the > session mechanism has a flaw, as this is a standard procedure? > > Any ideas of how to fix this? I had a serious problem with the session machinery. I use a very long timeout on sessions and thus have a large number of sessions saved (up to 30k). The sweep machinery kicks in and sweeps everything. It takes so long that all the threads do the sweep and you get these errors. I customised the sweep for my site as follows: 1. Only sweep at night 2. Sweep a random subset of the data (20 records), but sweep very often 3. Different timeouts for authenticated sessions and anonymous sessions. Regards, Kevin > > Best Regards, > Hermann > > -- > hermann(a)qwer.tk > GPG key ID: 299893C7 (on keyservers) > FP: 0124 2584 8809 EF2A DBF9 4902 64B4 D16B 2998 93C7 > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > https://mail.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > https://mail.zope.org/mailman/listinfo/zope-announce > https://mail.zope.org/mailman/listinfo/zope ) > > >

2 1

Re: [Zope-dev] Zope3 sessions and database conflicts
by kevin gill 04 Mar '10

04 Mar '10

Hi, For quite some time I see messages like this in my z3.log: 2010-03-02T16:27:14 WARNING ZopePublication Competing writes/reads at /BSPSite/act/++vh++http:zis.act.at:80/bankneu/++/images/sponsor_logo.png: database conflict error (oid 0x063f, class BTrees.OOBTree.OOBucket, serial this txn started with 0x038484dc7d5ac044 2010-03-02 14:52:29.379960, serial currently committed 0x038484ff3c6b5455 2010-03-02 15:27:14.160763) I followed an advice from the zope-dev list and added some debug messages in ZODB.Connection.py where the objects are registered for writing. The following debug messages (I print the key/values of the object in question) occur before and after the database conflict error: ------------------- 2010-03-02T16:27:14 DEBUG zbsp keys: ['6ZZzgjNK0p.bIIlruXb4JkDo-T0J-XipPcVFGtcj0 LH6dMdI9akYvg', ......... , '7MmOPQOlkAHoa3T nydH9IIgKBqoVyn3Q.yH6OXJeLj7epObIy3M5Lg'] ----------- 2010-03-02T16:27:14 DEBUG zbsp values: [<zope.session.session.SessionData object at 0x43723bec>, <zope.session.session.SessionData object at 0x4372356c>, <zope.session.session.SessionData object at 0x437233ec>, ......... <zope.session.session.SessionData object at 0x436b586c>, <zope.session.session.SessionData object at 0x436b532c>, <zope.session.session.SessionData object at 0x43640b6c>,<zope.session.session.SessionData object at 0x436b572c>] ------------------- So it seems these are the session data containers. I wonder why they are written? Perhaps this happens when somebody else is logging into the system (so a new session is added) and others are concurrently reading from the session? However, this would mean that the session mechanism has a flaw, as this is a standard procedure? Any ideas of how to fix this? Best Regards, Hermann -- hermann(a)qwer.tk GPG key ID: 299893C7 (on keyservers) FP: 0124 2584 8809 EF2A DBF9 4902 64B4 D16B 2998 93C7 _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org https://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - https://mail.zope.org/mailman/listinfo/zope-announce https://mail.zope.org/mailman/listinfo/zope )

1 0

Zope Tests: 6 OK
by Zope Tests Summarizer 04 Mar '10

04 Mar '10

Summary of messages to the zope-tests list. Period Wed Mar 3 12:00:00 2010 UTC to Thu Mar 4 12:00:00 2010 UTC. There were 6 messages: 6 from Zope Tests. Tests passed OK --------------- Subject: OK : Zope-2.10 Python-2.4.6 : Linux From: Zope Tests Date: Wed Mar 3 20:36:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013671.html Subject: OK : Zope-2.11 Python-2.4.6 : Linux From: Zope Tests Date: Wed Mar 3 20:38:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013672.html Subject: OK : Zope-2.12 Python-2.6.4 : Linux From: Zope Tests Date: Wed Mar 3 20:40:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013673.html Subject: OK : Zope-2.12-alltests Python-2.6.4 : Linux From: Zope Tests Date: Wed Mar 3 20:42:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013674.html Subject: OK : Zope-trunk Python-2.6.4 : Linux From: Zope Tests Date: Wed Mar 3 20:44:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013675.html Subject: OK : Zope-trunk-alltests Python-2.6.4 : Linux From: Zope Tests Date: Wed Mar 3 20:46:59 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013676.html

1 0

Stop energy
by Jim Fulton 03 Mar '10

03 Mar '10

On Wed, Mar 3, 2010 at 1:20 AM, Christian Theune <ct(a)gocept.com> wrote: > Morning, > > On 03/02/2010 07:09 PM, Martijn Faassen wrote: >> Hi there, >> >> > Chris McDonough suggests to ponder further structuring of the ZTK into >> > separate sub-sets which might allow us to get better mileage regarding >> > maintenance and release management. He gave the example of the >> > "Bicycle Toolkit" (zope.component, zope.configuration, >> > zope.interface). >> >> -1 > > Uhh. -1 for what? -1 for pondering *something*? The note I took was a > request for thinking about something. No *I'm* confused about stop energy. Oh come on. No, it's not -1 to pondering something. It's -1 to the idea of "splitting the ZTK into separate sub-sets which might allow us to get better mileage regarding maintenance and release management." I suppose Martijn should have said something like: "I'm thinking of disagreeing with that idea." On Wed, Mar 3, 2010 at 5:06 AM, Marius Gedminas <marius(a)gedmin.as> wrote: > On Wed, Mar 03, 2010 at 10:06:18AM +0100, Hermann Himmelbauer wrote: >> Am Mittwoch 03 M�rz 2010 01:28:21 schrieb Chris McDonough: >> > On 3/2/10 2:50 PM, Jim Fulton wrote: >> > > On Tue, Mar 2, 2010 at 2:18 PM, Chris McDonough<chrism(a)plope.com> wrote: >> > >> On 3/2/10 1:09 PM, Martijn Faassen wrote: >> > >>> Hi there, >> > >>> >> > >>> > Chris McDonough suggests to ponder further structuring of the ZTK >> > >>> > into separate sub-sets which might allow us to get better mileage >> > >>> > regarding maintenance and release management. He gave the example >> > >>> > of the "Bicycle Toolkit" (zope.component, zope.configuration, >> > >>> > zope.interface). >> > >>> >> > >>> -1 >> > >> >> > >> I don't know who "people" are, and I don't know who "they" are, and I >> > >> don't know who broke what. >> > > >> > > No one should have to extract anything from the ZTK, because, AFAIK, >> > > the ZTK isn't a distribution. >> > >> > You've both successfully beaten any initiative out of me again. Well done. >> > Full speed ahead. >> >> Hmmm, interesting: ... >> As anyone can see, "worker_thread" is not started often, which is not optimal. >> How could this be improved? > > More positive feedback, less negative feedback. I'm not sure what you're referring to here. Does Martijn and me disagreeing with an idea constitute negative feedback? Is disagreement not allowed? If so, that doesn't leave much room for discussion. Or is Chris' characterization of my disagreement with him as "beating" negative feedback. This seems more appropriate to me, but I'm not sure what you mean. Jim -- Jim Fulton

5 9

z3c.form: Missing hidden widgets templates for radio buttons
by Timo Stollenwerk 03 Mar '10

03 Mar '10

Hello, I ran into problems when I was trying to hide a widget for a radio button inside a z3c.form (or plone.z3cform): ComponentLookupError: ( (<PloneSite at /test>, <HTTPRequest, URL=http://localhost:9080/test/comment_form>, <example.z3cformtutorial.comment.CommentForm object at 0xe67e90c>, <zope.schema._bootstrapfields.Bool object at 0xbdf368c>, <RadioWidget 'form.widgets.mybool'>), <InterfaceClass zope.pagetemplate.interfaces.IPageTemplate>, 'hidden') Full code: http://pastie.org/851816 I got a component error due to the missing hidden widget templates for the radio button widget: http://svn.zope.org/repos/main/z3c.form/branches/1.9/TODOS.txt: - There is only hidden widget templates registered for ``ITextWidget`` and ``ISelectWidget``. We have to define more hidden widgets. I would like to add the missing templates and registrations to the z3c.form code. Though, I need to fix this for the 1.9 branch too. I have the necessary permissions for the Zope SVN. Though, I'm not sure about the best way to do this. Shall I start a branch of the existing z3c.form 1.9 branch or fix this in the trunk and merge it into the 1.9 branch afterwards? I would like to fix this as soon as possible, and also make a new z3c.form 1.9.x release, if possible. Cheers, timo

2 1

Zope Tests: 6 OK
by Zope Tests Summarizer 03 Mar '10

03 Mar '10

Summary of messages to the zope-tests list. Period Tue Mar 2 12:00:00 2010 UTC to Wed Mar 3 12:00:00 2010 UTC. There were 6 messages: 6 from Zope Tests. Tests passed OK --------------- Subject: OK : Zope-2.10 Python-2.4.6 : Linux From: Zope Tests Date: Tue Mar 2 20:36:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013665.html Subject: OK : Zope-2.11 Python-2.4.6 : Linux From: Zope Tests Date: Tue Mar 2 20:38:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013666.html Subject: OK : Zope-2.12 Python-2.6.4 : Linux From: Zope Tests Date: Tue Mar 2 20:40:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013667.html Subject: OK : Zope-2.12-alltests Python-2.6.4 : Linux From: Zope Tests Date: Tue Mar 2 20:42:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013668.html Subject: OK : Zope-trunk Python-2.6.4 : Linux From: Zope Tests Date: Tue Mar 2 20:44:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013669.html Subject: OK : Zope-trunk-alltests Python-2.6.4 : Linux From: Zope Tests Date: Tue Mar 2 20:46:58 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013670.html

1 0

Reminder: IRC meeting today at 3pm UTC
by Christian Theune 02 Mar '10

02 Mar '10

Hi, today we'll start the experiment of having a short IRC meeting to talk about organisational issues. I've had some input for the agenda and mixed with my own questions here's the list of topics: ZTK / Infrastructure - Test runners / nightly builds - Review open issues - Bug tracking / working on bugs regularly Frameworks - Will Zope 2.13 use the ZTK? - Zope 3.5 release I think that will already be enough stuff for 30 minutes. Christian -- Christian Theune · ct(a)gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 0 · fax +49 345 1229889 1 Zope and Plone consulting and development

3 4

Zope Tests: 6 OK
by Zope Tests Summarizer 02 Mar '10

02 Mar '10

Summary of messages to the zope-tests list. Period Mon Mar 1 12:00:00 2010 UTC to Tue Mar 2 12:00:00 2010 UTC. There were 6 messages: 6 from Zope Tests. Tests passed OK --------------- Subject: OK : Zope-2.10 Python-2.4.6 : Linux From: Zope Tests Date: Mon Mar 1 20:36:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013659.html Subject: OK : Zope-2.11 Python-2.4.6 : Linux From: Zope Tests Date: Mon Mar 1 20:38:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013660.html Subject: OK : Zope-2.12 Python-2.6.4 : Linux From: Zope Tests Date: Mon Mar 1 20:40:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013661.html Subject: OK : Zope-2.12-alltests Python-2.6.4 : Linux From: Zope Tests Date: Mon Mar 1 20:42:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013662.html Subject: OK : Zope-trunk Python-2.6.4 : Linux From: Zope Tests Date: Mon Mar 1 20:44:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013663.html Subject: OK : Zope-trunk-alltests Python-2.6.4 : Linux From: Zope Tests Date: Mon Mar 1 20:46:28 EST 2010 URL: http://mail.zope.org/pipermail/zope-tests/2010-March/013664.html

1 0

z3c.form IGroupForm unused?
by Wichert Akkerman 02 Mar '10

02 Mar '10

z3c.form.interfaces.IGroupForm does not appear to be used anywhere. Is that an oversight, or should the interface be deleted? Wichert.

1 0

Evaluating a zope.i18nmessageid memory leak patch
by Brian Sutherland 02 Mar '10

02 Mar '10

Hi all, We've been using this patch in production for some weeks and testing for months: http://launchpadlibrarian.net/37237733/_zope_i18nmessageid_message.c.patch To resolve this bug: https://bugs.launchpad.net/zope3/+bug/257657 The patch seems to do what it claims and I've not noted any nasty side-effects thus far. However, before I commit it, I'd appreciate it if someone with knowledge of python C-extension fu had a look at it. I attempted to write a test for this, but my only idea (using weakref.ref) failed. If no-one objects, I'll probably just commit the patch anyway after some time. -- Brian Sutherland

1 0