November 2008 - Zope-Dev

Plone/Zeocluster performances problems
by Service TICE 08 Dec '08

08 Dec '08

Hello After many searches I’m stuck on several problems, I hope you guys can help me :) I’m using Plone as institutional webportal (Zope 2.9.8-final, python 2.4.4) with python 2.4.4. The portal runs a zeocluster with 4 production instances, 3 threads each, and 1 admin instance (in debug mode). All instances share the same ZODB and data.fs on local drive. We use Apache 2 and a "STICKY_ROUTE" cookie to redirect user to the instance he's logged to. We use SSO authentification (CAS) with PloneCASLogin 2.5.0. Apache configuration: ## Default Virtual Host Configuration Listen xxx.xxx.xxx:80 NameVirtualHost xxx.xxx.xxx:80 <VirtualHost xxx.xxx.xxx:80> ServerName xxx.xxx.xxx ServerAdmin xxx(a)xxx.xxx <Proxy balancer://lb> BalancerMember http://xxx.xxx.xxx:8080 route=8080" BalancerMember http://xxx.xxx.xxx:8081 route=8081" BalancerMember http://xxx.xxx.xxx:8082 route=8082" BalancerMember http://xxx.xxx.xxx:8083 route=8083" </Proxy> # conditional proxy pass ProxyPass / balancer://lb/VirtualHostBase/http/xxx.xxx.xxx: 80/plone/VirtualHostRoot/ stickysession=STICKY_ROUTE #LOGS #LogLevel debug ServerAlias * CustomLog /opt/apache2/xxx.xxx.xxx.log combined </VirtualHost> We noticed that, sometimes, users are not redirected to right instance, so we decided to use the same temporary_folder for all instances and users are connected to the 4 instances at same time. But this modification causes errors like this one from my event.log file: 2008-11-26T10:45:23 INFO ZPublisher.Conflict ConflictError at / VirtualHostBase/http/XXXXX.fr:80/XXXX/VirtualHostRoot/Cours/ Cours.XXXXX.4424/fichiersan_XXXXX.2530/cours_supports_affichage: database conflict error (oid 0x2571, class BTrees._OOBTree.OOBTree, serial this txn started with 0x037a24a416ae79bb 2008-11-26 09:40:05.315987, serial currently committed 0x037a24a95ee0d788 2008-11-26 09:45:22.237099) (1 conflicts (0 unresolved) since startup at Wed Nov 26 10:43:19 2008) and this one from plone's error_log: Request URL http://XXXXXX.fr/Members/XXXXX/Cours/Cours.XXXXX.4648/cours_attacher_templa… Exception Type database conflict error (oid 0x1247, class BTrees._OOBTree.OOBTree, serial this txn started with 0x037a1ffe66682b66 2008-11-25 13:50:24.001620, serial currently committed 0x037a1ffeae62ca44 2008-11-25 13:50:40.871695) Exception Value database conflict error (oid 0x1247, class BTrees._OOBTree.OOBTree, serial this txn started with 0x037a1ffe66682b66 2008-11-25 13:50:24.001620, serial currently committed 0x037a1ffeae62ca44 2008-11-25 13:50:40.871695) Traceback (innermost last): * Module Zope2.App.startup, line 173, in zpublisher_exception_hook * Module ZPublisher.Publish, line 121, in publish * Module Zope2.App.startup, line 240, in commit * Module transaction._manager, line 96, in commit * Module transaction._transaction, line 380, in commit * Module transaction._transaction, line 378, in commit * Module transaction._transaction, line 436, in _commitResources * Module ZODB.Connection, line 665, in tpc_vote * Module ZEO.ClientStorage, line 893, in tpc_vote * Module ZEO.ClientStorage, line 877, in _check_serials ConflictError: database conflict error (oid 0x1247, class BTrees._OOBTree.OOBTree, serial this txn started with 0x037a1ffe66682b66 2008-11-25 13:50:24.001620, serial currently committed 0x037a1ffeae62ca44 2008-11-25 13:50:40.871695) From what I understand, there's a conflict in my database when user wants to access an object. I assume it's related to the temporary_folder sharing modification because errors appeared after it. Is there a way to resolve this error? Is there inconvenient to share temporary_folder? Should I stop it? My second problem, found in the event.log: 2008-11-26T10:45:28 ERROR PortalTransforms Cannot register transform lynx_dump, using BrokenTransform: Error Unable to find binary "lynx" in /opt/local/bin:/usr/bin:/bin:/usr/ sbin:/sbin:/usr/local/bin:/usr/X11/bin I don't understand when and why Plone tries to access to Lynx. We don't receive any traceback error in Plone's error_log. Last but not least. Sometimes instances stops all alone. We were not able to find why because we don't receive any error, message or signal. When stops occur, we restart Zeo by ssh, then instances works fine for some times but the problem comes back later. The server has 8 processors with very low usage but the 12gb RAM are always saturated à 98%. Python process takes 1 to 2gb RAM but there's a lot of "httpd" processes, up to 2.5gb each, their origin remains unknown to us. Thanks

3 2

z3c.autoinclude doesn't include extra_requires
by Christian Zagrodnick 07 Dec '08

07 Dec '08

Hi, when I include an egg with extras (like gocept.foo[server]) the dependencies from the extra are not automatically included with autoinclude. I'm posting this here, because there is no other obvious place (no project for this on lauchpad). Regards, -- Christian Zagrodnick · cz(a)gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 4 · fax +49 345 1229889 1 Zope and Plone consulting and development

3 2

[Fwd: Zope Tests: 4 OK, 2 Failed]
by Tres Seaver 05 Dec '08

05 Dec '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Any chance you can get these worked out? I looked at the Products.Five tests today, with the following observations: - Not as many tests fail if I run '-s Products.Five' as when I run the whole set: in particular, the first two in 'aqlegacy_ftest.txt' ('HTTPError', 'falcon.pt' not called) don't occur. - The next 'aqlegacy_ftest.txt' failure is because the content provider is not being acquisition wrapped. The remaining failure is likely due to the same cause (it is on the following line). - All the failing tests in Products.Five come from code which relies on zope.testbrowser, via the Products.Five.testbrowser shim. - The first failing zope.testbrowser test (README.txt line 1162) seems to be due to a change somewhere which contradicts the comment just below the example: "Here, the body is left in place because it isn't form data." - The testing requirements for zope.testbrowser itself are really snarled up: it pulls in basically all of Zope3. - -------- Original Message -------- Subject: Zope Tests: 4 OK, 2 Failed Date: Sat, 29 Nov 2008 13:00:03 +0100 From: Zope Tests Summarizer <zope-tests(a)epy.co.at> To: Zope-dev <zope-dev(a)zope.org> Newsgroups: gmane.comp.web.zope.devel Summary of messages to the zope-tests list. Period Fri Nov 28 12:00:00 2008 UTC to Sat Nov 29 12:00:00 2008 UTC. There were 6 messages: 6 from Zope Tests. Test failures - ------------- Subject: FAILED (failures=3) : Zope-trunk Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:38:21 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010572.html Subject: FAILED (failures=3) : Zope-trunk Python-2.5.2 : Linux From: Zope Tests Date: Fri Nov 28 20:39:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010573.html Tests passed OK - --------------- Subject: OK : Zope-2.8 Python-2.3.7 : Linux From: Zope Tests Date: Fri Nov 28 20:32:16 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010568.html Subject: OK : Zope-2.9 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:33:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010569.html Subject: OK : Zope-2.10 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:35:21 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010570.html Subject: OK : Zope-2.11 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:36:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010571.html _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope ) - -- =================================================================== Tres Seaver +1 540-429-0999 tseaver(a)palladion.com Palladion Software "Excellence by Design" http://palladion.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJMWKt+gerLs4ltQ4RAh0MAJ4gBJZOdsRw+Q8ZqhOU+VlajxuC6wCgw0BP oCiVHZ0ig6wiItTk9clcBJU= =KihL -----END PGP SIGNATURE-----

8 14

Editing an item stored inside a BTreeFolder
by abhishek dastidar 30 Nov '08

30 Nov '08

Hi All, I have until now learnt how to play around with BTreeFolder2.I have one remaining doubt left.How do I edit an item that is stored inside a BtreeFolder2? I added my own OOBTree objects inside and I would like to manipulate the data inside the OOBTree. The only way I see is fetch the obj, delete it and store the new one again. Any other way? This is what I did: ... if self.userFolder in self.aq_parent.objectIds(): pass else: self.manage_addProduct['BTreeFolder2'].manage_addBTreeFolder(self.userFolder,'btf2 folder ') try: btf = self.userFolder uniq_id = getattr(self.aq_parent, btf).generateId() obT = OOBStuff(uniq_id,{'a':1,'b':2}) #This is the object I would like to edit later. getattr(self.aq_parent,btf)._setObject(uniq_id, obT) obtuff = getattr(self.aq_parent, btf)._getOb('item399638579') testy = obtuff.return_Tree() ... finally: pass class OOBStuff(BTreeFolder2): meta_type ='OOBStuff' def __init__(self, oid,dict_to_add): super(OOBStuff, self).__init__(oid) self.item = OOBTree() self.item['Auth'] = dict_to_add def return_Tree(self): return self.item Here,I would like to edit(add more key:value pairs) to the OOBStuff object that I had stored in the BTF2. Regards, Abhi

1 1

Zope Tests: 4 OK, 2 Failed
by Zope Tests Summarizer 30 Nov '08

30 Nov '08

Summary of messages to the zope-tests list. Period Sat Nov 29 12:00:00 2008 UTC to Sun Nov 30 12:00:00 2008 UTC. There were 6 messages: 6 from Zope Tests. Test failures ------------- Subject: FAILED (failures=3) : Zope-trunk Python-2.4.5 : Linux From: Zope Tests Date: Sat Nov 29 20:38:43 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010578.html Subject: FAILED (failures=3) : Zope-trunk Python-2.5.2 : Linux From: Zope Tests Date: Sat Nov 29 20:40:13 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010579.html Tests passed OK --------------- Subject: OK : Zope-2.8 Python-2.3.7 : Linux From: Zope Tests Date: Sat Nov 29 20:32:42 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010574.html Subject: OK : Zope-2.9 Python-2.4.5 : Linux From: Zope Tests Date: Sat Nov 29 20:34:12 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010575.html Subject: OK : Zope-2.10 Python-2.4.5 : Linux From: Zope Tests Date: Sat Nov 29 20:35:42 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010576.html Subject: OK : Zope-2.11 Python-2.4.5 : Linux From: Zope Tests Date: Sat Nov 29 20:37:12 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010577.html

1 0

Zope Tests: 4 OK, 2 Failed
by Zope Tests Summarizer 29 Nov '08

29 Nov '08

Summary of messages to the zope-tests list. Period Fri Nov 28 12:00:00 2008 UTC to Sat Nov 29 12:00:00 2008 UTC. There were 6 messages: 6 from Zope Tests. Test failures ------------- Subject: FAILED (failures=3) : Zope-trunk Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:38:21 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010572.html Subject: FAILED (failures=3) : Zope-trunk Python-2.5.2 : Linux From: Zope Tests Date: Fri Nov 28 20:39:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010573.html Tests passed OK --------------- Subject: OK : Zope-2.8 Python-2.3.7 : Linux From: Zope Tests Date: Fri Nov 28 20:32:16 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010568.html Subject: OK : Zope-2.9 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:33:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010569.html Subject: OK : Zope-2.10 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:35:21 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010570.html Subject: OK : Zope-2.11 Python-2.4.5 : Linux From: Zope Tests Date: Fri Nov 28 20:36:51 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010571.html

1 0

z3c.indexer 0.5.1
by Dan Korostelev 28 Nov '08

28 Nov '08

Can someone release z3c.indexer 0.5.1, or give me rights to do so myself? It has some important bugfixes and seems to be stable. Or is there any work on this package planned to do soon? :-) -- WBR, Dan Korostelev

2 1

deprecate http://download.zope.org/distribution
by Jim Fulton 28 Nov '08

28 Nov '08

http://download.zope.org/distribution was set up as a place to publish distributions while we were learning about setuptools, eggs, and pypi. I think now, we're all using PyPI (or local repositories). I'd like to deprecate this site, making it read-only for now, but eventually removing it. Any objections? Jim -- Jim Fulton Zope Corporation

10 15

Zope Tests: 4 OK, 2 Failed
by Zope Tests Summarizer 28 Nov '08

28 Nov '08

Summary of messages to the zope-tests list. Period Thu Nov 27 12:00:00 2008 UTC to Fri Nov 28 12:00:00 2008 UTC. There were 6 messages: 6 from Zope Tests. Test failures ------------- Subject: FAILED (failures=3) : Zope-trunk Python-2.4.5 : Linux From: Zope Tests Date: Thu Nov 27 20:39:40 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010566.html Subject: FAILED (failures=3) : Zope-trunk Python-2.5.2 : Linux From: Zope Tests Date: Thu Nov 27 20:41:10 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010567.html Tests passed OK --------------- Subject: OK : Zope-2.8 Python-2.3.7 : Linux From: Zope Tests Date: Thu Nov 27 20:33:39 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010562.html Subject: OK : Zope-2.9 Python-2.4.5 : Linux From: Zope Tests Date: Thu Nov 27 20:35:10 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010563.html Subject: OK : Zope-2.10 Python-2.4.5 : Linux From: Zope Tests Date: Thu Nov 27 20:36:40 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010564.html Subject: OK : Zope-2.11 Python-2.4.5 : Linux From: Zope Tests Date: Thu Nov 27 20:38:10 EST 2008 URL: http://mail.zope.org/pipermail/zope-tests/2008-November/010565.html

1 0

Re: [Zope-dev] SVN: Sandbox/malthe/chameleon.core/src/chameleon/core/utils.py Catch all exceptions; it's not required to be able to determine length.
by Tres Seaver 28 Nov '08

28 Nov '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Malthe Borch wrote: > Log message for revision 93341: > Catch all exceptions; it's not required to be able to determine length. > > Changed: > U Sandbox/malthe/chameleon.core/src/chameleon/core/utils.py > > -=- > Modified: Sandbox/malthe/chameleon.core/src/chameleon/core/utils.py > =================================================================== > --- Sandbox/malthe/chameleon.core/src/chameleon/core/utils.py 2008-11-25 14:20:12 UTC (rev 93340) > +++ Sandbox/malthe/chameleon.core/src/chameleon/core/utils.py 2008-11-25 14:21:04 UTC (rev 93341) > @@ -188,7 +188,9 @@ > def insert(self, key, iterable): > try: > length = len(iterable) > - except TypeError: > + except: > + # we catch all exceptions here, because it's not required > + # for iteration > length = None > > try: > @@ -201,7 +203,9 @@ > raise TypeError( > "Can only repeat over an iterable object (%s)." % iterable) > > - self[key] = (iterator, length) > + if length is not None: > + self[key] = (iterator, length) > + > return iterator > > def __getitem__(self, key): Hmm, some exceptions should never be caught (KeyboardInterrupt, SystemExit, ConflictError). Tres. - -- =================================================================== Tres Seaver +1 540-429-0999 tseaver(a)palladion.com Palladion Software "Excellence by Design" http://palladion.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJLC00+gerLs4ltQ4RAgTcAJ4y1O2fsJtabW9wxvVXObwKUPtzWACdFfze aYy6uw7WkG8UXHdSlEcc9cs= =sD/Q -----END PGP SIGNATURE-----

2 1