- Zope - Zope lists

Safe way to abort or re-start stalled out ZODB pack?
by John Schinnerer 27 Jan '10

27 Jan '10

Hello, This is for Zope 2.9.8-final, python 2.4.4, linux2 (debian) (installed by the Plone 2.5.5 installer if that matters, and using zeoserver) I have a ZODB pack operation started via the ZMI control panel that has failed to complete. It appears to be from a disk space issue (traceback below). The zope instance is still working fine on the pre-pack ZODB, and, there is a Data.fs.pack file sitting in ../zeocluster/server/var which hasn't been modified in the last ten hours. I need to know how to deal with this situation safely - how to abort and/or safely re-start the pack (the disk space issue has been dealt with). Some questions that have come to mind are: Is it safe to just restart zope? Will that clear the stalled pack operation automagically? Will I need to do something manually with the Data.fs.pack file? Any assistance appreciated...! thanks, John S. Traceback: --------------------- 2010-01-27T03:51:09 INFO ZEO.zrpc.Connection(S) (127.0.0.1:35831) vote() raised exception: [Errno 28] No space left on device Traceback (most recent call last): File "/opt/Plone-2.5.5/lib/python/ZEO/zrpc/connection.py", line 421, in handle_request ret = meth(*args) File "/opt/Plone-2.5.5/lib/python/ZEO/StorageServer.py", line 465, in vote return self._wait(lambda: self._vote()) File "/opt/Plone-2.5.5/lib/python/ZEO/StorageServer.py", line 583, in _wait return self._restart() File "/opt/Plone-2.5.5/lib/python/ZEO/StorageServer.py", line 599, in _restart resp = self._thunk() File "/opt/Plone-2.5.5/lib/python/ZEO/StorageServer.py", line 465, in <lambda> return self._wait(lambda: self._vote()) File "/opt/Plone-2.5.5/lib/python/ZEO/StorageServer.py", line 539, in _vote return self.storage.tpc_vote(self.transaction) File "/opt/Plone-2.5.5/lib/python/ZODB/FileStorage/FileStorage.py", line 891, in tpc_vote self._file.flush() IOError: [Errno 28] No space left on device --------------------------- -- John Schinnerer - M.A., Whole Systems Design -------------------------------------------- - Eco-Living - Whole Systems Design Services People - Place - Learning - Integration john(a)eco-living.net http://eco-living.net

1 0

Cann't we use 'get' as object name in Zope 2.12 ?
by Baiju M 27 Jan '10

27 Jan '10

Hi, Any idea about this ? >>> app.manage_addFolder('get') Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/opt/baiju/zesite/eggs/Zope2-2.12.1-py2.6-linux-i686.egg/OFS/Folder.py", line 51, in manage_addFolder self._setObject(id, ob) File "/opt/baiju/zesite/eggs/Zope2-2.12.1-py2.6-linux-i686.egg/OFS/ObjectManager.py", line 332, in _setObject v = self._checkId(id) File "/opt/baiju/zesite/eggs/Zope2-2.12.1-py2.6-linux-i686.egg/OFS/ObjectManager.py", line 116, in checkValidId 'The id "%s" is invalid - it is already in use.' % id) zExceptions.BadRequest: The id "get" is invalid - it is already in use. Regards, Baiju M

3 2

Very odd reverse proxy problem . [nginx -> win32 zope]
by kiorky 22 Jan '10

22 Jan '10

The things: * I have a nginx handmade compiled under the hood * I have an official zope+plone installation on native windows * I have a django based application inside the cygwin * I have a tomcat+cas installation on native windows All of that seem to be configured correctly. What i want to do is to make my nginx a reverse proxy of the 3 others applications. Because of some other application needs (wsgi served with flup/socket) i need that nginx to live inside the cygwin installation. That's not my concern afterall :). The nginx works well for static contents and as the the django and tomcat installations reverse proxy. Here come problems with zope+plone. If i hit my http://url/plone (nginx mapped point to the plone install as http reverse proxy), the first request (get /) pass, but the other stall as 206 partial content and are very long to be satisfied. The browser seems to be blocked on some read() call. I tried a bunch of things nginx side (use epoll, use select, tweak proxy parameters, stop proxy buffering, set timeouts, set retrys and so on) but i have not found the right configuration if it is there. But where it is very strange is that if i make an ssh tunnel from localhost:80 to prod_machine:localhost:80, then make some entry into my /etc/hosts to fake the dns name. Then browse to http://myurl/plone, no problem, i have the content, and all http request are satisfied (js & co.). I really don't know how to debug that, can it be because the request enter from cygwin, go out to windows re enter cygwin and go for the client? The fact that throught the ssh tunnel, when i hit the nginx server on my plone install (like "as normal", i dont hit plone but nginx) work perfectly lives me without words. Other strange thing is that the CAS application, also http reverse proxified work like a charm. Other thing is that if i use the windows nginx binary from nginx website, with equal configuration, it works. The only thing is nginx running out of cygwin stack and compiled for win32. If someone has some suggestions .... -- Cordialement, KiOrKY GPG Key FingerPrint: 0x1A1194B7681112AF

1 0

python help needed
by Garry Saddington 19 Jan '10

19 Jan '10

I am trying to upload a csv file (called data) using the following script: i=0 d=data.readlines() for row in d: i+=1 a=row.split(',') if i > 1: subjectid=a[0] entry=a[1] type=a[2] studentid=a[3] try: context.insertestimatesandtargets(subjectid=subjectid,entry=entry,type=type,studentid=studentid) except: continue return "something good" (email editor messed up indentation) insertestimatesandtargets() is a ZSQLmethod. When the call to this method results in an error the script stops and not all data is inserted. Without an error all the data is inserted. So how can I make this script skip over errors and continue? The reason is that there may already be some data in the database table that I want to preserve. regards Garry

2 2

Product loading during ZopeTestCase startup
by Encolpe Degoute 19 Jan '10

19 Jan '10

Hello, since few days i'am facing a strange problem with egg loading in tests. One egg called project.site_policy is never loaded in the Products namespace: the ZopeLite.hasPackage('project.site_policy') always returns False. Where is the code that loads eggs and products outside SOFTWARE_HOME/lib/python/Products ? regards -- "...[Linux] peut communiquer à travers n'importe quel medium excepté les signaux de fumée." -+- Dr. Greg Wettstein, Roger Maris Cancer Center -+-

2 2

Re: [Zope] New Zope2 releases available
by Encolpe Degoute 13 Jan '10

13 Jan '10

Tres Seaver a écrit : [...] > > - "Zope 2.10.11", > http://www.zope.org/Products/Zope/2.10.22 short typo : - "Zope 2.10.11", http://www.zope.org/Products/Zope/2.10.11 -- <html> <head> </head> <body bgcolor="#ffffff" text="#000000"> <img alt="Encolpe Degoute <encolpe.degoute(a)quadra-informatique.fr>" src="file:///home/edegoute/Images/mailsignpic2.png"/> </body> </html>

1 0

New Zope2 releases available
by Tres Seaver 13 Jan '10

13 Jan '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 In order to address a potential cross-site scripting problem in Zope's fallback error message, we are releasing new versions of the 2.8, 2.9, 2.10, 2.11, and 2.12 release lines. The issue, reported by the Plone team, could be triggered by a combination of a broken 'standard_error_message' template, plus an error whose 'str' contained markup. Although the 2.8, 2.9, and 2.10 branches are formally "out-of- maintenance", they are still in very wide use. the Zope security response team decided to release versions for those branches, in addition to the 2.11 and 2.12 branches which are still being supported under normal policy. Releases are available here: - - "Zope 2.8.12", http://www.zope.org/Products/Zope/2.8.12 - - "Zope 2.9.12", http://www.zope.org/Products/Zope/2.9.12 - - "Zope 2.10.11", http://www.zope.org/Products/Zope/2.10.22 - - "Zope 2.11.6", http://www.zope.org/Products/Zope/2.11.6 - - "Zope 2.12.3", http://pypi.zope.org/pypi/Zope2/2.12.3 Please note that the 2.12 releases are made only on the Python Package Index server, aka "PyPI" or "the Cheeseshop." Tres. - -- =================================================================== Tres Seaver +1 540-429-0999 tseaver(a)palladion.com Palladion Software "Excellence by Design" http://palladion.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAktNPJYACgkQ+gerLs4ltQ6P1QCeJk6B+kIz9tXmN2oGYxFh1HuT WTIAoKevoMU9XOLmTJgpiRuLk7dHZnZv =PrpY -----END PGP SIGNATURE-----

1 0

Five EditFrom and Fields appears broken
by Jim Pharis 08 Jan '10

08 Jan '10

Does anyone successfully use zope.formlib.form Fields with Products.Five.formlib.formbase EditForm? I was trying to figure out why my form_fields.omit and custom_widget were being ignored. I followed it up the stack and found the method setUpEditWidgets in zope.app.form.utility never takes Fields into account and just looks at the schema and context to determine the fields. So I was starting to think maybe you don't use Fields with Five forms, but there is a unit test in Products.Five.formlib.tests view.py that actually thinks its using Fields. I don't think this is actually the case though, the test just doesn't touch omit or custom_widget functionality so it passes thinking Fields is working. The /Products/Five/form/__init__.py imports zope.app.form.utility setUpEditWidgets. zope.formlib has a different setUpEditWidgets method in zope/formlib/form.py that actually takes form_fields as the 1st param. So in summary, if you think your using Fields in Five try using omit or custom_widget and see if it works and you actually are really using Fields. If it works maybe I have something messed up on my end. TIA - Jim

1 0

Error in Copy/Import during Migration
by Brian Brinegar 07 Jan '10

07 Jan '10

I'm fairly well versed on the inner workings of Zope, but yesterday I've run into a problem that I can grasp. First, some background on what I'm doing. I've got a 200GB Data.fs file which I'm splitting up into multiple storages. The way I'm doing this is to create a zope instance which mounts a new storage and the old storage and then a python script connects to the application and uses a modified version of manage_clone (which maintains ownership) to copy content into the new storage. This works correctly for most things, but yesterday I tried to move a folder with about 3.1GB of stuff in it. On a side note, I ran into an issue with running out of /tmp space during the clone. The _getCopy method of CopySourse exports an object to a tempfile and then imports it to create the copy. When copying something larger than available tmp space zope crashes. I worked around this by explicitly setting tempfile.tempdir to somewhere with plenty of free space. There may be an environment variable to do this as well. Just an FYI. Anyway, here's what I see. The copy starts, a tempfile is created (on the client) and grows to the appropriate size (3.1GB). Then, a Data.fs.temp appears on the new server and grows to the appropriate size. However, when my script tries to commit the transaction I get an EOF error: Traceback (most recent call last): File "./migrate_site.py", line 45, in ? transaction.get().commit() File "/var/local/zope/Zope-2.11.4-1/lib/python/transaction/_transaction.py", line 325, in commit self._commitResources() File "/var/local/zope/Zope-2.11.4-1/lib/python/transaction/_transaction.py", line 427, in _commitResources rm.tpc_vote(self) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZODB/Connection.py", line 744, in tpc_vote s = vote(transaction) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/ClientStorage.py", line 1004, in tpc_vote self._server.vote(id(txn)) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/ServerStub.py", line 262, in vote return self.rpc.call('vote', trans_id) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/zrpc/connection.py", line 699, in call raise inst # error raised by server EOFError I don't seem to have any space issues on any devices, and the process works for smaller site. Any input would be greatly appreciated. Thanks, -- Brian Brinegar Web Services Coordinator Engineering Computer Network

4 8

zeo cache-size tuning - number of obj. vs MB
by Gaute Amundsen 06 Jan '10

06 Jan '10

Hi What's the difference between the to cache-size settings here? I've not been able to find a good description to guide me in finding the right values. <zodb_db main> mount-point / cache-size 10000 1. <zeoclient> server foo:9080 storage main name zeostorage var $INSTANCE/var cache-size 20MB 2. </zeoclient> </zodb_db> As far as I've been able to determine, the second one 2. refers to a separate cache at the zeo connection level. Running 9 zeo clients (2.7.9) like this on a frontend with 4G ram, varnish, apache, and haproxy. Tethering on the edge of too much swapping. Needing to cut down.. Would it be better to spend all the memory on 1? Is there a good way to find a balance? Regards Gaute Amundsen

2 3