- Zope - Zope lists

Error in Copy/Import during Migration
by Brian Brinegar 07 Jan '10

07 Jan '10

I'm fairly well versed on the inner workings of Zope, but yesterday I've run into a problem that I can grasp. First, some background on what I'm doing. I've got a 200GB Data.fs file which I'm splitting up into multiple storages. The way I'm doing this is to create a zope instance which mounts a new storage and the old storage and then a python script connects to the application and uses a modified version of manage_clone (which maintains ownership) to copy content into the new storage. This works correctly for most things, but yesterday I tried to move a folder with about 3.1GB of stuff in it. On a side note, I ran into an issue with running out of /tmp space during the clone. The _getCopy method of CopySourse exports an object to a tempfile and then imports it to create the copy. When copying something larger than available tmp space zope crashes. I worked around this by explicitly setting tempfile.tempdir to somewhere with plenty of free space. There may be an environment variable to do this as well. Just an FYI. Anyway, here's what I see. The copy starts, a tempfile is created (on the client) and grows to the appropriate size (3.1GB). Then, a Data.fs.temp appears on the new server and grows to the appropriate size. However, when my script tries to commit the transaction I get an EOF error: Traceback (most recent call last): File "./migrate_site.py", line 45, in ? transaction.get().commit() File "/var/local/zope/Zope-2.11.4-1/lib/python/transaction/_transaction.py", line 325, in commit self._commitResources() File "/var/local/zope/Zope-2.11.4-1/lib/python/transaction/_transaction.py", line 427, in _commitResources rm.tpc_vote(self) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZODB/Connection.py", line 744, in tpc_vote s = vote(transaction) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/ClientStorage.py", line 1004, in tpc_vote self._server.vote(id(txn)) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/ServerStub.py", line 262, in vote return self.rpc.call('vote', trans_id) File "/var/local/zope/Zope-2.11.4-1/lib/python/ZEO/zrpc/connection.py", line 699, in call raise inst # error raised by server EOFError I don't seem to have any space issues on any devices, and the process works for smaller site. Any input would be greatly appreciated. Thanks, -- Brian Brinegar Web Services Coordinator Engineering Computer Network

4 8

zeo cache-size tuning - number of obj. vs MB
by Gaute Amundsen 06 Jan '10

06 Jan '10

Hi What's the difference between the to cache-size settings here? I've not been able to find a good description to guide me in finding the right values. <zodb_db main> mount-point / cache-size 10000 1. <zeoclient> server foo:9080 storage main name zeostorage var $INSTANCE/var cache-size 20MB 2. </zeoclient> </zodb_db> As far as I've been able to determine, the second one 2. refers to a separate cache at the zeo connection level. Running 9 zeo clients (2.7.9) like this on a frontend with 4G ram, varnish, apache, and haproxy. Tethering on the edge of too much swapping. Needing to cut down.. Would it be better to spend all the memory on 1? Is there a good way to find a balance? Regards Gaute Amundsen

2 3

generate unique user id, without cookies
by Marko Kruijer 04 Jan '10

04 Jan '10

after having some weird issues with Sessions and ZEO usage I've found out part of the problem. It turns out certain browsers (IE6 mostly) save the session ID cookies, but sometimes these disappear. This results in a new _ZopeId being generated and thus the new session is empty. At first i thought it was a session product problem, but in recreating this with my own session management (mysql based) the same issue arises. I don't know why this happens, the only obstacle I'm facing now is to create an adequate solution ;) Because the cookie method is not flawless we've decided to create a way to uniquely determine a user without using a client side cookie, we are already using the IP address for this, Of course that is not enough, so I was wondering what other 'unique' elements could be used for this. I've thought about adding user agent, but this is to general I think. Internal IP would be ideal, but I'm not sure this can be done (probably not). Maybe there are also 'other' zope session products that work in another way and might fix my problems as a whole?

3 2

exUserFolder and Zope 2.12
by Baiju M 02 Jan '10

02 Jan '10

Hi, In exUserFolder there are few exceptions raised like this: raise 'LoginRequired', self.docLogin(self, request) This will not working in Zope 2.12 (Python 2.6) Any idea, how to change it ? Regards, Baiju M

3 6

Change admin's password
by iarly selbir | ski0s 31 Dec '09

31 Dec '09

There are some command to change admin's password, in my env I have a server with many instances and I need change it for all Thanks in advance for some tip. Regards, - - iarly selbir | ski0s :wq!

4 12

utilities @ the site level
by Jim Pharis 31 Dec '09

31 Dec '09

Can I register utilities at the site level in zcml? And once I have the local utility registered, how do I pass that site manager context to my browser/forms so I can do things like createObject. createObject seems to fail because it can't find the utility, but I think that's because its not looking for the utililty at the site level. I'm using Zope2.12 w/five.localsitemanager. Thanks, - Jim

2 3

Zope developers in local government or with transparency/participation projects
by Steven Clift 30 Dec '09

30 Dec '09

We are gathering software developers interested in local government transparency and community participation here: http://e-democracy.org/locallabs It is a new e-list/online group. It would be great to have a healthy Zope contingent among us. Steven Clift E-Democracy.org

1 0

Zope2.12
by Jim Pharis 25 Dec '09

25 Dec '09

I'm trying to wrap my head around what the changes in Zope2.12 can mean for how I develop in Zope2 now. I've developed things in Zope3 and am getting stuck attempting the same methods in Zope2.12. So I see now that etc/ now has a site.zcml. But what is missing is the package-includes directory that provides the wiring to zcml directives in the varies packages. Why are those configurations missing from Zope2.12.2 etc/? I am trying to make it so a site can be added the same it is added in the Web Component Development with Zope 3 book and finding that the browser directives that declare the menu item and container view are missing from the wiring. Overall, it would be helpful for the Zope2.12 documentation to give a better idea about how to develop in the new ZTK way. I'm sure someone is working on it though. Thanks, - Jim

5 21

DateTime Issues
by Justin Dunsworth 24 Dec '09

24 Dec '09

I am having difficulties with time zones and rendering proper times/dates. My time zone is GMT-6 (CST)... mysql reports the proper time/date, running <dtml-var expr="e.strftime('%c')"> shows Zope has the right date, running a query straight from the SQLMethod shows the proper time in relation to the field in mysql. However, when I try and run the variable in the dtml document it gives the time in GMT+0. For example... in mysql I have "2009-12-23 10:41:06" as the date of the record. Running the SQL Method returns it as '2009/12/23 10:41:06 GMT+0' -- So far so good but when I run <dtml-var comment_date fmt="%m-%d-%y %H:%M"> in my document it gives: 12-23-09 04:41. I can get fmt=ISO (and other similar time functions) working and showing the proper date/time but I'd rather have a little more control over how the time is displayed. Is there any suggestions on what to do? I've looked many places and couldn't find the answer. I am running Zope 2.11.4-final, python 2.4.4, win32 Regards, -J

3 5

Fork another process from Zope
by Baiju M 22 Dec '09

22 Dec '09

Hi, Is it possible to fork another process within Zope ? Any suggestion ? Regards, Baiju M

2 1