I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing. I have the following folder set-up: Root |----Coz |---ZeoServer1 After the pack operation, folder 'ZeoServer1' is missing. In zope.conf I have: <zodb_db main> # Main FileStorage database <filestorage> path $INSTANCE/var/Data.fs </filestorage> mount-point / </zodb_db> <zodb_db zeo1> mount-point /Coz/ZeoServer1 # ZODB cache, in number of objects cache-size 5000 <zeoclient> server 192.168.123.1:8100 storage 1 name zeostorage var /apps/zeo1/var # ZEO client cache, in bytes cache-size 20MB # Uncomment to have a persistent disk cache #client zeo1 </zeoclient> </zodb_db> I am packing the main Data.fs (running on an application server - the zeo client) not the zeo Data.fs. (zeo server is running on a different machine). I am running Zope 2.9.2 on RedHat linux. Any ideas as to how to resolve this issue would be greatly appreciated! Jonathan
Hello Jonathan! Mon, 21 Aug 2006 11:41:42 -0400, you wrote:
I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing.
There is zeopack.py script to pack ZEO databases. It should be located on: /usr/lib/zope2.9/bin/zeopack.py if you installed with your distribution package, or else, somewhere alongside with mkzeoinstance.py and mkzopeinstance.py -- Gaël Le Mignot - gael@pilotsystems.net Pilot Systems - 9, rue Desargues - 75011 Paris Tel : +33 1 44 53 05 55 - http://www.pilotsystems.net Hébergement Zope et Plone gratuit - http://www.objectis.org
----- Original Message ----- From: ""Gaël Le Mignot"" <gael@pilotsystems.net> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org> Sent: Monday, August 21, 2006 11:50 AM Subject: Re: [Zope] Pack problem with zeo
Hello Jonathan!
Mon, 21 Aug 2006 11:41:42 -0400, you wrote:
I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing.
There is zeopack.py script to pack ZEO databases. It should be located on: /usr/lib/zope2.9/bin/zeopack.py if you installed with your distribution package, or else, somewhere alongside with mkzeoinstance.py and mkzopeinstance.py
How can I pack just the the main Data.fs (running under plain zope, not zeo)? I don't want to pack the zeo Data.fs (yet, but thanks for the info on how to pack with zeo!). Thanks, Jonathan
Jonathan wrote at 2006-8-21 11:41 -0400:
I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing.
I have the following folder set-up:
Root |----Coz |---ZeoServer1
After the pack operation, folder 'ZeoServer1' is missing.
That would be a severe bug in "FileStorage" -- and it is almost unbelievable... A mount point is nothing special for a "FileStorage". It is treated like any other object. What you tell us is that a reachable object can be discarded by packing. As a mount point is nothing special, it could happen with any object. But it is now years back that we got the last packing problem report. -- Dieter
----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 1:32 PM Subject: [Problem report] "pack" discards reachable object (was: [Zope] Pack problem with zeo)
Jonathan wrote at 2006-8-21 11:41 -0400:
I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing.
I have the following folder set-up:
Root |----Coz |---ZeoServer1
After the pack operation, folder 'ZeoServer1' is missing.
That would be a severe bug in "FileStorage" -- and it is almost unbelievable...
A mount point is nothing special for a "FileStorage". It is treated like any other object.
What you tell us is that a reachable object can be discarded by packing. As a mount point is nothing special, it could happen with any object.
But it is now years back that we got the last packing problem report.
I can reproduce the behaviour very easily... after I pack and the 'ZeoServer1' folder disappears i do the following: - stop zope - delete Data.fs - rename Data.fs.old to Data.fs - start zope And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again. Jonathan
Jonathan wrote at 2006-8-21 13:38 -0400:
... I can reproduce the behaviour very easily... after I pack and the 'ZeoServer1' folder disappears i do the following:
- stop zope - delete Data.fs - rename Data.fs.old to Data.fs - start zope
And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again.
If your "Data.fs.old" is not too large (not larger than 1 MB) and on the path to the "ZeoServer1" are only standard Zope objects, you could send it to me for investigation ([bg]zip it, to make it smaller). -- Dieter
----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 1:58 PM Subject: Re: [Problem report] "pack" discards reachable object (was: [Zope] Pack problem with zeo)
Jonathan wrote at 2006-8-21 13:38 -0400:
... I can reproduce the behaviour very easily... after I pack and the 'ZeoServer1' folder disappears i do the following:
- stop zope - delete Data.fs - rename Data.fs.old to Data.fs - start zope
And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again.
If your "Data.fs.old" is not too large (not larger than 1 MB) and on the path to the "ZeoServer1" are only standard Zope objects, you could send it to me for investigation ([bg]zip it, to make it smaller).
Thanks for the very kind offer but the Data.fs file is 53Mb before packing and 7.8Mb after packing. I tried tar/gzip but the 53Mb only dropped down to 8.9Mb. Thanks again for the offer. Jonathan
----- Original Message ----- From: "Jonathan" <dev101@magma.ca> To: "Dieter Maurer" <dieter@handshake.de> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 2:05 PM Subject: Re: [Problem report] "pack" discards reachable object (was: [Zope]Pack problem with zeo)
----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 1:58 PM Subject: Re: [Problem report] "pack" discards reachable object (was: [Zope] Pack problem with zeo)
Jonathan wrote at 2006-8-21 13:38 -0400:
... I can reproduce the behaviour very easily... after I pack and the 'ZeoServer1' folder disappears i do the following:
- stop zope - delete Data.fs - rename Data.fs.old to Data.fs - start zope
And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again.
If your "Data.fs.old" is not too large (not larger than 1 MB) and on the path to the "ZeoServer1" are only standard Zope objects, you could send it to me for investigation ([bg]zip it, to make it smaller).
Thanks for the very kind offer but the Data.fs file is 53Mb before packing and 7.8Mb after packing. I tried tar/gzip but the 53Mb only dropped down to 8.9Mb.
I have found a work-around: - delete the ZeoServer1 folder (via the ZMI) - pack the main Data.fs and specify only to pack items older than 1 day - after the pack (Data.fs down to 7.8Mb from 53Mb) undo the ZeoServer1 folder deletion Everything seems to be ok, but a bit of an ugly work-around. Jonathan
Jonathan wrote at 2006-8-21 14:05 -0400:
...
And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again.
If your "Data.fs.old" is not too large (not larger than 1 MB) and on the path to the "ZeoServer1" are only standard Zope objects, you could send it to me for investigation ([bg]zip it, to make it smaller).
Thanks for the very kind offer but the Data.fs file is 53Mb before packing and 7.8Mb after packing. I tried tar/gzip but the 53Mb only dropped down to 8.9Mb.
Then you may try the following: Manually add the mount point after packing. Pack again and see whether the mount point will still vanish. If it does, gzip and sent it to me (privately). -- Dieter
----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 2:53 PM Subject: Re: [Problem report] "pack" discards reachable object (was: [Zope] Pack problem with zeo)
Jonathan wrote at 2006-8-21 14:05 -0400:
...
And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again.
If your "Data.fs.old" is not too large (not larger than 1 MB) and on the path to the "ZeoServer1" are only standard Zope objects, you could send it to me for investigation ([bg]zip it, to make it smaller).
Thanks for the very kind offer but the Data.fs file is 53Mb before packing and 7.8Mb after packing. I tried tar/gzip but the 53Mb only dropped down to 8.9Mb.
Then you may try the following:
Manually add the mount point after packing. Pack again and see whether the mount point will still vanish. If it does, gzip and sent it to me (privately).
Using the work-around I mentioned earlier (delete the ZeoServer1 folder, pack > 1 day, after pack undo ZeoServer1 deletion) seems to have resolved the issue. I tried packing the Data.fs again and the ZeoServer1 folder did not disappear this time! The only thing I can think of this that there must have been some entry in the original Data.fs file that was causing the problem, and the pack removed that problem entry, but everything 'appears' to be ok now. Thanks again for all the help! Jonathan
----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "Jonathan" <dev101@magma.ca> Cc: <zope@zope.org>; <zodb-dev@zope.org> Sent: Monday, August 21, 2006 1:32 PM Subject: [Problem report] "pack" discards reachable object (was: [Zope] Pack problem with zeo)
Jonathan wrote at 2006-8-21 11:41 -0400:
I have encountered a problem caused by packing Data.fs (pack done via ZMI - Control Panel - Database Management - main - Pack). After Data.fs is packed, the ZODBmount point for the zeo server is missing.
I have the following folder set-up:
Root |----Coz |---ZeoServer1
After the pack operation, folder 'ZeoServer1' is missing.
That would be a severe bug in "FileStorage" -- and it is almost unbelievable...
A mount point is nothing special for a "FileStorage". It is treated like any other object.
What you tell us is that a reachable object can be discarded by packing. As a mount point is nothing special, it could happen with any object.
But it is now years back that we got the last packing problem report.
I can reproduce the behaviour very easily... after I pack and the 'ZeoServer1' folder disappears i do the following: - stop zope - delete Data.fs - rename Data.fs.old to Data.fs - start zope And the ZeoServer1 folder is back. I then pack zope and the ZeoServer1 folder disappears again. I can do this again and again and again. Jonathan
participants (3)
-
Dieter Maurer -
gael＠pilotsystems.net -
Jonathan