Hi, I'm working on a Zope application that will store a bunch of openoffice documents that users change on a regular basis. I am not completely sure about using the ZODB for this for a few reasons, and I can't find complete documentation on the ZODB. These openoffice filess will be changed often and may be large. I think that ZODB keeps all old copies of a file each time it changes. Changing large openoffice documents all the time would make the ZODB huge, right? Can I make ZODB only store the most recent version of these files, instead of keeping a history of all the versions? I have also looked into using LocalFS and storing them on my file system. Is that the best way to go? OpenOffice has history and versioning built in so I won't be getting any benefit from keeping a history of old versions, just wasting disk space. Can I set ZODB to only keep the last 3 versions of a file and erase older versions all together? Is there any good ZODB documentation you can point me to? I've picked up things here and there from the Zope Book but I'm still don't know much about ZODB. Also, as for LocalFS I could hardly find anything. From the Zope site I couldn't even tell which version of LocalFS to use with Zope-2.7.0, let alone how to use it. Thanks, -- Ryan Boder http://www.bitwiser.org/icanoop
Ryan Boder wrote at 2004-4-4 03:11 -0400:
... These openoffice filess will be changed often and may be large. I think that ZODB keeps all old copies of a file each time it changes. Changing large openoffice documents all the time would make the ZODB huge, right? Can I make ZODB only store the most recent version of these files, instead of keeping a history of all the versions?
No, but you can frequently (e.g. daily) pack the ZODB storage. Packing means to discard non current versions older than a specified date. -- Dieter
Ryan Boder wrote:
These openoffice filess will be changed often and may be large. I think that ZODB keeps all old copies of a file each time it changes. Changing large openoffice documents all the time would make the ZODB huge, right?
Maybe, but pack often, and use BTreeFolder2's instead of Normal Folders. This works for me, as well as storing that BTreeFolder2 in a seperate FileStorage. That means I can pack that one often, while not loosing my code history...
I have also looked into using LocalFS and storing them on my file system. Is that the best way to go?
Maybe, it's certainly a possibility...
Can I set ZODB to only keep the last 3 versions of a file and erase older versions all together?
not exactly, you can pack to the last day, or hour, or something like that...
Also, as for LocalFS I could hardly find anything.
It's not very maintained, but does seem to be pretty stable... cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk
Ryan Boder wrote:
These openoffice filess will be changed often and may be large. I think that ZODB keeps all old copies of a file each time it changes. Changing large openoffice documents all the time would make the ZODB huge, right? Can I make ZODB only store the most recent version of these files, instead of keeping a history of all the versions?
I have also looked into using LocalFS and storing them on my file system. Is that the best way to go?
I would try Ape. Ape stores Zope objects either on the filesystem or in a SQL database. http://hathaway.freezope.org/Software/Ape/ Shane
Ryan Boder wrote:
From the Zope site I couldn't even tell which version of LocalFS to use with Zope-2.7.0
Hi Ryan, Please have a look at LocalFS-LocalFS-1.2-andreas.tar.gz at: http://www.easyleading.org/Downloads/ This version includes some bug fixes to work well with Zope2.7 Regards Andreas Heckel
On Tue, Apr 06, 2004 at 07:16:39PM +0200, Andreas Heckel wrote:
Ryan Boder wrote:
From the Zope site I couldn't even tell which version of LocalFS to use with Zope-2.7.0
Hi Ryan,
Please have a look at LocalFS-LocalFS-1.2-andreas.tar.gz at:
Forbidden You don't have permission to access /Downloads/ on this server. -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's MUSICIAN FANG! (random hero from isometric.spaceninja.com)
On Tue, Apr 06, 2004 at 07:16:39PM +0200, Andreas Heckel wrote:
Ryan Boder wrote:
From the Zope site I couldn't even tell which version of LocalFS to use with Zope-2.7.0
Hi Ryan,
Please have a look at LocalFS-LocalFS-1.2-andreas.tar.gz at:
I have not been able to get in there, apache is giving Forbidden. But I'm curious whether your version exhibits the same horrible behavior I've just observed with LocalFS 1.1 (tarball from sourceforge): with File objects at least, and maybe others, the ZODB grows by approximately the size of the object for *every download*. I noticed this because I ran ab on a test file in a localfs instance and my Data.fs promptly grew by a gigabyte! 8-0 I don't know what causes this yet. I never observed anything like it with LocalFS 1.0 on Zope 2.5* or 2.6.*. -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's THE DEBUT ALBUM! (random hero from isometric.spaceninja.com)
On Wed, Apr 07, 2004 at 01:50:28AM -0400, Paul Winkler wrote: (snip)
horrible behavior I've just observed with LocalFS 1.1 (tarball from sourceforge): with File objects at least, and maybe others, the ZODB grows by approximately the size of the object for *every download*.
Confirmed: LocalFS 1.0.0 does not have the bloating-ZODB behavior. LocalFS 1.1.0 does have it, on both zope 2.7.0 and 2.6.2. Do not use LocalFS 1.1.0! -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's YELLOW FOOT GIRL! (random hero from isometric.spaceninja.com)
participants (6)
-
Andreas Heckel -
Chris Withers -
Dieter Maurer -
Paul Winkler -
Ryan Boder -
Shane Hathaway