I'm currently trying to work out an effective backup solution for my zope servers. My current system involves shutting down the server, copying the zodb, and then starting the server again. This works, but leaves the site down for several minutes. Is it possible to do the equivilant of a sync and remount read-only? Or is it safe to just copy the ZODB from a live site? I'd also like to hear ideas on how others have setup their backup systems. exporting is not an option as my plone sites do not always correctly reimport. -James Davies (jamesd@mena.org.au)
This is an FAQ. It is safe to backup the Data.fs without shutting down the instance. Search the mailing list archives for details. -aj --On Montag, 2. Juni 2003 13:01 Uhr +1000 jamesd@mena.org.au wrote:
I'm currently trying to work out an effective backup solution for my zope servers. My current system involves shutting down the server, copying the zodb, and then starting the server again. This works, but leaves the site down for several minutes.
Is it possible to do the equivilant of a sync and remount read-only? Or is it safe to just copy the ZODB from a live site?
I'd also like to hear ideas on how others have setup their backup systems. exporting is not an option as my plone sites do not always correctly reimport. -James Davies (jamesd@mena.org.au)
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
On Monday 02 June 2003 05:38, Andreas Jung wrote:
This is an FAQ.
yes
It is safe to backup the Data.fs without shutting down the instance.
But thats not the whole answer.... You need to be sure that your backup process reads the whole file once from start to end (most do, but rsync is one notable exception). If you are not sure, this thread may be useful http://mail.zope.org/pipermail/zodb-dev/2002-October/003418.html You also need to be sure that your application does not use non-transactional undo. By default, zope uses transactional undo which is not a problem
Search the mailing list archives for details.
as always. -- Toby Dickenson http://www.geminidataloggers.com/people/tdickenson
--On Montag, 2. Juni 2003 8:49 Uhr +0100 Toby Dickenson <tdickenson@geminidataloggers.com> wrote:
On Monday 02 June 2003 05:38, Andreas Jung wrote:
This is an FAQ.
yes
It is safe to backup the Data.fs without shutting down the instance.
But thats not the whole answer.... You need to be sure that your backup process reads the whole file once from start to end (most do, but rsync is one notable exception). If you are not sure, this thread may be useful http://mail.zope.org/pipermail/zodb-dev/2002-October/003418.html
You also need to be sure that your application does not use non-transactional undo. By default, zope uses transactional undo which is not a problem
Search the mailing list archives for details.
as always.
It would be nice to have an up2date FAQ for Zope (maybe Zopelabs is right place for questions etc.) For the German speaking Zopers we have a growing FAQ area on dzug.org. -aj
in the upcoming 2.6 edition of the zope book i (hopefully) covered this (http://www.zope.org/Documentation/Books/ZopeBook/2_6Edition/MaintainingZope....). unfortunately the 2.6 edition is still not marked "official". - peter. Andreas Jung wrote:
--On Montag, 2. Juni 2003 8:49 Uhr +0100 Toby Dickenson <tdickenson@geminidataloggers.com> wrote:
On Monday 02 June 2003 05:38, Andreas Jung wrote:
This is an FAQ.
yes
It is safe to backup the Data.fs without shutting down the instance.
But thats not the whole answer.... You need to be sure that your backup process reads the whole file once from start to end (most do, but rsync is one notable exception). If you are not sure, this thread may be useful http://mail.zope.org/pipermail/zodb-dev/2002-October/003418.html
You also need to be sure that your application does not use non-transactional undo. By default, zope uses transactional undo which is not a problem
Search the mailing list archives for details.
as always.
It would be nice to have an up2date FAQ for Zope (maybe Zopelabs is right place for questions etc.) For the German speaking Zopers we have a growing FAQ area on dzug.org.
-aj
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
On Monday 02 June 2003 10:18, Peter Sabaini wrote:
in the upcoming 2.6 edition of the zope book i (hopefully) covered this (http://www.zope.org/Documentation/Books/ZopeBook/2_6Edition/MaintainingZop e.stx).
That /etc/cron.daily/zbackup.cron script is dangerous in several ways. Think of backup as a database operation - this script has no ACID. rsync doesnt even give any performance advantage here. rsync is good if you are doing backups remotely over ssh, but for local backups (like this script) it cant beat "cp". I strongly recommend DirectoryStorage if you want to keep daily backups like this. It has a standard tool for creating local incremental backups as tar files, or synchronising a remote replica of the storage. These tools are ACID, and efficient. Unlike all the home-brew FileStorage schemes I have seen. -- Toby Dickenson http://www.geminidataloggers.com/people/tdickenson
Toby Dickenson wrote:
On Monday 02 June 2003 10:18, Peter Sabaini wrote:
in the upcoming 2.6 edition of the zope book i (hopefully) covered this (http://www.zope.org/Documentation/Books/ZopeBook/2_6Edition/MaintainingZop e.stx).
That /etc/cron.daily/zbackup.cron script is dangerous in several ways. Think of backup as a database operation - this script has no ACID.
please explain -- why would i need transactions and concurrency with a backup script?
rsync doesnt even give any performance advantage here. rsync is good if you are doing backups remotely over ssh, but for local backups (like this script) it cant beat "cp".
not that i have any numbers to back this up but i think that just copying the difference of two similar Data.fs's can be advantageous with large files -- of course this will really only make a difference if the backup is to a network mount or something like that.
I strongly recommend DirectoryStorage if you want to keep daily backups like this. It has a standard tool for creating local incremental backups as tar files, or synchronising a remote replica of the storage. These tools are ACID, and efficient. Unlike all the home-brew FileStorage schemes I have seen.
DirectoryStorage sounds great if you have the requirements, but for simpler sites (or sites which host their data in an RDBMS anyway) FileStorage is just ok. - peter.
On Monday 02 June 2003 06:02 pm, Andreas Jung wrote:
--On Montag, 2. Juni 2003 8:49 Uhr +0100 Toby Dickenson <tdickenson@geminidataloggers.com> wrote:
On Monday 02 June 2003 05:38, Andreas Jung wrote:
This is an FAQ.
yes
[snip]
Search the mailing list archives for details.
as always.
It would be nice to have an up2date FAQ for Zope (maybe Zopelabs is right place for questions etc.) For the German speaking Zopers we have a growing FAQ area on dzug.org.
It would be even nicer for the Zope Administrators Guide project to be rejuvenated ;) Richard
On Tue, 2003-06-03 at 07:55, Richard Jones wrote:
It would be nice to have an up2date FAQ for Zope (maybe Zopelabs is right place for questions etc.) For the German speaking Zopers we have a growing FAQ area on dzug.org.
It would be even nicer for the Zope Administrators Guide project to be rejuvenated ;)
It has been, in some sense, within the "Maintaining Zope" chapter of the 2.6 edition Zope Book. - C
participants (6)
-
Andreas Jung -
Chris McDonough -
jamesd＠mena.org.au -
Peter Sabaini -
Richard Jones -
Toby Dickenson