CorruptedDataError! Please help asap
Hello, This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder: * Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ????????????????????? I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)." fsrecover ??? Can someone please help me here ?? Please CC me on any responds as I'm having problems receiving the Zope mailing lists at the moment Greetings, Gitte Wange
Hello again, On Tue, 09 Sep 2003 07:42:38 +0200, Gitte Wange wrote:
Hello,
This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder:
* Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ?????????????????????
I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)."
fsrecover ???
I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ??? -- Gitte Wange Technical Manager Email: gitte@mmmanager.org Web: http://www.mmmanager.org Tlf: +45 36 46 20 02 After 1.5 years of Python, I'm still discovering richness (and still unable to understand what the hell Jim Fulton is talking about). -- Gordon McMillan, 13 Mar 1998
Gitte, If you can establish when the corruption occurred you can simply truncate Data.fs to that point. That will recover an uncorrupted version of your portal, but you'll have elided all transactions following. The length field of fsrecover is useful for this. HTH. -dr On Tue, 9 Sep 2003, Gitte Wange wrote:
Hello again,
On Tue, 09 Sep 2003 07:42:38 +0200, Gitte Wange wrote:
Hello,
This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder:
* Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ?????????????????????
I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)."
fsrecover ???
I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ???
-- Gitte Wange Technical Manager
Email: gitte@mmmanager.org Web: http://www.mmmanager.org Tlf: +45 36 46 20 02
After 1.5 years of Python, I'm still discovering richness (and still unable to understand what the hell Jim Fulton is talking about).
-- Gordon McMillan, 13 Mar 1998
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Hello again, On Tue, 09 Sep 2003 07:42:38 +0200, Gitte Wange wrote:
Hello,
This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder:
* Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ?????????????????????
I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)."
fsrecover ???
I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ??? -- Gitte Wange Technical Manager Email: gitte@mmmanager.org Web: http://www.mmmanager.org Tlf: +45 36 46 20 02 it ocurred to me: if the choice is "them hurting their own feet" versus "them hurting my nose" the choice is quite clear -- tomas@fabula.de:, on whether to move his co-workers from DTML to ZPT..
Hi Gitte, Gitte Wange wrote:
Hello again,
On Tue, 09 Sep 2003 07:42:38 +0200, Gitte Wange wrote:
Hello,
This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder:
* Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ?????????????????????
I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)."
fsrecover ???
I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ???
I see 2 posibilities: 1) restore your most current backup (preferred) 2) export/import your objects tree-wise. HTH Tino Wildenhain
On Tue, 09 Sep 2003 12:19:50 +0200, Tino Wildenhain wrote:
Hi Gitte,
Gitte Wange wrote:
Hello again,
On Tue, 09 Sep 2003 07:42:38 +0200, Gitte Wange wrote:
Hello,
This morning I woke to an email from a customer, saying he got this error everytime he went to a specifik folder:
* Module Products.PageTemplates.ZRPythonExpr, line 48, in __call__ * __traceback_info__: here.listFolderContents() * Module Python expression "here.listFolderContents()", line 2, in f * Module Products.CMFCore.PortalFolder, line 230, in listFolderContents * Module Products.CMFCore.PortalFolder, line 221, in contentValues * Module Products.CMFCore.PortalFolder, line 194, in _filteredItems * Module Products.CMFCore.PortalFolder, line 591, in __call__ * Module Products.CMFCore.PortalFolder, line 572, in <lambda> * Module ZODB.Connection, line 509, in setstate * Module ZODB.FileStorage, line 650, in load * Module ZODB.FileStorage, line 630, in _load CorruptedDataError: ?????????????????????
I have looked at the archives and saw something that Dieter Maurer wrote about: " Looks like a case for "fsrecover" (make a backup copy of your "Data.fs"!)."
fsrecover ???
I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ???
I see 2 posibilities:
1) restore your most current backup (preferred)
I'm working on that :-) I just contacted the customer and asked for the nightly backup. The have some sort of network system that logs in to the machine and fetch all data. An interesting thing in this context is, that the backup is from 02:24 (local time) and the they discovered the problem 02:37. Maybe Zope doesn't like their backup system ??
2) export/import your objects tree-wise.
What do you mean ? export/import all the objects I can get access without errors ? The problem is that all there newest content is inside the folder where the corrupted object also is so I cannot access the folder at all :-( Does objectsIds() load all the objects ? Maybe I can create some script that lists the ids of the objects in the folder and access them manually and find the corrupted object that way .... -- Gitte Wange Technical Manager Email: gitte@mmmanager.org Web: http://www.mmmanager.org Tlf: +45 36 46 20 02 Old Zopistas never die, they just lose their Persistence Wrappers. -- The Jester: ZopeLabs.
Gitte Wange wrote:
An interesting thing in this context is, that the backup is from 02:24 (local time) and the they discovered the problem 02:37. Maybe Zope doesn't like their backup system ??
This is a possibility. Have they run a backup on this data before and had no problems? You may also wish to try on the zodb-dev@zope.org list, some of the people there may be interested in analysing your corrupt Data.fs to see what happened. Please keep a copy of the whole 'var' directory somewhere so people can help find out what happened so it doesn't happen again in the future :-) cheers, Chris
Gitte Wange wrote at 2003-9-9 09:30 +0200:
... I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ???
The "fsrecover" of Zope 2.6.1 was broken. Use that of Zope 2.5.1 or of Zope 2.6.2 (any beta). It is easiest to fetch it from the Zope CVS. Dieter
On Tue, 9 Sep 2003 23:17:57 +0200, Dieter Maurer <dieter@handshake.de> wrote:
Gitte Wange wrote at 2003-9-9 09:30 +0200:
... I have tried running fsrecover on the corrupted Data.fs now - and it skipped everything saying it was corrupted ? Now I can enter the portal and browse everything except the folder containing the corrupted portal - then everything in the Data.fs file can't be corrupted ???
The "fsrecover" of Zope 2.6.1 was broken.
Use that of Zope 2.5.1 or of Zope 2.6.2 (any beta).
It is easiest to fetch it from the Zope CVS.
Arh thanks :-) I just saw the release notes for Zope 2.6.2 Yes I will upgrade the customer instance for this - but it must wait untill they are no longer using the system. I actually "solved" the problem ... They have this backup system running every day at 3 am They have never used there system at night, so when they worked in the system monday night, it crashed when the backup was running ! I don't know what kind up backup system they use - but it does weird things to Zope ... I just got the backup up and running and imported the content they had created after the portal crashed. Greetings, Gitte Wange
I don't know what kind up backup system they use - but it does weird things to Zope ...
So you're in a position where you have to support their Zope install and their backup possibly corrupts it? That's a very bad position to be in. You might be paying the price for someone's incompetence on their side... jens
participants (6)
-
Chris Withers -
Dennis Allison -
Dieter Maurer -
Gitte Wange -
Jens Vagelpohl -
Tino Wildenhain