- Corrupted data record errors?
Could someone please advise on what to do about corrupted data, and what might have caused it? Also, where is this "/home/brian/temp" stuff coming from? There's no such directory on my system. [zope@linux Zope-1.9.0-linux2-x86]$ python serve.py Traceback (innermost last): File "serve.py", line 104, in ? ZopeHTTPServer.main(args) File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/ZopeHTTPServer/ZopeHTTPS erver.py", line 527, in main File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/ZopeHTTPServer/ZopeHTTPS erver.py", line 467, in start File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/ZopeHTTPServer/ZopeHTTPS erver.py", line 463, in set_published_module File "/usr/local/Zope-1.9.0-linux2-x86/lib/python/Main.py", line 115, in ? Bobobase=OFS.Application.open_bobobase() File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/lib/python/OFS/Applicati on.py", line 310, in open_bobobase File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/lib/python/BoboPOS/Pickl eDictionary.py", line 166, in __init__ File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/lib/python/BoboPOS/Simpl eDB.py", line 218, in __init__ File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/lib/python/BoboPOS/Simpl eDB.py", line 271, in open File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/lib/python/BoboPOS/Simpl eDB.py", line 1332, in read_index DatabaseError: Corrupted data record at 521744 [zope@linux Zope-1.9.0-linux2-x86]$ ------------------------------------------------ Dr. Brad Cox; 703 361 4751; bcox@virtualschool.edu (update your address book) http://virtualschool.edu/mon A Project with Paradoxical Goals PGP Signature: E194 C6E5 92D8 B8FB 20E8 8667 929A 95A0 FCB6 7C62
On Mon, 4 Jan 1999, Brad Cox wrote:
Also, where is this "/home/brian/temp" stuff coming from? There's no such directory on my system. It's the directory where Zope was built. The same happens for example with Python RPMs which are built with a with BuildRoot, because the path is embedded in the .pyc/.pyo files is the real path at the time of the compilation.
[zope@linux Zope-1.9.0-linux2-x86]$ python serve.py Traceback (innermost last): File "serve.py", line 104, in ? ZopeHTTPServer.main(args) File "/home/brian/temp/build/tmp_build/Zope-1.9.0-linux2-x86/ZopeHTTPServer/ZopeHTTPS erver.py", line 527, in main
Andreas -- Win95: n., A huge annoying boot virus that causes random spontaneous system crashes, usually just before saving a massive project. Easily cured by UNIX. See also MS-DOS, IBM-DOS, DR-DOS, Win 3.x, Win98.
Brad Cox wrote:
Could someone please advise on what to do about corrupted data,
We need better tools for diagnosing and correcting this sort of thing. In the mean time, I'd like you to send me (or alternatively support@digicool.com) the corrupted data file and the traceback.
and what might have caused it?
This doesn't happen very often (at all, at least not for us). It usually happens when multiple processes open the file at the same time, which should generally be prevented by a file lock. It could conceavably happen if a process is killed in the process of writing a record. I'd like to see the corrupted file to better diagnose the cause and hopefully prevent it in the future.
Also, where is this "/home/brian/temp" stuff coming from? There's no such directory on my system.
This is an artifact of the way that the Python files were compiled. Error traceback show the location where the files were compiled, which is generally different from the run-time locations. Future binary releases will be made in such a way that relative (to the Zope installation directory) will be stored in the files and shown in tracebacks. Jim -- Jim Fulton mailto:jim@digicool.com Technical Director (888) 344-4332 Python Powered! Digital Creations http://www.digicool.com http://www.python.org Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.
Thanks, Jim. The traceback I sent earlier. I've attached the contents of the var directory; hope that's what you mean. At 11:48 AM -0500 01/04/1999, Jim Fulton wrote:
Brad Cox wrote:
Could someone please advise on what to do about corrupted data,
We need better tools for diagnosing and correcting this sort of thing. In the mean time, I'd like you to send me (or alternatively support@digicool.com) the corrupted data file and the traceback.
and what might have caused it?
This doesn't happen very often (at all, at least not for us).
It usually happens when multiple processes open the file at the same time, which should generally be prevented by a file lock. It could conceavably happen if a process is killed in the process of writing a record.
I'd like to see the corrupted file to better diagnose the cause and hopefully prevent it in the future.
Also, where is this "/home/brian/temp" stuff coming from? There's no such directory on my system.
This is an artifact of the way that the Python files were compiled. Error traceback show the location where the files were compiled, which is generally different from the run-time locations.
Future binary releases will be made in such a way that relative (to the Zope installation directory) will be stored in the files and shown in tracebacks.
Jim
-- Jim Fulton mailto:jim@digicool.com Technical Director (888) 344-4332 Python Powered! Digital Creations http://www.digicool.com http://www.python.org
Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.
------------------------------------------------ Dr. Brad Cox; 703 361 4751; bcox@virtualschool.edu (update your address book) http://virtualschool.edu/mon A Project with Paradoxical Goals PGP Signature: E194 C6E5 92D8 B8FB 20E8 8667 929A 95A0 FCB6 7C62
On Mon, 4 Jan 1999, Brad Cox wrote:
Thanks, Jim. The traceback I sent earlier. I've attached the contents of the var directory; hope that's what you mean. <sarcasm> I'm really happy, that you didn't have a 100MB var directory ;) </sarcasm>
Andreas -- Win95: n., A huge annoying boot virus that causes random spontaneous system crashes, usually just before saving a massive project. Easily cured by UNIX. See also MS-DOS, IBM-DOS, DR-DOS, Win 3.x, Win98.
At 12:05 PM -0500 01/04/1999, Brad Cox wrote:
Thanks, Jim. The traceback I sent earlier. I've attached the contents of the var directory; hope that's what you mean.
Yikes. Sorry about cluttering the list. Missed the cc to zope@zope.org. Thought I was sending only to jim. ------------------------------------------------ Dr. Brad Cox; 703 361 4751; bcox@virtualschool.edu (update your address book) http://virtualschool.edu/mon A Project with Paradoxical Goals PGP Signature: E194 C6E5 92D8 B8FB 20E8 8667 929A 95A0 FCB6 7C62
Brad Cox wrote:
Could someone please advise on what to do about corrupted data, and what might have caused it?
Looking at your file, it looks like the problem occurred during Zope startup. Did you have a problem starting Zope just prior to this? The record that contains product information for the MySQL DA was incompletely written at the end of the file. I wonder if a broken MySQL binary could have caused a memory corruption problem that caused the record to have been partially written or caused Zope to crash while writing the record. I have seen memory errors (e.g. bad pointers) cause file writes to fail without errors on Win32. I wonder if something similar happened here. I'm going to look into getting Zope to try to recognize final records that are partially written and ignoring them. The next generation of the database will do a much better job in cases like this. You can always try to repair an error like this by truncating the file at the position reported in the error message. (I do this in emacs, you could do this in a variety of other ways). This makes sense especially if the problem position is near the end of the file. I'll send you a repaired database file (Data.bbb) in a separate email. Jim -- Jim Fulton mailto:jim@digicool.com Technical Director (888) 344-4332 Python Powered! Digital Creations http://www.digicool.com http://www.python.org Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.
participants (3)
-
Andreas Kostyrka -
Brad Cox -
Jim Fulton