[Zope-dev] experiments & bugs with data.fs >2GB
Chris McDonough
chrism@digicool.com
Tue, 3 Jul 2001 07:34:34 -0400
Hmm. I'm pretty sure that we thought we fixed the problems you're seeing.
;-) It seems like a 32 bit integer counter is overflowing. If you have the
time, you could help us by doing two things:
1. Trying the same thing with 2.4.0b2 and reporting the results
2. Reporting this to the collector
(or either).
Many thanks,
- C
----- Original Message -----
From: "marc lindahl" <marc@bowery.com>
To: <zope-dev@zope.org>
Sent: Tuesday, July 03, 2001 12:22 AM
Subject: [Zope-dev] experiments & bugs with data.fs >2GB
> I've recently been testing a new setup with XFS
> (http://oss.sgi.com/projects/xfs/1.0_release.html) and decided to try to
> bloat data.fs before using this system for production. The computer is
set
> up with zope 2.3.3 installed from source (the old fashioned way, with
> everything in one directory), with a separate 18GB disk as
/usr/local/zope.
>
> I uploaded a couple of files -- seawolf disk one ISO image (about 650MB)
and
> SGI's XFS install ISO (about 300MB). Both from another computer via ZMI
via
> a 10 baseT network. (interestingly both loaded up OK, but the seawolf
image
> gave a client side 'page failed to load' error, while the other worked
fine.
> So I suppose 600MB is the hairy edge of filesize you can upload via ZMI)
>
> Then proceeded to copy the two files and paste. First time worked fine,
> pushing data.fs to about 1.9GB. Second time, I copied all 4, which should
> push data.fs to about 4GB. It seemed to reach about 2.29GB (perhaps
copying
> the first XFS ISO image), then gave this error:
>
> --------------------------
> Zope Error
>
> Zope has encountered an error while publishing this
resource.
>
> Error Type: OverflowError
> Error Value: long int too long to convert
>
>
>
> Troubleshooting Suggestions
>
> The URL may be incorrect.
> The parameters passed to this resource may be
> incorrect.
> A resource that this resource relies on may be
> encountering an error.
>
> For more detailed information about the error, please refer
> to the HTML source for this page.
>
> If the error persists please contact the site maintainer.
> Thank you for your patience.
>
>
>
>
> Traceback (innermost last):
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 223, in publish_module
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 187, in publish
> File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221,
in
> zpublisher_exception_hook
> (Object: Traversable)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 171, in publish
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line
160,
> in mapply
> (Object: manage_pasteObjects)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 112, in call_object
> (Object: manage_pasteObjects)
> File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 229,
> in manage_pasteObjects
> (Object: Traversable)
> File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 469,
> in _getCopy
> (Object: copy_of_RH7.1-SGI-XFS-1.0.iso)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/ExportImport.py, line
218,
> in importFile
> File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line
745,
> in tpc_vote
> (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs)
> OverflowError: (see above)
>
> --------------------------
>
> Lines 744 and 745 are:
>
> pos=self._pos
> file.seek(pos)
>
> it looks like file.seek doesn't like the long int?
>
> Also, when going to the UNDO tab get this error:
>
> -----------------------
>
> Zope Error
>
> Zope has encountered an error while publishing this
resource.
>
> Error Type: OverflowError
> Error Value: long int too long to convert
>
>
>
> Troubleshooting Suggestions
>
> The URL may be incorrect.
> The parameters passed to this resource may be
> incorrect.
> A resource that this resource relies on may be
> encountering an error.
>
> For more detailed information about the error, please refer
> to the HTML source for this page.
>
> If the error persists please contact the site maintainer.
> Thank you for your patience.
>
>
>
>
> Traceback (innermost last):
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 223, in publish_module
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 187, in publish
> File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221,
in
> zpublisher_exception_hook
> (Object: Traversable)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 171, in publish
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line
160,
> in mapply
> (Object: manage_UndoForm)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line
> 112, in call_object
> (Object: manage_UndoForm)
> File
/usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py,
> line 324, in __call__
> (Object: manage_UndoForm)
> File
/usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py,
> line 354, in _bindAndExec
> (Object: manage_UndoForm)
> File /usr/local/zope/Zope-2.3.3/lib/python/App/special_dtml.py, line
236,
> in _exec
> (Object: manage_UndoForm)
> File /usr/local/zope/Zope-2.3.3/lib/python/App/Undo.py, line 164, in
> undoable_transactions
> (Object: Traversable)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/UndoLogCompatible.py,
line
> 100, in undoInfo
> (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs)
> File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line
868,
> in undoLog
> (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs)
> OverflowError: (see above)
>
>
> -------------------------
>
> seems like the same thing:
>
> seek(pos-8)
>
>
> I found one reference to large file support in Python:
>
> http://www.python.org/doc/current/lib/posix-large-files.html
>
> Could it be just that the default install script in the release needs to
> enable large file support? Or....???
>
>
>
>
> _______________________________________________
> Zope-Dev maillist - Zope-Dev@zope.org
> http://lists.zope.org/mailman/listinfo/zope-dev
> ** No cross posts or HTML encoding! **
> (Related lists -
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope )
>