I've recently been testing a new setup with XFS (http://oss.sgi.com/projects/xfs/1.0_release.html) and decided to try to bloat data.fs before using this system for production. The computer is set up with zope 2.3.3 installed from source (the old fashioned way, with everything in one directory), with a separate 18GB disk as /usr/local/zope. I uploaded a couple of files -- seawolf disk one ISO image (about 650MB) and SGI's XFS install ISO (about 300MB). Both from another computer via ZMI via a 10 baseT network. (interestingly both loaded up OK, but the seawolf image gave a client side 'page failed to load' error, while the other worked fine. So I suppose 600MB is the hairy edge of filesize you can upload via ZMI) Then proceeded to copy the two files and paste. First time worked fine, pushing data.fs to about 1.9GB. Second time, I copied all 4, which should push data.fs to about 4GB. It seemed to reach about 2.29GB (perhaps copying the first XFS ISO image), then gave this error: -------------------------- Zope Error Zope has encountered an error while publishing this resource. Error Type: OverflowError Error Value: long int too long to convert Troubleshooting Suggestions The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error. For more detailed information about the error, please refer to the HTML source for this page. If the error persists please contact the site maintainer. Thank you for your patience. Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 229, in manage_pasteObjects (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 469, in _getCopy (Object: copy_of_RH7.1-SGI-XFS-1.0.iso) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/ExportImport.py, line 218, in importFile File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 745, in tpc_vote (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above) -------------------------- Lines 744 and 745 are: pos=self._pos file.seek(pos) it looks like file.seek doesn't like the long int? Also, when going to the UNDO tab get this error: ----------------------- Zope Error Zope has encountered an error while publishing this resource. Error Type: OverflowError Error Value: long int too long to convert Troubleshooting Suggestions The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error. For more detailed information about the error, please refer to the HTML source for this page. If the error persists please contact the site maintainer. Thank you for your patience. Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/special_dtml.py, line 236, in _exec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/Undo.py, line 164, in undoable_transactions (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/UndoLogCompatible.py, line 100, in undoInfo (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 868, in undoLog (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above) ------------------------- seems like the same thing: seek(pos-8) I found one reference to large file support in Python: http://www.python.org/doc/current/lib/posix-large-files.html Could it be just that the default install script in the release needs to enable large file support? Or....???
Hmm. I'm pretty sure that we thought we fixed the problems you're seeing. ;-) It seems like a 32 bit integer counter is overflowing. If you have the time, you could help us by doing two things: 1. Trying the same thing with 2.4.0b2 and reporting the results 2. Reporting this to the collector (or either). Many thanks, - C ----- Original Message ----- From: "marc lindahl" <marc@bowery.com> To: <zope-dev@zope.org> Sent: Tuesday, July 03, 2001 12:22 AM Subject: [Zope-dev] experiments & bugs with data.fs >2GB
I've recently been testing a new setup with XFS (http://oss.sgi.com/projects/xfs/1.0_release.html) and decided to try to bloat data.fs before using this system for production. The computer is set up with zope 2.3.3 installed from source (the old fashioned way, with everything in one directory), with a separate 18GB disk as /usr/local/zope.
I uploaded a couple of files -- seawolf disk one ISO image (about 650MB) and SGI's XFS install ISO (about 300MB). Both from another computer via ZMI via a 10 baseT network. (interestingly both loaded up OK, but the seawolf image gave a client side 'page failed to load' error, while the other worked fine. So I suppose 600MB is the hairy edge of filesize you can upload via ZMI)
Then proceeded to copy the two files and paste. First time worked fine, pushing data.fs to about 1.9GB. Second time, I copied all 4, which should push data.fs to about 4GB. It seemed to reach about 2.29GB (perhaps copying the first XFS ISO image), then gave this error:
-------------------------- Zope Error
Zope has encountered an error while publishing this resource.
Error Type: OverflowError Error Value: long int too long to convert
Troubleshooting Suggestions
The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error.
For more detailed information about the error, please refer to the HTML source for this page.
If the error persists please contact the site maintainer. Thank you for your patience.
Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 229, in manage_pasteObjects (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 469, in _getCopy (Object: copy_of_RH7.1-SGI-XFS-1.0.iso) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/ExportImport.py, line 218, in importFile File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 745, in tpc_vote (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above)
--------------------------
Lines 744 and 745 are:
pos=self._pos file.seek(pos)
it looks like file.seek doesn't like the long int?
Also, when going to the UNDO tab get this error:
-----------------------
Zope Error
Zope has encountered an error while publishing this resource.
Error Type: OverflowError Error Value: long int too long to convert
Troubleshooting Suggestions
The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error.
For more detailed information about the error, please refer to the HTML source for this page.
If the error persists please contact the site maintainer. Thank you for your patience.
Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/special_dtml.py, line 236, in _exec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/Undo.py, line 164, in undoable_transactions (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/UndoLogCompatible.py, line 100, in undoInfo (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 868, in undoLog (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above)
-------------------------
seems like the same thing:
seek(pos-8)
I found one reference to large file support in Python:
http://www.python.org/doc/current/lib/posix-large-files.html
Could it be just that the default install script in the release needs to enable large file support? Or....???
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Well, if we can figure out where the problem is, we sure can fix it on the 2.3 branch. Also, FWIW, CMF works with 2.4 (although it's not recommended, I'm using it just fine). - C ----- Original Message ----- From: "marc lindahl" <marc@bowery.com> To: "Chris McDonough" <chrism@digicool.com>; <zope-dev@zope.org> Sent: Tuesday, July 03, 2001 12:44 PM Subject: Re: [Zope-dev] experiments & bugs with data.fs >2GB
From: "Chris McDonough" <chrism@digicool.com>
1. Trying the same thing with 2.4.0b2 and reporting the results
Yikes... I need CMF! So far it's not recommended with 2.4! Are there plans to fix this in the 2.3 branch?
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
marc lindahl wrote:
From: "Chris McDonough" <chrism@digicool.com>
1. Trying the same thing with 2.4.0b2 and reporting the results
Yikes... I need CMF! So far it's not recommended with 2.4! Are there plans to fix this in the 2.3 branch?
Actually, it was only not recommended that you use Zope 2.4.0a1. The other Zope 2.4.x releases are good. (Some features were slipped in at the very last moment for 2.4.0a1 without adequate testing.) Shane
marc lindahl wrote:
I've recently been testing a new setup with XFS (http://oss.sgi.com/projects/xfs/1.0_release.html) and decided to try to bloat data.fs before using this system for production. The computer is set up with zope 2.3.3 installed from source (the old fashioned way, with everything in one directory), with a separate 18GB disk as /usr/local/zope.
I uploaded a couple of files -- seawolf disk one ISO image (about 650MB) and SGI's XFS install ISO (about 300MB). Both from another computer via ZMI via a 10 baseT network. (interestingly both loaded up OK, but the seawolf image gave a client side 'page failed to load' error, while the other worked fine. So I suppose 600MB is the hairy edge of filesize you can upload via ZMI)
Then proceeded to copy the two files and paste. First time worked fine, pushing data.fs to about 1.9GB. Second time, I copied all 4, which should push data.fs to about 4GB. It seemed to reach about 2.29GB (perhaps copying the first XFS ISO image), then gave this error:
-------------------------- Zope Error
Zope has encountered an error while publishing this resource.
Error Type: OverflowError Error Value: long int too long to convert
Troubleshooting Suggestions
The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error.
For more detailed information about the error, please refer to the HTML source for this page.
If the error persists please contact the site maintainer. Thank you for your patience.
Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_pasteObjects) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 229, in manage_pasteObjects (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/OFS/CopySupport.py, line 469, in _getCopy (Object: copy_of_RH7.1-SGI-XFS-1.0.iso) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/ExportImport.py, line 218, in importFile File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 745, in tpc_vote (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above)
--------------------------
Lines 744 and 745 are:
pos=self._pos file.seek(pos)
it looks like file.seek doesn't like the long int?
Also, when going to the UNDO tab get this error:
-----------------------
Zope Error
Zope has encountered an error while publishing this resource.
Error Type: OverflowError Error Value: long int too long to convert
Troubleshooting Suggestions
The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error.
For more detailed information about the error, please refer to the HTML source for this page.
If the error persists please contact the site maintainer. Thank you for your patience.
Traceback (innermost last): File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/zope/Zope-2.3.3/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/special_dtml.py, line 236, in _exec (Object: manage_UndoForm) File /usr/local/zope/Zope-2.3.3/lib/python/App/Undo.py, line 164, in undoable_transactions (Object: Traversable) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/UndoLogCompatible.py, line 100, in undoInfo (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 868, in undoLog (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above)
-------------------------
seems like the same thing:
seek(pos-8)
I found one reference to large file support in Python:
http://www.python.org/doc/current/lib/posix-large-files.html
Could it be just that the default install script in the release needs to enable large file support? Or....???
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[sorry for the first reply containing only the quote of marc's nail... Seems that I'm getting too tired...] marc lindahl wrote:
I've recently been testing a new setup with XFS (http://oss.sgi.com/projects/xfs/1.0_release.html) and decided to try to bloat data.fs before using this system for production. The computer is set up with zope 2.3.3 installed from source (the old fashioned way, with everything in one directory), with a separate 18GB disk as /usr/local/zope.
[...]
File /usr/local/zope/Zope-2.3.3/lib/python/ZODB/FileStorage.py, line 745, in tpc_vote (Object: /usr/local/zope/Zope-2.3.3/var/Data.fs) OverflowError: (see above)
--------------------------
Lines 744 and 745 are:
pos=self._pos file.seek(pos)
it looks like file.seek doesn't like the long int? [...] I found one reference to large file support in Python:
http://www.python.org/doc/current/lib/posix-large-files.html
Could it be just that the default install script in the release needs to enable large file support? Or....???
Hi, I had similar problems when I tried to install Python on a Linux box with large file support. I haven't yet time enough to test Zops with a data base > 2GB, but a tiny test program bailed out quite the same way. In my case, it turned out that it was not enough to set the environment variable CC, as described on the page on the Python site you mentioned. (to be precise, I used CFLAGS intead of CC as recommended in a comment in config.h) Eventually, the following worked for me: export CFLAGS="-DLARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64" ./configure - checked config.h: Does it contains the the lines "#define " "#define HAVE_FTELLO 1" (HAVE_FTELL64 instead of HAVE_FTELLO might work too) - add the following two lines at the top of config.h: #define LARGEFILE_SOURC #define _FILE_OFFSET_BITS=64 make && make install Without the additional #defines, the glibc header files seem to "forget" about large file support. HTH Abel
Anybody knows how to insert a string in the value of the property (type) lines, using an external method? I try in this way: def string(self): self.nameOfProperty="hello"..... But it doesn't work...
participants (5)
-
abel deuring -
Chris McDonough -
Edgardo Zulian -
marc lindahl -
Shane Hathaway