Large File Support (LFS) in Zope
Hi, last December my Zope crashed because of the large file support or that's what I found searching on the lists. I got the message: Aiieee! 2365 exited with error code: 25 In my previous message: http://groups.yahoo.com/group/zope/message/105508 I was told to install a new version of linux and to compile python with large file support, thing that I did in my original installation: Suse 7.3, Zope 2.5.1 I didn't install Suse 8 because, as I read, 7.3 comes already with large file support. (Am I wrong?) Anyway, I just want to know how the people with large databases is handling this. (I mean without using LocalFS or similars) Thanks in advanced, Josef
--- In zope@yahoogroups.com, sean.upton@u... wrote:
One option, if you are using Linux and able to use ReiserFS is to consider switching to DirectoryStorage instead of using FileStorage. This should be fairly scalable, but is likely a Linux-only solution for now. I've already read about it and I think I won't use it because they say: "WARNING: do not use reiser4 for production system, do not keep any important data on reiser4. It is experimental yet."
Perhaps I will try XFS from SGI, which seems more stable.
http://dirstorage.sf.net Unless you have very, very big objects, the file-size issue becomes a non-issue with this approach, and you don't have to worry about large-file support at all the various layers. This will be my second alternative.
Another option is just to compile python from source with LFS yourself (search Google for this), and use that python binary to run Zope from source. As I said in my first message, I have already done it. I followed the gidelines given at: http://www.zope.org/Members/beacon/install_instructions but it didn't work
Yet a third option is to use Zope 2.6's binary install, which I believe has LFS support built-into its python. Soon or later I will have to update, but first I want to make sure that my system works under 2.5.1
For LFS to work, you need a relatively new C library and Linux 2.4 kernel (though 2.2 kernels work fine on 64 bit platforms). I have linux kernel v.2.4.18-3 and glibc v.2.2.5-34, so I guess it has LFS since it is supported from versions > 2.2
Thanks for your reply, Josef
On Tue, Jan 21, 2003 at 09:08:03AM +0100, Josef Meile wrote:
--- In zope@yahoogroups.com, sean.upton@u... wrote:
One option, if you are using Linux and able to use ReiserFS is to consider switching to DirectoryStorage instead of using FileStorage. This should be fairly scalable, but is likely a Linux-only solution for now. I've already read about it and I think I won't use it because they say: "WARNING: do not use reiser4 for production system, do not keep any important data on reiser4. It is experimental yet."
That's resierfs version 4 which adds radical new features. Version 3 is stable. -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's THE SWIRLY COBRA! (courtesy of isometric.spaceninja.com)
On Tue, 21 Jan 2003, Josef Meile wrote:
--- In zope@yahoogroups.com, sean.upton@u... wrote:
One option, if you are using Linux and able to use ReiserFS is to consider switching to DirectoryStorage instead of using FileStorage. This should be fairly scalable, but is likely a Linux-only solution for now. I've already read about it and I think I won't use it because they say: "WARNING: do not use reiser4 for production system, do not keep any important data on reiser4. It is experimental yet."
Umm reiserfs4 is not released yet. It is expected to be out June 30 so it is still in devel. Of course you should not use it yet. The current version of reiserfs is 3 and I have that on all of my systems and it works very nicely.
Josef Meile wrote:
Anyway, I just want to know how the people with large databases is handling this. (I mean without using LocalFS or similars)
Have a look at Toby Dickenson's DirectoryStorage, it might well solve your problems here :-) cheers, Chris
Josef Meile wrote at 2003-1-20 21:26 +0100:
last December my Zope crashed because of the large file support or that's what I found searching on the lists. I got the message:
Aiieee! 2365 exited with error code: 25 The "25" represents a signal number (which killed Zope).
Under my linux (SuSE 8.1; not recommended!), it is "SIGXFSZ". I do not know precisely, what it is for, but I expect it is signaled for a resource limit violation. Check the documentation... Dieter
participants (5)
-
Chris Withers -
Dieter Maurer -
Josef Meile -
kosh＠aesaeion.com -
Paul Winkler