OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-) If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ? Thanks ! Andrei Cenja, Bucharest, Romania.
Your advisor was right, most Linuxen sufer from a 2Gb file size limit. One way to overcome this is to use mountable storages, which you can mount from different partitions on you linux box. Search the dev list for comments on mountable storages. hth Phil ----- Original Message ----- From: "Andrei Cenja" <cnj@finsiel.ro> To: <zope@zope.org> Sent: Tuesday, March 20, 2001 8:29 AM Subject: [Zope] Large File Support ?!
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Phil Harris wrote:
Your advisor was right, most Linuxen sufer from a 2Gb file size limit.
One way to overcome this is to use mountable storages, which you can mount from different partitions on you linux box.
Search the dev list for comments on mountable storages.
Also look for Shane's Partitioned File Storage, which is an easier to use solution to the problem :-) cheers, Chris
[Phil Harris] | One way Another way could be to install ReiserFS, for example, which doesn't have the 2GB limit.
On 20 Mar 2001, Erik Enge wrote:
Another way could be to install ReiserFS, for example, which doesn't have the 2GB limit.
Don't forget to recompile Python to use long offsets! Oleg. ---- Oleg Broytmann http://www.zope.org/Members/phd/ phd@phd.pp.ru Programmers don't die, they just GOSUB without RETURN.
But let's face it, the FileStorage ZODB was never intended as a high performance storage medium. It is an excellent python object store. If you are going to be uploading really large files, you will be much better off storing them in the local filesystem as independant objects (assuming that the files themselves are static), and putting references to them in the ZODB. There are a number of Products available from the zope.org site that allow you to do just that. Check out http://www.zope.org/Members/MacGregor/ExtFile and http://www.zope.org/Members/jfarr/Products/LocalFS which were the first two that I found. --sam -- ----------------------------------------------- "The language and concepts contained herein are guaranteed not to cause eternal torment in the place where the guy with the horns and pointed stick conducts his business." --Frank Zappa
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions. Bye, A.R.KARTHICK (A.R.K)
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions. Bye, A.R.KARTHICK (A.R.K)
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions. Bye, A.R.KARTHICK (A.R.K)
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions. Bye, A.R.KARTHICK (A.R.K)
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Hi All, How do I prevent a page from being loaded from the cache. I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded Mohan.
Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
Mohan.
<dtml-call expr="RESPONSE.setHeader('pragma', 'no-cache')"> <dtml-call expr="RESPONSE.setHeader('expires', '0')"> should do it. -- | Casey Duncan | Kaivo, Inc. | cduncan@kaivo.com `------------------>
Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')"> There might be a simpler syntax but I know this works everywhere. (The header name might be "Expiration", though.) Shane
Maybe I am asking the wrong question. How do I get Zope to reload a page from the server when the user hits the BACK button of the browser. I tried <dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')"> and <dtml-call expr="RESPONSE.setHeader('pragma', 'no-cache')"> <dtml-call expr="RESPONSE.setHeader('expires', '0')"> They are not working. Mohan. -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org]On Behalf Of Shane Hathaway Sent: Tuesday, March 20, 2001 11:22 AM To: zope@zope.org Subject: Re: [Zope] Prevent cache from being loaded in Zope/DTML Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')"> There might be a simpler syntax but I know this works everywhere. (The header name might be "Expiration", though.) Shane _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Mohan Baro wrote:
Maybe I am asking the wrong question.
How do I get Zope to reload a page from the server when the user hits the BACK button of the browser.
I tried
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')">
and
<dtml-call expr="RESPONSE.setHeader('pragma', 'no-cache')"> <dtml-call expr="RESPONSE.setHeader('expires', '0')">
They are not working.
Mohan.
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org]On Behalf Of Shane Hathaway Sent: Tuesday, March 20, 2001 11:22 AM To: zope@zope.org Subject: Re: [Zope] Prevent cache from being loaded in Zope/DTML
Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')">
There might be a simpler syntax but I know this works everywhere. (The header name might be "Expiration", though.)
Shane
You might try loosing the expired header. Many browsers won't reload on back with this set, they just display an "page expired" message. Also you could add this to the <head> element of your document: <META HTTP-EQUIV="pragma" CONTENT="no-cache"> -- | Casey Duncan | Kaivo, Inc. | cduncan@kaivo.com `------------------>
Mohan Baro wrote:
Maybe I am asking the wrong question.
How do I get Zope to reload a page from the server when the user hits the BACK button of the browser.
Depending on the bowser, you can't. The back button will frequently redraw what used to be there, regardless of its cachability. The only thing you really have control over is the reload button. If it is cacheable, reload might get it out of cache. If it is not, reload is guaranteed to go to the origin server (usually ;-( ) --sam
I tried
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')">
and
<dtml-call expr="RESPONSE.setHeader('pragma', 'no-cache')"> <dtml-call expr="RESPONSE.setHeader('expires', '0')">
They are not working.
Mohan.
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org]On Behalf Of Shane Hathaway Sent: Tuesday, March 20, 2001 11:22 AM To: zope@zope.org Subject: Re: [Zope] Prevent cache from being loaded in Zope/DTML
Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
<dtml-call expr="RESPONSE.setHeader('Expires', 'Tue, 1 Jan 1980 12:00:00 GMT')">
There might be a simpler syntax but I know this works everywhere. (The header name might be "Expiration", though.)
Shane
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- ---------------------------------------------------- "Some Scientists claim that hydrogen, because it is so plentiful, is the basic building block of the universe. I dispute that. I say there is more stupidity than hydrogen, and that is the basic building block of the universe. --Frank Zappa
Not all caches will respect the Expires: 0 form of the header. You should also add pragma: no-cache, which will hit all of the older browsers. --sam Mohan Baro wrote:
Hi All,
How do I prevent a page from being loaded from the cache.
I want the following eqiv. in zope/dtml <% Response.Expires = 0 %> 'prevent cache from being loaded
Mohan.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- ----------------------------------------------------- Natives who beat drums to drive off evil spirits are objects of scorn to smart Americans who blow horns to break up traffic jams. -- Mary Ellen Kelly
On 20 Mar 2001 14:04:25 +0100, karthick ramanarayanan wrote:
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions.
That would be an incorrect presumption, IIRC.IIRC, ulimit only reports that which the sysadmin has limited you to. To get LFS, you need amodified kernel (or 2.4.x). For RHL7.x, you want the 'enterpise' kernel rpm installed, and then, of course, to boot said kernel. The other route is, of course, upgrade to 2.4.x (where x >=2, IMO), or get the LFS patch, apply, and build. Bill
Does this mean that there is not a 2gig limit on windows98/NT etc? -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org]On Behalf Of Bill Anderson Sent: 20 March 2001 16:36 To: zope@zope.org Subject: Re: [Zope] Large File Support ?! On 20 Mar 2001 14:04:25 +0100, karthick ramanarayanan wrote:
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions.
That would be an incorrect presumption, IIRC.IIRC, ulimit only reports that which the sysadmin has limited you to. To get LFS, you need amodified kernel (or 2.4.x). For RHL7.x, you want the 'enterpise' kernel rpm installed, and then, of course, to boot said kernel. The other route is, of course, upgrade to 2.4.x (where x >=2, IMO), or get the LFS patch, apply, and build. Bill _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Hi, First,the 2 Gig Limit is a problem with 32 bit systems because of the signed int offset,which gives you an upper limit of 2^31 -1 bytes. But,you can check if your system supports higher file sizes. For example,a 'ulimit -f` on my RHL 6.2,printed 'unlimited'. I presume I should be able to create 2 GIG files and access them successfully.Anyway you can also alternatively check the /etc/login.defs file for any ULIMIT Definitions. Bye, A.R.KARTHICK (A.R.K)
OK, I'm sorry if this question is gonna prompt bursts of laughter, but here it goes :-)
If I intend to store many files (and large ones, too) into Zope (on RHL7, BTW) - something close to a few GBs, it would mean that Zope's database will get to be one several-gigs-large file. Someone warned me of possible problems if using very large files under linux. The question is: was he right ? How does Zope cope with that ?
Thanks !
Andrei Cenja, Bucharest, Romania.
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
participants (12)
-
Andrei Cenja -
Bill Anderson -
Casey Duncan -
Chris Withers -
David Kyte -
Erik Enge -
karthick ramanarayanan -
Mohan Baro -
Oleg Broytmann -
Phil Harris -
sam gendler -
Shane Hathaway