RE: [Zope] How many objects can ZODB hold?
Does anyone know how to build python 1.5.2 with the linux 2.4 kernel for large file support? And if anything else would need to be done to support a FileStorage of > 2GB? Thanks, -Randy
-----Original Message----- From: Shane Hathaway [mailto:shane@digicool.com] Sent: Thursday, February 15, 2001 12:18 PM To: sbabu@tnc.org Cc: zope@zope.org Subject: Re: [Zope] How many objects can ZODB hold?
sbabu@tnc.org wrote:
Probably a dumb question: I know ZODB stores everything in an Object table. So, this table probably has a fixed length primary key. To maintain this, let us say there should be a counter which tracks the number of records in the table.
The question is, is there any limit to this? Like Zope can hold 1million objects?
First, the theoretical limitations: Currently an OID for FileStorage is 64 bits. You might have a problem if you could create 1 billion objects per second continuously over 544 years. But FileStorage is not the only way to store objects. Using existing alternate storage implementations, you can use Oracle or even create one file per object.
Now the practical limitations: some operating systems, like Linux 2.2.x, are limited to 2 GB files. FileStorage has run into this. But the Linux kernel version 2.4.x has lifted this limitation. But it probably isn't wise to rely on FileStorage for many GB of data. You'd want to use OracleStorage or the developing BerkeleyStorage.
Shane
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
"Randall F. Kern" wrote:
Does anyone know how to build python 1.5.2 with the linux 2.4 kernel for large file support? And if anything else would need to be done to support a FileStorage of > 2GB?
I don't think you have to do anything at all to Python. I have my old python 1.5.2 that came with RedHat 7.0, and I've recently updated to kernel 2.4.1 and python still runs fine. I don't think python knows anything about the underlying system's limits on file sizes. However, I'm very low on disk space currently so I can't test this. ;-) -- ................. paul winkler .................. slinkP arts: music, sound, illustration, design, etc. web page: http://www.slinkp.com A member of ARMS: http://www.reacharms.com
You might find using multiple ZODB's and ZEO is much more feasible option than worrying about huge file sizes. There are also Mounted databases and Shane had a patch for running several large ZODB's, have a rummage through the mail archive. -- Andy McKay. ----- Original Message ----- From: "Paul Winkler" <slinkp23@yahoo.com> To: <zope@zope.org> Sent: Thursday, February 15, 2001 12:52 PM Subject: Re: [Zope] How many objects can ZODB hold?
"Randall F. Kern" wrote:
Does anyone know how to build python 1.5.2 with the linux 2.4 kernel for large file support? And if anything else would need to be done to support a FileStorage of > 2GB?
I don't think you have to do anything at all to Python. I have my old python 1.5.2 that came with RedHat 7.0, and I've recently updated to kernel 2.4.1 and python still runs fine. I don't think python knows anything about the underlying system's limits on file sizes.
However, I'm very low on disk space currently so I can't test this. ;-)
-- ................. paul winkler .................. slinkP arts: music, sound, illustration, design, etc. web page: http://www.slinkp.com A member of ARMS: http://www.reacharms.com
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
participants (3)
-
Andy McKay -
Paul Winkler -
Randall F. Kern