As Dieter says, dont even think of trying this in the ZODB. Use a relational database. -- Andy McKay. ----- Original Message ----- From: "Dieter Maurer" <dieter@handshake.de> To: "iap_y2fun.com" <iap@y2fun.com> Cc: <zope@zope.org> Sent: Tuesday, February 27, 2001 1:10 PM Subject: Re: [Zope] Can Zope handle this project?
iap_y2fun.com writes:
I was asked to propose a solution for a insurance company. This comany has: 20,000,000 records of insurance contracts, 7,000,000 records of accounts, 60,000 records of products, The storages required for the above records amount to 200GB. This system is built for the agents which amount to 25,000 persons. The estimated traffice is 100,000 page views/day. The Platform doubtless is Linux or *Unix. ***I would like to adapt zope to slove this problem. *** I has experienced ZEO to handle hige traffic site, but in this case it seems that the ZODB is the key dancer. My question are: A) If it is possible for a Data.fs grows up to 200GB? ( Mounted fs?) B) Can "BTree Folder" handle 20 million of objects in a single folder? If not, how many ? C) Can ZCatalog handle 20 millions of objects (indexed fields could up to 200 millions)? Any suggestion is appreciated. I expect the data is now in a database.
I would leave it there (or put it there, if not yet there).
Data.fs might grow in principle to 200 GB, but I think of this as a horror szenario. This huge file would be in a single partition (I doubt, Unix supports files spread over several partitions). Doubt that you have such large partitions.
When Zope starts, it builds an index for "Data.fs". While the index is much smaller than the file itself, it still will be huge and it is held in memory. Do not do this!
My confidence in ZCatalog is limited, too. You have to carefully choose the commit granularity.
I, definitely, would go for a standard database solution and use Zopes excellent database integration to interface with the data in the database.
Dieter
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )