40,000 users - 800,000 documents
Hello, We are seeking information on running Zope under an extreme load. Here are the metrics of the system that we would like to migrate: # of users with an account: 40,000 # of R/O concurrent users at peak time: 5,000 # of R/W concurrent users at peak time: 5,000 # of (static) documents: 800,000 Read-only users mostly search and view documents. Searching is currently done with metadata, but we would like to add full-text search on text renditions of the documents. Read-write users mostly view and index documents. --> Has someone already run Zope under such extreme conditions? --> Could someone share ideas on hardware and software issues? We plan to do some kind of feasibility testing. At this time, here are a few of our ideas: 1. Run ZEO 2. Possibly add an additional layer of load-balancing with specialized Linux software 3. Serve static pages with Apache or IIS 4. Do not rely on ZODB only � consider MySQL, Postgres, Oracle 5. Consider alternatives to ZCatalog � for example Lucene 6. Develop customization with Products instead of ZClasses 7. Use Zope RAM caching as much as possible Your opinion on this topic will be very much appreciated. Thanks, Robert __________________________________ Do you Yahoo!? The New Yahoo! Search - Faster. Easier. Bingo. http://search.yahoo.com
Robert Jean wrote:
We are seeking information on running Zope under an extreme load. Here are the metrics of the system that we would like to migrate:
# of users with an account: 40,000 # of R/O concurrent users at peak time: 5,000 # of R/W concurrent users at peak time: 5,000 # of (static) documents: 800,000
Your opinion on this topic will be very much appreciated.
I think that the weak spot could be the 5000 R/W users. That should certainly be tested. It also depends on what the 5000 users are writing simultaniously. Perhaps that cen be moved to a rdbms if nessecary. Other than that, your tactics look sound. Caching being the key here. Anything that can possibly be cached/ stored statically should be. Perhaps you could even have that in mind when designing the pages. Ie. by not putting something like "A clever quote" on the fronpage so it willl ned to be generated every time. regards Max M
participants (2)
-
Max M -
Robert Jean