<snip> ----- Original Message ----- From: Sinang, Danny To: zope@zope.org Sent: Friday, July 14, 2006 11:24 AM Subject: [Zope] Zope performance experiences Can anyone share their experiences on Zope's performance, what your hardware / Zope configs are, and how you plan to scale ? </snip> I just did some load testing for a new app I am building, so i have some figures: Setup: Application Server - zope 2.9.2 - centOS 4.3 (linux) - AMD Athlon 64 3000+ (1.8 Ghz) - 1Mb RAM (PC3200 DDR 400Mhz) Database Server - zope 2.9.2 (but only using zeo server) - mysql 4.1 - centOS 4.3 (linux) - VIA Cyrix CPU (1Ghz) - 1Mb RAM (ECC 400Mhz) Load testing was done using http_load utility. Apache front-end web server was turned off (I didn't want Apache & its caching to impact the load testing). Load testing was done on an internal LAN. Test #1 - retrieval of static web page (application server gets web page from zeo server running on database server); results: 750 fetches, 50 max parallel 3382 mean bytes/connection 186.86 fetches/sec 631981 bytes/sec msecs/connect: mean 0.414 max 7.523 min 0.174 msecs/first-response: mean 258.394 max 277.709 min 114.296 Test #2 - retrieval of a dynamic page (data collected via an external method and displayed via dtml). Data collection required 5 separate ZCatalog searches and 1 SQL search (all searches performed by Database server); results: 750 fetches, 50 max parallel 8223.2 mean bytes/connection 12.84 fetches/sec 105593 bytes/sec msecs/connect: mean 1.616 max 46.725 min 0.17 msecs/first-response: mean 3768.18 max 4339.11 min 365.858 cpu monitoring during the load test indicated that the Application Server was running at 80-85% utilization and the Database Server cpu was running at 27-31% utilization. Test #3 - retrieval of a dynamic page (data collected/generated via an external method and displayed via dtml). Data collection consisted of 1 zodb object access (to obtain property fields), 2 SQL searches and the generation of a customized image (using PIL, the image was temporarily stored in a temporary_folder); results: 750 fetches, 50 max parallel 2287.93 mean bytes/connection 26.554 fetches/sec 60753 bytes/sec msecs/connect: mean 0.425 max 1.544 min 0.168 msecs/first-response: mean 1782.18 max 7685.95 min 78.514 Final system configuration will consist of a front-end load balancer (linux-based), several application servers and several database servers. There is some good info on scalable networks here: http://www.linuxvirtualserver.org/ hth Jonathan

Sinang, Danny wrote:

Can anyone share their experiences on Zope's performance, what your hardware / Zope configs are, and how you plan to scale ?

Danny, Reading this as a user of Plone, which hogs far more resources than Zope, I feel like a C programmer might if they saw someone ask whether others had managed to get their Assembly programs to perform OK. ;-) If you put Apache or Squid in front of Zope to provide caching, and use, say, 2 ZEO clients , with 4 threads each, and use "this year's model" machine, say 2.5Ghz, 1G RAM (unless you've got loads of huge files inside the ZODB which isn't a great idea anyway) - that should really be most of the work. Even if you plan to have a gigantic site with huge numbers of users, the time it would take for that content to be added and the userbase to grow would give you plenty of opportunity to explore a few other performance tricks in the meantime. Regards Nick -- Nick Davis Web Application Developer University of Leicester http://www2.le.ac.uk http://ebulletin.le.ac.uk