[Zope] Performance requirements and ZEO

BZ bz@bwanazulia.com
Thu, 31 Jul 2003 16:40:51 -0500 (CDT)


Bart,

The machine you have listed below would EASILY handle 1,000,000 hits a
day. If you are worried about it, try some benchmarks using Apache Bench
(ab).

Here are some VERY old ones I did..
http://www.zope.org/Members/BwanaZulia/benchmarks.html

Basically, your machine should easily be able to handle 50-100 requests
per second and there are a ton of things you can do to offload the work
from Zope if you are looking for raw speed...

- Have images/files served up by Apache (lets Zope do what it does best)
- Use Zope internal RAM Cache on things that are highly dynamic
- Use a proxy server (like Squid) for offsite caching

Good luck.

Cheers,
Jake

> BZ,
>
> Thanks a bunch for the speedy reply.  The machine I was looking at has a
> RAID5 controller with 3 Ultra320 SCSI 10,000 RPM 36GB drives, 2 GB RAM,
> and
> 2 processors.  From what I've read, I'm starting to think maybe I should
> be
> getting a fast single-processor machine with more memory, instead of
> spending that money on two or three machines.
>
> Thank you for your help.
>
> -bart
>
>> -----Original Message-----
>> From: BZ [mailto:bz@bwanazulia.com]
>> Sent: Thursday, July 31, 2003 5:24 PM
>> To: bart hubbard
>> Cc: zope@zope.org
>> Subject: Re: [Zope] Performance requirements and ZEO
>>
>>
>> Bart....
>>
>> I run 2/3 major sites that brings my zope up to about 100,000
>> hits a day and I can tell you you are going to have a lot of capacity.
>>
>> My set up:
>> - 1.67 AMD
>> - 1.5 GB DDR Ram
>> - 2 x 36 GB SCSI in Raid
>> - Tape backup, etc...
>>
>> I store everything in the ZODB (images, js, css) which totals
>> 59,702 objects. The zope process is fine, it peaks up and
>> down but there are also other sites (minor) running on Apache
>> and mail server running on the machine (also logs, tools, etc
>> etc..). I would say the machine runs at about 3-4% of
>> capacity. I could easily bring this box up to 1,000,000 hits
>> a day without worrying about expanding.
>>
>> Here is some suggestions:
>> - Get lots of RAM. Zope (python) loves RAM (and RAM cache helps)
>> - Up your zope threads (I run at 10) and cache size (10,000)
>> - Get SCSI & RAID (7,200 - 10,000 RPM). Since Zope reads its
>> ZODB from the drive you want this to be fast and reliable.
>>
>> I think you could easily start with one box and migrate up.
>> If you are planning on a dual, look into Python and SMP. I
>> remember reading it was not great, so what you could do is
>> run two instances (your ZEOs) one on each processor.
>>
>> Cheers,
>> BZ
>>
>>
>>
>>
>>
>>
>> > I'm working on a project to build a public website using
>> Zope, and am
>> > in a position where I need to spec and order the hardware before
>> > beginning the work on the site.  We're going to plan for 500,000
>> > hits/day as a benchmark. I'm leaning towards a ZEO
>> configuration, with
>> > a dedicated ZEO Storage Server
>> > and 2 ZEO Client machines, with a load-balancer up front.
>> This way, the
>> > worst case is the performance isn't up to par, and I can
>> just toss another
>> > machine at it as a ZEO Client.
>> >
>> > Here's the question: is there any benefit to having dual-processor
>> > machines on any of these?  I think we can afford 3 of them, if
>> > necessary, but is it even needed?  I was planning on going with
>> > Dual-Xeon 2.8 GHz boxes running Linux.  I'd rather not run
>> more than
>> > one instance of Zope on the clients, btw.
>> >
>> > Also, I'm having trouble finding info on getting SSL
>> working in a ZEO
>> > setup. Are there any docs out there I should read?
>> >
>> > much thanks,
>> > bart
>> >
>> >
>> > _______________________________________________
>> > Zope maillist  -  Zope@zope.org
>> > http://mail.zope.org/mailman/listinfo/zope
>> > **   No cross posts or HTML encoding!  **
>> > (Related lists -
>> http://mail.zope.org/mailman/listinfo/zope-> announce
>> >
>> http://mail.zope.org/mailman/listinfo/zope-dev )
>> >
>>
>>
>
>
>