Scaling Media Sites, was: RE: [Zope] FYI: cbsnewyork

[sean.upton@uniontrib.com]

Slightly related to this... Somehow if I were to guess, Zope could
definitely handle the traffic of a big media site, supposing there was at
least one or more of the following:
1 - use of ZEO
2 - #1 plus heavy use of front-end caching and proxy-based load-balancing of
ZEO nodes w/ Squid
3 - (most aggressive) Load-balance several boxes doing #2 using L4 switch

#3 is in theory, the smartest move if you want to support daily 8-digit
hit-counts, if the same "semi-dynamic" content (of which news is), only has
to be generated once, then cached, it would be served out of RAM as an
in-transit object from the proxy server.

This caching arrangement (well, for now, 1&2, with 2 ZEO client boxes and a
ZSS) seems to work well for our online classified ads site, which sustains
around a million plus hits on a good day.  Most of those hits, the ZEO
clients / Zope servers never see because most are images, which are cached
in Squid on the first load.  I'm pretty sure that with enough hardware (i.e.
1, 2, and 3 above) this same sort of arrangement could scale just fine to
8-digit page views per day for a news site, supposing you have the bandwidth
to accommodate that sort of traffic as well.

Sean

-----Original Message-----
From: Pierre-Julien Grizel [mailto:grizel@mouli.net]
Sent: Thursday, September 13, 2001 7:13 AM
To: aboulanger@vpatch.com
Cc: Zope@zope.org
Subject: Re: [Zope] FYI: cbsnewyork



Yes, many thanks !

BTW, has anyone got information about the way the cbsnewyork website kept 
(or didn't keep) running during the information rush after the crash ?


It would be a benefit for the whole Zope community to know if Zope is 
stable to endure such a trafic rush !


Many thanks,


P.-J.


> As is known by many here, cbsnewyork is a Zope site and is up and
>servicing NYC with
> information during these days of infamy.
> 
> Regards,
> Albert Boulanger
> aboulanger@vpatch.com
> 
> 
> 
> 
> 
> 
> _______________________________________________
> Zope maillist  -  Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )



_______________________________________________
Zope maillist  -  Zope@zope.org
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )