hi good people i've been using zope for quite some time now. everything has been great; zope, the mailinglist, products are great! <rant> i want to serve a dynamic site and zope fits the bill. now, i think i want to have some of the dynamic methods cached, so as to reduce the cpu cycles on my server. y'see, the site has slowly bogged down as the number of users increase(dwhich is good, the users increase :)) and cpu cycles processing user requests have increased. i'm not too sure (being a newbie) whether all my methods contribute to the consumption of cpu cycles. caching. yes, i've tried putting cache headers on my docs, but it seems that ie do not honor the headers, or maybe i put it wrongly. ie(4.x and 5.x) kept showing the cached version of my pages, even after clearing the local cache. only deleting the temp files solved the problem. i had no bad behaviour from netscape. also tried ZCache, but according to the product author, better wait for the next version. so, i'm waiting. meanwhile, i've tried Cache Pool, and it looks good. i have yet to test the effectiveness of Cache Pool, but it looks as if the page loads faster now. </rant> the point is this: will zope ever have a method cacheing modules/object in the future? for i think zope can be faster if he/she/it have this built in. just a thought. what say you guys? how do you guys tackle this? thanks -- ------------------------------------------------------ http://www.kedai.com.my/kk Am I Evil?
On Mon, 3 Jul 2000 10:49:28 +0800, "Bak @ kedai" <kedai@kedai.com.my> wrote:
hi good people i've been using zope for quite some time now. everything has been great; zope, the mailinglist, products are great!
<rant> i want to serve a dynamic site and zope fits the bill. now, i think i want to have some of the dynamic methods cached, so as to reduce the cpu cycles on my server.
y'see, the site has slowly bogged down as the number of users increase(dwhich is good, the users increase :)) and cpu cycles processing user requests have increased. i'm not too sure (being a newbie) whether all my methods contribute to the consumption of cpu cycles.
FWIW, I think your approach is the right one..... Treat caching as an optimisation. Wait until it's a measurable problem, then tackle the hot spots.
caching. yes, i've tried putting cache headers on my docs, but it seems that ie do not honor the headers, or maybe i put it wrongly. ie(4.x and 5.x) kept showing the cached version of my pages, even after clearing the local cache. only deleting the temp files solved the problem. i had no bad behaviour from netscape.
There are several messages in the mailing list archives explaining how to set these headers. Im still planning to write that HowTo one day....
also tried ZCache, but according to the product author, better wait for the next version. so, i'm waiting.
meanwhile, i've tried Cache Pool, and it looks good. i have yet to test the effectiveness of Cache Pool, but it looks as if the page loads faster now.
These products that cache stuff internal to Zope are great if you need zope to process the cached data (from your desciption, you dont) If you need to cache whole requests, then the best approach is to understand and use the http cache headers. If processor load is your main problem, an external http cache is a big advantage too (I use squid, see http://www.squid-cache.org) Toby Dickenson tdickenson@geminidataloggers.com
On Mon, 03 Jul 2000, Toby Dickenson wrote:
There are several messages in the mailing list archives explaining how to set these headers. Im still planning to write that HowTo one day....
i've followed the thread with interest, and test some of the solutions. but, ie doesn't really honor the headers, me think. or maybe i'm too dense! what i did: <dtml-call "RESPONSE.setHeader('expires',(_.DateTime() + .001).toZone('GMT').strftime('%a, %d %b %Y %H:%M:%S GMT'))"> <dtml-call "RESPONSE.setHeader('cache-control','no-cache')"> <dtml-call "RESPONSE.setHeader('Last-Modified',bobobase_modification_time().toZone('GMT').strftime('%a, %d %b %Y %H:%M:%S GMT') )"> in the very top of my standard_html_header netscape rendered great, while ie will give me intermittent result. most of the time, it spits out old pages, which is a nono since this is a news site!
These products that cache stuff internal to Zope are great if you need zope to process the cached data (from your desciption, you dont)
i'm not following you here. (i'm a newbie. sometimes, it's a great excuse ;)) i thought of it as a cache to all dynamic calls, so i got a static page, with no need for processing dynamic objects (e.g date time, getting objects from other objects, etc) correct me if i'm wrong maybe neli@zopers.org(cachepool author) can chime in here.
If you need to cache whole requests, then the best approach is to understand and use the http cache headers. If processor load is your main problem, an external http cache is a big advantage too (I use squid, see http://www.squid-cache.org)
i'll try and look into this again. will also look into squid.
Toby Dickenson tdickenson@geminidataloggers.com -- thanks
------------------------------------------------------ http://www.kedai.com.my/kk Am I Evil?
Here at DC we recently had a "jam session" discussion on caching. I don't think anything "hard" came out of it, we just tossed around some ideas. DC has several current contract customers who are going to need high speed pretty badly. Of course, they're also going to be using ZEO, which negates some of the need for speed by distributing the load over several boxes. But if that doesn't do the trick, in addition to the already existing caching stuff in DTML, I'd imagine DC is going to need to build some HTML-page-level caching into Zope soon. More specifics I can't give, it's jammed into the (already very crowded) "nebulous things we should be working on". Sounds sort of like fun though. I haven't used CachePool... gad, it's hard to keep up. In addition to caching, have you considered trying to use ZEO over a few machines? "Bak @ kedai" wrote:
hi good people i've been using zope for quite some time now. everything has been great; zope, the mailinglist, products are great!
<rant> i want to serve a dynamic site and zope fits the bill. now, i think i want to have some of the dynamic methods cached, so as to reduce the cpu cycles on my server.
y'see, the site has slowly bogged down as the number of users increase(dwhich is good, the users increase :)) and cpu cycles processing user requests have increased. i'm not too sure (being a newbie) whether all my methods contribute to the consumption of cpu cycles.
caching. yes, i've tried putting cache headers on my docs, but it seems that ie do not honor the headers, or maybe i put it wrongly. ie(4.x and 5.x) kept showing the cached version of my pages, even after clearing the local cache. only deleting the temp files solved the problem. i had no bad behaviour from netscape.
also tried ZCache, but according to the product author, better wait for the next version. so, i'm waiting.
meanwhile, i've tried Cache Pool, and it looks good. i have yet to test the effectiveness of Cache Pool, but it looks as if the page loads faster now. </rant>
the point is this: will zope ever have a method cacheing modules/object in the future? for i think zope can be faster if he/she/it have this built in.
just a thought. what say you guys? how do you guys tackle this?
thanks
-- ------------------------------------------------------ http://www.kedai.com.my/kk Am I Evil?
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
to build some HTML-page-level caching into Zope soon. More specifics I can't give, it's jammed into the (already very crowded) "nebulous things we should be working on". Sounds sort of like fun though.
i do hope this materialize, since it will only boost Zope.
I haven't used CachePool... gad, it's hard to keep up.
i did a crude test with ab, and came out with the following. this is a moderately dynamic page (with dtml-method invoking date time, look for stuff in ZClass objects, etc). in summary, about 3 times increase of transfer rate. w/o CachePool /tmp]# /usr/sbin/ab -n 100 -c 20 http://203.106.2.206:8080/emedia_html This is ApacheBench, Version 1.3c <$Revision: 1.38 $> apache-1.3 Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/ Server Software: Zope/Zope Server Hostname: 203.106.2.206 Server Port: 8080 Document Path: /emedia_html Document Length: 14063 bytes Concurrency Level: 20 Time taken for tests: 43.212 seconds Complete requests: 100 Failed requests: 97 (Connect: 0, Length: 97, Exceptions: 0) Total transferred: 1422643 bytes HTML transferred: 1402543 bytes Requests per second: 2.31 Transfer rate: 32.92 kb/s received Connnection Times (ms) min avg max Connect: 1 11 375 Processing: 805 7817 8569 Total: 806 7828 8944 with CachePool /tmp]# /usr/sbin/ab -n 100 -c 20 http://203.106.2.206:8080/t_p This is ApacheBench, Version 1.3c <$Revision: 1.38 $> apache-1.3 Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Copyright (c) 1998-1999 The Apache Group, http://www.apache.org/ Server Software: Zope/Zope Server Hostname: 203.106.2.206 Server Port: 8080 Document Path: /t_p Document Length: 14066 bytes Concurrency Level: 20 Time taken for tests: 14.671 seconds Complete requests: 100 Failed requests: 66 (Connect: 0, Length: 66, Exceptions: 0) Total transferred: 1423367 bytes HTML transferred: 1403267 bytes Requests per second: 6.82 Transfer rate: 97.02 kb/s received Connnection Times (ms) min avg max Connect: 1 573 3008 Processing: 106 2072 6070 Total: 107 2645 9078
In addition to caching, have you considered trying to use ZEO over a few machines?
yes. but not until zeo is stable enough, and i'm comfortable with 2.2.0 (what with all the new security stuff and new behaviour) but i am going to test it. fer sure. thanks p/s - anybody know why i got failed request when i do ab?
participants (3)
-
Bak ＠ kedai -
Chris McDonough -
Toby Dickenson