Hi everybody Try this from the root Folder: <dtml-var standard_html_header> <dtml-in "[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1]"> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> <dtml-var standard_html_footer> This should take a while to show. If not try more 1,1,1,....! If I call another page on a second browser window on the same Zope-site the response is generated after the above script is completed. This would mean that the script hoggs all threads. If this behaviour is "normal" the I wonder how big sites run with an adequate performance?! Of course ZEO would probably be a solution but that would be very expensive in hardware and administration. I can't believe that Zope is so "singletheaded". Therefore I'm interested if somebody can verify this. I run under Solaris but I suppose that the behaviour should be similar on all platforms (Zope 2.4.x). Please don't run this on a production system! Thanx Oliver -- GMX - Die Kommunikationsplattform im Internet. http://www.gmx.net
On Monday 22 October 2001 07:20 am, Oliver Erlewein wrote:
Hi everybody
Try this from the root Folder:
<dtml-var standard_html_header> <dtml-in "[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1 ]"> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> <dtml-var standard_html_footer>
This should take a while to show. If not try more 1,1,1,....! If I call another page on a second browser window on the same Zope-site the response is generated after the above script is completed. This would mean that the script hoggs all threads.
actually it doesn't but it is good example of some zope's optimization. so whats happening here is that ZopeFind starts looking through all the objects of the folder trying to match up requirements, when it does that it means that all these objects are now loaded from the db and are in memory/cache. after the page gets served back to the client the zpublisher thread releases its connection to the zodb, this connection's cache contains all those objects just loaded. when another request is served the zpublisher thread opens up a connection to the zodb, internal to the db these connections are stored in a FIFO stack, so the zpublisher thread ends up getting and using the connection with all those objects sitting in cache, now when the find executes it basically is operating on objects that are all in memory! cheers kapil
Hi What do you mean by "actually it doesn't"? Have you tried it? On what OS and what Zope? And thanx for the other Detail! Oliver
actually it doesn't but it is good example of some zope's optimization. so whats happening here is that ZopeFind starts looking through all the objects of the folder trying to match up requirements, when it does that it means that all these objects are now loaded from the db and are in memory/cache. after the page gets served back to the client the zpublisher thread releases its connection to the zodb, this connection's cache contains all those objects just loaded. when another request is served the zpublisher thread opens up a connection to the zodb, internal to the db these connections are stored in a FIFO stack, so the zpublisher thread ends up getting and using the connection with all those objects sitting in cache, now when the find executes it basically is operating on objects that are all in memory!
cheers
kapil
On Tuesday 23 October 2001 03:54 pm, Oliver Erlewein wrote:
Hi
What do you mean by "actually it doesn't"? Have you tried it? On what OS and what Zope? And thanx for the other Detail!
sorry, i completely misread your question and concern. thats what i get for answering emails late at night. kapil
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs. I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris? ----- Original Message ----- From: "Oliver Erlewein" <oerlewein@gmx.de> To: <zope@zope.org> Sent: Monday, October 22, 2001 10:20 AM Subject: [Zope] Threading, dtml and performance?!
Hi everybody
Try this from the root Folder:
<dtml-var standard_html_header> <dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1, 1,1,1]">
<dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> <dtml-var standard_html_footer>
This should take a while to show. If not try more 1,1,1,....! If I call another page on a second browser window on the same Zope-site the response is generated after the above script is completed. This would mean that the script hoggs all threads.
If this behaviour is "normal" the I wonder how big sites run with an adequate performance?! Of course ZEO would probably be a solution but that would be very expensive in hardware and administration. I can't believe that Zope is so "singletheaded". Therefore I'm interested if somebody can verify this. I run under Solaris but I suppose that the behaviour should be similar on all platforms (Zope 2.4.x). Please don't run this on a production system!
Thanx Oliver
-- GMX - Die Kommunikationsplattform im Internet. http://www.gmx.net
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on the same site .... No-go. Damn. Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
Weird. Anybody know anything about Solaris threading? ----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on the same site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Can somebody with a multiprocessor Linux machine try this out? ----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on the same site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Um... I can do this on a Dual P2-400 with 256mb ram, loading the Redhat flavour of the latest linux kernel.... But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals .83 seconds, but that is because my interface is quite heavy on SQL and CST. Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead? If the ZopeFind(this(), '', '', '',....) means its looking for '1' as an object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and the ZopeFind returns bunk. I'm interested in this test, but I;m not techie enough to understand the control here. <dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br> <dtml-in "[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1, 1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> end<br> <dtml-var standard_html_footer> Thanks for help, Paul Zwarts -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?! Can somebody with a multiprocessor Linux machine try this out? ----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on the same site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until it finished, there would be a problem. Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the Redhat flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals .83 seconds, but that is because my interface is quite heavy on SQL and CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as an object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and the ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand the control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in "[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1, 1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones"
Well, okay then. I get it. However, since it takes only 80% of 1 second to load the page, its difficult to access another page... LOL. I've tried the reverse now. Pulling a page that does heavy SQL queries and then refreshing the speeTest page a few times. Adding some time fields, the page only takes .1 second more than before. I also mention that I built my own mailing list app for our site, and it has run against 8000 emails, and still services me or other users on the site, even though the bulkmailer takes up to 30 minutes to run fully. So I guess the result is the same. Solaris has something funny, whereas Linux does not. But as per my first message, I don't think this test works properly because the second IN is never executed, so this dtml doesn't actually do anything to the server that would distract it or load it down..... Paul Zwarts -----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: Wednesday, October 24, 2001 2:24 PM To: Paul Zwarts Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?! The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until it finished, there would be a problem. Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the Redhat flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals .83 seconds, but that is because my interface is quite heavy on SQL and CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as an object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and the ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand the control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones"
Maybe you created the method in a subfolder without many peer objects? It should be created at the root. Paul Zwarts wrote:
Well, okay then. I get it. However, since it takes only 80% of 1 second to load the page, its difficult to access another page... LOL.
I've tried the reverse now. Pulling a page that does heavy SQL queries and then refreshing the speeTest page a few times. Adding some time fields, the page only takes .1 second more than before.
I also mention that I built my own mailing list app for our site, and it has run against 8000 emails, and still services me or other users on the site, even though the bulkmailer takes up to 30 minutes to run fully.
So I guess the result is the same. Solaris has something funny, whereas Linux does not.
But as per my first message, I don't think this test works properly because the second IN is never executed, so this dtml doesn't actually do anything to the server that would distract it or load it down.....
Paul Zwarts
-----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: Wednesday, October 24, 2001 2:24 PM To: Paul Zwarts Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know
that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until
it finished, there would be a problem.
Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the
Redhat
flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals
.83
seconds, but that is because my interface is quite heavy on SQL and
CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as
an
object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and
the
ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand
the
control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br>
</dtml-in>
</dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones"
Ahaha... Keyword being method. Its one step closer to working now, but I get authorization errors against bobbobase_mod_time. I tried as superuser and owner/manager roles with no avail. Am I missing something? Paul Zwarts -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 3:11 PM To: Paul Zwarts Cc: chrism@zope.com; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?! Maybe you created the method in a subfolder without many peer objects? It should be created at the root. Paul Zwarts wrote:
Well, okay then. I get it. However, since it takes only 80% of 1 second to load the page, its difficult to access another page... LOL.
I've tried the reverse now. Pulling a page that does heavy SQL queries and then refreshing the speeTest page a few times. Adding some time fields, the page only takes .1 second more than before.
I also mention that I built my own mailing list app for our site, and it has run against 8000 emails, and still services me or other users on the site, even though the bulkmailer takes up to 30 minutes to run fully.
So I guess the result is the same. Solaris has something funny, whereas Linux does not.
But as per my first message, I don't think this test works properly because the second IN is never executed, so this dtml doesn't actually do anything to the server that would distract it or load it down.....
Paul Zwarts
-----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: Wednesday, October 24, 2001 2:24 PM To: Paul Zwarts Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know
that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until
it finished, there would be a problem.
Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the
Redhat
flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals
.83
seconds, but that is because my interface is quite heavy on SQL and
CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as
an
object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and
the
ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand
the
control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br>
</dtml-in>
</dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones" _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Okay... So I removed reference to the bobbobase and the id. Instead I just output text, but otherwise it runs well. I've never counted my objects till now, but it's a nice test to really stress the server when you find out you have 1000+ objects being pulled from the root. Results: The testpage took about 3.5 minutes to load. It by itself takes all of the first processor relentlessly, leaving the second open. When a second request comes in, the second processor kicks in and it becomes more even 60%-30% across 1st and 2nd processor. The second page request takes about 8 seconds rather than a normal call of 8/10th sec. I'm not sure if I can be more explicit with other usefull information. One thing to mention though, I'm on Zope 233 with py152, since it seems snappier than py2. Was this test supposed to be for py2 and Z242? If so, I'll do a quick switcherooni and test again. L8r, Paul Zwarts -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Paul Zwarts Sent: Wednesday, October 24, 2001 4:54 PM To: chrism@zope.com Cc: zope@zope.org Subject: RE: [Zope] Threading, dtml and performance?! Ahaha... Keyword being method. Its one step closer to working now, but I get authorization errors against bobbobase_mod_time. I tried as superuser and owner/manager roles with no avail. Am I missing something? Paul Zwarts -----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 3:11 PM To: Paul Zwarts Cc: chrism@zope.com; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?! Maybe you created the method in a subfolder without many peer objects? It should be created at the root. Paul Zwarts wrote:
Well, okay then. I get it. However, since it takes only 80% of 1 second to load the page, its difficult to access another page... LOL.
I've tried the reverse now. Pulling a page that does heavy SQL queries and then refreshing the speeTest page a few times. Adding some time fields, the page only takes .1 second more than before.
I also mention that I built my own mailing list app for our site, and it has run against 8000 emails, and still services me or other users on the site, even though the bulkmailer takes up to 30 minutes to run fully.
So I guess the result is the same. Solaris has something funny, whereas Linux does not.
But as per my first message, I don't think this test works properly because the second IN is never executed, so this dtml doesn't actually do anything to the server that would distract it or load it down.....
Paul Zwarts
-----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: Wednesday, October 24, 2001 2:24 PM To: Paul Zwarts Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know
that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until
it finished, there would be a problem.
Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the
Redhat
flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals
.83
seconds, but that is because my interface is quite heavy on SQL and
CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as
an
object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and
the
ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand
the
control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br>
</dtml-in>
</dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones" _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev ) _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Excellent, thanks for these results. I dont know that the Zope/Python versions matter too much (because I wouldn't be able to interpret any difference in any meaningful way anyway, this is just "back of the napkin" kind of testing). Are you running ZEO? ----- Original Message ----- From: "Paul Zwarts" <paz@oratrix.com> To: <chrism@zope.com> Cc: <zope@zope.org> Sent: Wednesday, October 24, 2001 11:13 AM Subject: RE: [Zope] Threading, dtml and performance?!
Okay... So I removed reference to the bobbobase and the id. Instead I just output text, but otherwise it runs well.
I've never counted my objects till now, but it's a nice test to really stress the server when you find out you have 1000+ objects being pulled from the root.
Results: The testpage took about 3.5 minutes to load. It by itself takes all of the first processor relentlessly, leaving the second open.
When a second request comes in, the second processor kicks in and it becomes more even 60%-30% across 1st and 2nd processor.
The second page request takes about 8 seconds rather than a normal call of 8/10th sec.
I'm not sure if I can be more explicit with other usefull information.
One thing to mention though, I'm on Zope 233 with py152, since it seems snappier than py2. Was this test supposed to be for py2 and Z242? If so, I'll do a quick switcherooni and test again.
L8r, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Paul Zwarts Sent: Wednesday, October 24, 2001 4:54 PM To: chrism@zope.com Cc: zope@zope.org Subject: RE: [Zope] Threading, dtml and performance?!
Ahaha... Keyword being method. Its one step closer to working now, but I get authorization errors against bobbobase_mod_time. I tried as superuser and owner/manager roles with no avail. Am I missing something?
Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 3:11 PM To: Paul Zwarts Cc: chrism@zope.com; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Maybe you created the method in a subfolder without many peer objects? It should be created at the root.
Paul Zwarts wrote:
Well, okay then. I get it. However, since it takes only 80% of 1 second to load the page, its difficult to access another page... LOL.
I've tried the reverse now. Pulling a page that does heavy SQL queries and then refreshing the speeTest page a few times. Adding some time fields, the page only takes .1 second more than before.
I also mention that I built my own mailing list app for our site, and it has run against 8000 emails, and still services me or other users on the site, even though the bulkmailer takes up to 30 minutes to run fully.
So I guess the result is the same. Solaris has something funny, whereas Linux does not.
But as per my first message, I don't think this test works properly because the second IN is never executed, so this dtml doesn't actually do anything to the server that would distract it or load it down.....
Paul Zwarts
-----Original Message----- From: Chris McDonough [mailto:chrism@digicool.com] Sent: Wednesday, October 24, 2001 2:24 PM To: Paul Zwarts Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know
that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until
it finished, there would be a problem.
Paul Zwarts wrote:
Um... I can do this on a Dual P2-400 with 256mb ram, loading the
Redhat
flavour of the latest linux kernel....
But, I don't quite understand the test. At least, what is the dtml doing? I tried it out and I get nothing on the page, except my header/footer stuff. The time reslut from the debug console reveals
.83
seconds, but that is because my interface is quite heavy on SQL and
CST.
Should I modify the code to something else? I suppose the first in-tag is to just create a loop, so can I use _.range() instead?
If the ZopeFind(this(), '', '', '',....) means its looking for '1' as
an
object, it doesn't work either even if I add a method called '1'. With some text in between, I see that the first <dtml-in> works only and
the
ZopeFind returns bunk.
I'm interested in this test, but I;m not techie enough to understand
the
control here.
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1, 1,
1,1]"> a<br> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)" sort=bobobase_modification_time reverse> b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br>
</dtml-in>
</dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf
Of
Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones"
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
On 24/10/01 1:23 pm, "Chris McDonough" <chrism@digicool.com> wrote:
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until it finished, there would be a problem.
Ok more data points. I downloaded the Solaris binary distribution from the Zope site, extracted the python from that and moved it to /usr/local/bin/python-thread I then started up my test site so; exec /usr/local/bin/python-thread $WHERE_ZOPE_LIVES/z2.py -X -w54321 "$@" (extraneous stuff removed). I started off Olivers script and then tried to view another page on this site - no go :( For completeness I kicked off a Zope2.4.0 instance on my MacOS-X TiPb and started off Olivers script again. I could easily select other pages on that site. I'm looking through various archives on Solaris, python and threading, but I'm no guru so this is bloody hard :( I added LD_FLAGS = -lpthread To the python2.1 Makefile and moved the resultant python to /usr/local/bin/python-thread Same result, ie site is locked up whilst the long running dtml method was running. I'm baffled and *really* hoping I can sort this out, as once it's sorted, I guess I can expect to see something like 7 times the performance I have been getting on our sites (7 threads by default - I think). Going quietly doo-lally here.... Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
Tony, I wonder if you'd experience the same results with a different Python version? Do you have an "old" copy of your site that uses Zope 2.3.3 + Python 1.5.2? Tony McDonald wrote:
On 24/10/01 1:23 pm, "Chris McDonough" <chrism@digicool.com> wrote:
The output of the DTML method isn't important, but if you ran it and it took a while (> 5 seconds or so), but then at the same time it was running, you visited a page in the mgmt interface and that operation took .83 seconds, that's the number that's important.. that lets us know that MP Linux systems aren't "freezing" like Solaris systems. However, if you ran this method, and you couldn't do anything on the system until it finished, there would be a problem.
Ok more data points.
I downloaded the Solaris binary distribution from the Zope site, extracted the python from that and moved it to /usr/local/bin/python-thread
I then started up my test site so; exec /usr/local/bin/python-thread $WHERE_ZOPE_LIVES/z2.py -X -w54321 "$@"
(extraneous stuff removed).
I started off Olivers script and then tried to view another page on this site - no go :(
For completeness I kicked off a Zope2.4.0 instance on my MacOS-X TiPb and started off Olivers script again. I could easily select other pages on that site.
I'm looking through various archives on Solaris, python and threading, but I'm no guru so this is bloody hard :(
I added LD_FLAGS = -lpthread To the python2.1 Makefile and moved the resultant python to /usr/local/bin/python-thread
Same result, ie site is locked up whilst the long running dtml method was running.
I'm baffled and *really* hoping I can sort this out, as once it's sorted, I guess I can expect to see something like 7 times the performance I have been getting on our sites (7 threads by default - I think).
Going quietly doo-lally here.... Tone.
-- Chris McDonough Zope Corporation http://www.zope.org http://www.zope.com "Killing hundreds of birds with thousands of stones"
On 24/10/01 2:18 pm, "Chris McDonough" <chrism@digicool.com> wrote:
Tony,
I wonder if you'd experience the same results with a different Python version? Do you have an "old" copy of your site that uses Zope 2.3.3 + Python 1.5.2?
It just so happens I do ;) (Zope 2.2.1 though) Same behaviour. That is, I start off 'threader' (the DTML Method Oliver posted), then try and do anything else on the site - nothing happens until threader has finished. Just to make sure I know what I'm looking for - I started up my MacOS-X Zope2.4.0 site again, ran threader and navigated all over the place. It's really beginning to look like all my Zope sites have been (effectively) single-threaded doesn't it :( Tone (despondently) -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE http://www.fmcc.org.uk/mailman/listinfo/zope
Sorry the Script might not do what it should. But that's not the important thing. Just select a script, that occupies Zope quite some time (e.g. long running <dtml-in>). The try to call another page on the site. Does ist appear? Below I've changed the script a little. It might work (sorry can't test because my home implementation of Zope isn't up & running yet). Please start it in a Folder with manny Subfloders (big site). Oliver Erlewein
<dtml-call logic> <dtml-var head> <dtml-var standard_html_header> start<br>
<dtml-in "[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1, 1,1]"> a<br> <dtml-in "ZopeFind(this(), search_sub=1)">
sort=bobobase_modification_time reverse>
b<br> <dtml-var bobobase_modification_time>, <dtml-var id><br> </dtml-in> </dtml-in> end<br> <dtml-var standard_html_footer>
Thanks for help, Paul Zwarts
-----Original Message----- From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Chris McDonough Sent: Wednesday, October 24, 2001 12:48 AM To: Tony McDonald; Oliver Erlewein; zope@zope.org Subject: Re: [Zope] Threading, dtml and performance?!
Can somebody with a multiprocessor Linux machine try this out?
----- Original Message ----- From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk> To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein" <oerlewein@gmx.de>; <zope@zope.org> Sent: Tuesday, October 23, 2001 6:12 PM Subject: Re: [Zope] Threading, dtml and performance?!
On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
Zope
2.3.3 system we have here. I can browse the site normally while
the
DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on
the same
site .... No-go.
Damn.
Tone. -- Dr Tony McDonald, Assistant Director, FMCC, http://www.fmcc.org.uk/ The Medical School, Newcastle University Tel: +44 191 243 6140 A Zope list for UK HE/FE
http://www.fmcc.org.uk/mailman/listinfo/zope
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Tony McDonald wrote:
Solaris 8, Zope 2.4.1 compiled from source. Save the DTML as a method, 'view' it. Try and do something else on the same site .... No-go.
Thanks for saving me from sacrificing my Ultra 10 :-) -- Matt Behrens <matt.behrens@kohler.com> System Analyst, Baker Furniture
Thanx for the test! I've tested it with these configs: Production: Zope 2.4.0 and Python 2.1.1 compiled from source. Apache 1.3.20 with mod_ssl and ProxyPass Solaris 7 Intel x86, HW: PIII 1Ghz, 512Mb RAM. Test&Programming: Zope 2.4.0 and Python 2.1.1 compiled from source. Apache 1.3.20 with mod_ssl and ProxyPass Solaris 8 Sun, HW: 4 Processor Sun please don't ask me what model! Can anybody confirm on a Wintel Server? Oliver
This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel, Zope 2.3.3 system we have here. I can browse the site normally while the DTML method runs.
I don't have a Solaris machine to test this on; can anyone else confirm the behavior on Solaris?
participants (8)
-
Behrens Matt - Grand Rapids -
Chris McDonough -
Chris McDonough -
kapil thangavelu -
Oliver Erlewein -
Oliver Erlewein -
Paul Zwarts -
Tony McDonald