[Zope] Threading, dtml and performance?!

Wed, 24 Oct 2001 17:13:34 +0200

Okay... So I removed reference to the bobbobase and the id. Instead I
just output text, but otherwise it runs well.

I've never counted my objects till now, but it's a nice test to really
stress the server when you find out you have 1000+ objects being pulled
from the root.

Results:
The testpage took about 3.5 minutes to load. It by itself takes all of
the first processor relentlessly, leaving the second open.

When a second request comes in, the second processor kicks in and it
becomes more even 60%-30% across 1st and 2nd processor.

The second page request takes about 8 seconds rather than a normal call
of 8/10th sec.

I'm not sure if I can be more explicit with other usefull information.

One thing to mention though, I'm on Zope 233 with py152, since it seems
snappier than py2. Was this test supposed to be for py2 and Z242? If so,
I'll do a quick switcherooni and test again.

L8r,
Paul Zwarts

-----Original Message-----
From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of Paul
Zwarts
Sent: Wednesday, October 24, 2001 4:54 PM
To: chrism@zope.com
Cc: zope@zope.org
Subject: RE: [Zope] Threading, dtml and performance?!

Ahaha... Keyword being method. Its one step closer to working now, but I
get authorization errors against bobbobase_mod_time. I tried as
superuser and owner/manager roles with no avail. Am I missing something?

Paul Zwarts

-----Original Message-----
From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of
Chris McDonough
Sent: Wednesday, October 24, 2001 3:11 PM
To: Paul Zwarts
Cc: chrism@zope.com; 'Tony McDonald'; 'Oliver Erlewein'; zope@zope.org
Subject: Re: [Zope] Threading, dtml and performance?!

Maybe you created the method in a subfolder without many peer objects? 
It should be created at the root.

Paul Zwarts wrote:
> Well, okay then. I get it. However, since it takes only 80% of 1
second
> to load the page, its difficult to access another page... LOL. 
> 
> I've tried the reverse now. Pulling a page that does heavy SQL queries
> and then refreshing the speeTest page a few times. Adding some time
> fields, the page only takes .1 second more than before. 
> 
> I also mention that I built my own mailing list app for our site, and
it
> has run against 8000 emails, and still services me or other users on
the
> site, even though the bulkmailer takes up to 30 minutes to run fully.
> 
> So I guess the result is the same. Solaris has something funny,
whereas
> Linux does not.
> 
> But as per my first message, I don't think this test works properly
> because the second IN is never executed, so this dtml doesn't actually
> do anything to the server that would distract it or load it down.....
> 
> Paul Zwarts
> 
> -----Original Message-----
> From: Chris McDonough [mailto:chrism@digicool.com] 
> Sent: Wednesday, October 24, 2001 2:24 PM
> To: Paul Zwarts
> Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein';
zope@zope.org
> Subject: Re: [Zope] Threading, dtml and performance?!
> 
> The output of the DTML method isn't important, but if you ran it and
it 
> took a while (> 5 seconds or so), but then at the same time it was 
> running, you visited a page in the mgmt interface and that operation 
> took .83 seconds, that's the number that's important.. that lets us
know
> 
> that MP Linux systems aren't "freezing" like Solaris systems.
However, 
> if you ran this method, and you couldn't do anything on the system
until
> 
> it finished, there would be a problem.
> 
> Paul Zwarts wrote:
> 
>>Um... I can do this on a Dual P2-400 with 256mb ram, loading the
>>
> Redhat
> 
>>flavour of the latest linux kernel....
>>
>>But, I don't quite understand the test. At least, what is the dtml
>>doing? I tried it out and I get nothing on the page, except my
>>header/footer stuff. The time reslut from the debug console reveals
>>
> .83
> 
>>seconds, but that is because my interface is quite heavy on SQL and
>>
> CST.
> 
>>Should I modify the code to something else? I suppose the first in-tag
>>is to just create a loop, so can I use _.range() instead?
>>
>>If the ZopeFind(this(), '', '', '',....) means its looking for '1' as
>>
> an
> 
>>object, it doesn't work either even if I add a method called '1'. With
>>some text in between, I see that the first <dtml-in> works only and
>>
> the
> 
>>ZopeFind returns bunk.
>>
>>I'm interested in this test, but I;m not techie enough to understand
>>
> the
> 
>>control here.
>>
>>
>><dtml-call logic>
>><dtml-var head>
>><dtml-var standard_html_header>
>>start<br>
>>
>> <dtml-in
>>
>>
>
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
> 
>>1,1]">
>>  a<br>
>>  <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)"
>>sort=bobobase_modification_time reverse>
>>    b<br>
>>    <dtml-var bobobase_modification_time>, <dtml-var id><br>
>>
> </dtml-in>
> 
>>  </dtml-in>
>>end<br>
>><dtml-var standard_html_footer>
>>
>>
>>
>>Thanks for help,
>>Paul Zwarts
>>
>>-----Original Message-----
>>From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of
>>Chris McDonough
>>Sent: Wednesday, October 24, 2001 12:48 AM
>>To: Tony McDonald; Oliver Erlewein; zope@zope.org
>>Subject: Re: [Zope] Threading, dtml and performance?!
>>
>>Can somebody with a multiprocessor Linux machine try this out?
>>
>>----- Original Message -----
>>From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk>
>>To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein"
>><oerlewein@gmx.de>; <zope@zope.org>
>>Sent: Tuesday, October 23, 2001 6:12 PM
>>Subject: Re: [Zope] Threading, dtml and performance?!
>>
>>
>>
>>
>>>On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
>>>
>>>
>>>
>>>>This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
>>>>
>>>>
>>Zope
>>
>>
>>>>2.3.3 system we have here.  I can browse the site normally while
>>>>
>>>>
>>the
>>
>>
>>>>DTML method runs.
>>>>
>>>>I don't have a Solaris machine to test this on; can anyone else
>>>>confirm the behavior on Solaris?
>>>>
>>>>
>>>>
>>>Solaris 8, Zope 2.4.1 compiled from source.
>>>Save the DTML as a method, 'view' it. Try and do something else on
>>>
>>>
>>the same
>>
>>
>>>site .... No-go.
>>>
>>>Damn.
>>>
>>>Tone.
>>>--
>>>Dr Tony McDonald,  Assistant Director, FMCC, http://www.fmcc.org.uk/
>>>The Medical School, Newcastle University Tel: +44 191 243 6140
>>>A Zope list for UK HE/FE
>>>
>>>
>>http://www.fmcc.org.uk/mailman/listinfo/zope
>>
>>
>>>_______________________________________________
>>>Zope maillist  -  Zope@zope.org
>>>http://lists.zope.org/mailman/listinfo/zope
>>>**   No cross posts or HTML encoding!  **
>>>(Related lists -
>>>http://lists.zope.org/mailman/listinfo/zope-announce
>>>http://lists.zope.org/mailman/listinfo/zope-dev )
>>>
>>>
>>>
>>
>>_______________________________________________
>>Zope maillist  -  Zope@zope.org
>>http://lists.zope.org/mailman/listinfo/zope
>>**   No cross posts or HTML encoding!  **
>>(Related lists - 
>> http://lists.zope.org/mailman/listinfo/zope-announce
>> http://lists.zope.org/mailman/listinfo/zope-dev )
>>
>>
>>
> 
> 

-- 
Chris McDonough                    Zope Corporation
http://www.zope.org             http://www.zope.com
"Killing hundreds of birds with thousands of stones"

_______________________________________________
Zope maillist  -  Zope@zope.org
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )