[Zope] Zope slooooowww

Ron Arts raarts@office.netland.nl
Thu, 14 Mar 2002 17:32:02 +0100


This is a cryptographically signed message in MIME format.

--------------ms020404070803000901000505
Content-Type: text/plain; charset=us-ascii; format=flowed
Content-Transfer-Encoding: 7bit

seb bacon wrote:
> 
> If you have a large Data.fs with a lot of products, it is normal to see
> a long startup time.  But if this was a fresh Zope, then I would not
> expect the startup on your hardware to take more than 15 seconds at the
> most.
> 
> There are two possibilities:
> 
> 1) Your system has a bottleneck you aren't aware of, processes blocking,
> running out of file descriptors, etc.
> 2) Python or Zope has some bug w.r.t your system.
> 
> Here are some questions for you:
> 
> What is your load average?   CPU utilization?  Disk activity?  Perhaps
> you could post a 'vmstat 2 10' the system idling vs. starting up zope
> vs. viewing a page in started up Zope?
> 

System idle:


[root@n010080 /root]# vmstat 2 10
    procs                      memory    swap          io     system         cpu
  r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
  0  0  0   4772   3208   5888  32576   0   0     6     3   27    49  95   4   1
  0  0  0   4772   3208   5888  32576   0   0     0     0  188    52   2   4  94
  0  0  0   4772   3208   5888  32576   0   0     0     0  218    89   7  16  77
  0  0  0   4772   3208   5888  32576   0   0     0     0  177    52   1   4  94
  0  0  0   4772   3208   5888  32576   0   0     0     0  187    59   3   3  94
  0  0  0   4772   3208   5888  32576   0   0     0     0  210    92   8  14  78
  0  0  0   4772   3208   5888  32576   0   0     0     0  197    57   2   3  94
  1  0  0   4772   3212   5888  32576   0   0     0     0  225    98   7  17  77
  0  0  0   4772   3208   5888  32576   0   0     0     0  194    79   1   6  93
  0  0  0   4772   3208   5888  32576   0   0     0     0  200    51   2   4  94


Zope start

[root@n010080 /root]# vmstat 2 10
    procs                      memory    swap          io     system         cpu
  r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
  1  0  0   4772  16088   5380  32320   0   0     6     3   27    49  95   4   1
  1  0  0   4772  15524   5380  32320   0   0     0     7  223    53  80  20   0
  1  0  1   4772  13800   5800  32320   0   0     0   171 1337   110  73  27   0
  2  0  0   4772  12776   5800  32320   0   0     0     7  470    71  83  17   0
  1  0  0   4772  12308   5800  32320   0   0     5     1  194    64  91   9   0
  1  0  0   4772  11640   5800  32320   0   0     0     0  179    56  90  10   0
  1  0  0   4772  11004   5800  32320   0   0     2     0  203    58  87  13   0
  1  0  0   4772  10420   5800  32320   0   0     0     0  192    50  89  11   0
  1  0  0   4772  10308   5800  32320   0   0     0     1  162    53  95   5   0
  1  0  0   4772   9580   5800  32320   0   0     0     0  173    49  92   8   0

Viewing a page:

[root@n010080 /root]# vmstat 2 10
    procs                      memory    swap          io     system         cpu
  r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
  1  0  0   4772   2452   6372  32408   0   0     6     3   28    49  95   4   1
  1  0  0   4772   2428   6372  32416   0   0     1     0  200    57  93   7   0
  1  0  0   4772   2412   6372  32428   0   0     0     2  203    60  94   6   0
  1  0  0   4772   2392   6372  32432   0   0     0     0  193    51  91   9   0
  2  0  0   4772   2328   6372  32448   0   0     1     0  221    84  91   6   3
  1  0  1   4772   2216   6372  32468   0   0     0     2  224    77  89  11   0
  2  0  3   4772   2156   6372  32524   0   0     6     0  245    73  86  11   3
  1  0  2   4772   2140   6372  32544   0   0     1     0  180    58  92   8   0
  1  0  0   4772   3108   6132  32336   0   0     4     0  239    62  80  18   2
  1  0  0   4772   3072   6132  32360   0   0     2    32  464    81  78  20   2



> What OS are you running?  IIRC there have been problems with threads on
> solaris.  
> 

Linux 2.2.20 kernel.

> Did you compile python, zope from source?  What version of python are
> you using?  What flags did you compile it with?
> 
> 

I used the RPM that is on www.zope.org, recreated that using the newest
Zope version (only thing I needed to change was add some products to
the spec file). The Zope RPM is running fine withouth CMF and plone.

If I add CMF it gets a lot slower, but when I add plone it really sucks.

Magnus said:

> 
> 3) You have used a cvs CMF version too long ;-) My guess is that 7 minutes
> on a P233 to login is normal, if you are using Plone that uses
> PageTemplates, and CMF1.2 that does not have support for delayed cooking.
> 
> There is a HUGE difference in startup time/first access time when using CMF
> cvs with delayed PageTemplates cooking support.
> 

So if I want to use plone I need to use latest CMF CVS-version?
I did not know that, the docs said CMF 1.2 was OK, so I took
it. I generally prefer not to use CVS versions.

Ron Arts


-- 
Netland Internet Services
bedrijfsmatige internetoplossingen

http://www.netland.nl   Kruislaan 419              1098 VA Amsterdam
info: 020-5628282       servicedesk: 020-5628280   fax: 020-5628281

--------------ms020404070803000901000505
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJZzCC
AxkwggKCoAMCAQICAwbOTzANBgkqhkiG9w0BAQQFADCBkjELMAkGA1UEBhMCWkExFTATBgNV
BAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMQ8wDQYDVQQKEwZUaGF3dGUx
HTAbBgNVBAsTFENlcnRpZmljYXRlIFNlcnZpY2VzMSgwJgYDVQQDEx9QZXJzb25hbCBGcmVl
bWFpbCBSU0EgMjAwMC44LjMwMB4XDTAyMDIyMDIxMDE1MFoXDTAzMDIyMDIxMDE1MFowXDEN
MAsGA1UEBBMEQXJ0czERMA8GA1UEKhMIUm9uIFIuQS4xFjAUBgNVBAMTDVJvbiBSLkEuIEFy
dHMxIDAeBgkqhkiG9w0BCQEWEXJhYXJ0c0BuZXRsYW5kLm5sMIIBIjANBgkqhkiG9w0BAQEF
AAOCAQ8AMIIBCgKCAQEA7vEsfUlWImQyVwQzmllJxPF1C39glLXkQrBwHvjrAmE3TgDVJXYN
7JCSTn8T2NUU4LTv8kzv7BC7+UrMKwYil3pAEhExGadcHSQ9zQSk7nhy1ElUzup0CtAgmCKC
48j2Mj9xwcb5hzXBLv+HoGDxhPjGpU2IHl7e++XY5x+B4ilgiv4br7mZQuZ/uoEIXcHd3ewO
uKaj61L3U7+dxp35jS6tbc3M7drrJZ3i9CFvIowRk0AMWI+9GfAjdqFzYdt0meojqngTUgqf
1yB7KvXhXsFUWt/HHurRs5dQanAPkmOmq4y/0xqEoBg+zWi1y/rYvFVsCUiBD4kaG3PCbRY6
UQIDAQABoy4wLDAcBgNVHREEFTATgRFyYWFydHNAbmV0bGFuZC5ubDAMBgNVHRMBAf8EAjAA
MA0GCSqGSIb3DQEBBAUAA4GBAKXLn6h6nxmhVK5MNaMuZRPFpSV3AO3kjXLOIQ/yZy/RhURJ
5FasQJRaWTMxAoxLpySWpKjBKtW7YprkLQUvZhuttqPrFXugfi3Up0tbZxjfyuIFxoa/RiGn
t1o9uSHyEikJQuFVq7JIK+fGnzqie9vMnwzIM1tUeP1VKLRbLp5RMIIDGTCCAoKgAwIBAgID
Bs5PMA0GCSqGSIb3DQEBBAUAMIGSMQswCQYDVQQGEwJaQTEVMBMGA1UECBMMV2VzdGVybiBD
YXBlMRIwEAYDVQQHEwlDYXBlIFRvd24xDzANBgNVBAoTBlRoYXd0ZTEdMBsGA1UECxMUQ2Vy
dGlmaWNhdGUgU2VydmljZXMxKDAmBgNVBAMTH1BlcnNvbmFsIEZyZWVtYWlsIFJTQSAyMDAw
LjguMzAwHhcNMDIwMjIwMjEwMTUwWhcNMDMwMjIwMjEwMTUwWjBcMQ0wCwYDVQQEEwRBcnRz
MREwDwYDVQQqEwhSb24gUi5BLjEWMBQGA1UEAxMNUm9uIFIuQS4gQXJ0czEgMB4GCSqGSIb3
DQEJARYRcmFhcnRzQG5ldGxhbmQubmwwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIB
AQDu8Sx9SVYiZDJXBDOaWUnE8XULf2CUteRCsHAe+OsCYTdOANUldg3skJJOfxPY1RTgtO/y
TO/sELv5SswrBiKXekASETEZp1wdJD3NBKTueHLUSVTO6nQK0CCYIoLjyPYyP3HBxvmHNcEu
/4egYPGE+MalTYgeXt775djnH4HiKWCK/huvuZlC5n+6gQhdwd3d7A64pqPrUvdTv53GnfmN
Lq1tzczt2uslneL0IW8ijBGTQAxYj70Z8CN2oXNh23SZ6iOqeBNSCp/XIHsq9eFewVRa38ce
6tGzl1BqcA+SY6arjL/TGoSgGD7NaLXL+ti8VWwJSIEPiRobc8JtFjpRAgMBAAGjLjAsMBwG
A1UdEQQVMBOBEXJhYXJ0c0BuZXRsYW5kLm5sMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEE
BQADgYEApcufqHqfGaFUrkw1oy5lE8WlJXcA7eSNcs4hD/JnL9GFREnkVqxAlFpZMzECjEun
JJakqMEq1btimuQtBS9mG622o+sVe6B+LdSnS1tnGN/K4gXGhr9GIae3Wj25IfISKQlC4VWr
skgr58afOqJ728yfDMgzW1R4/VUotFsunlEwggMpMIICkqADAgECAgEMMA0GCSqGSIb3DQEB
BAUAMIHRMQswCQYDVQQGEwJaQTEVMBMGA1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlD
YXBlIFRvd24xGjAYBgNVBAoTEVRoYXd0ZSBDb25zdWx0aW5nMSgwJgYDVQQLEx9DZXJ0aWZp
Y2F0aW9uIFNlcnZpY2VzIERpdmlzaW9uMSQwIgYDVQQDExtUaGF3dGUgUGVyc29uYWwgRnJl
ZW1haWwgQ0ExKzApBgkqhkiG9w0BCQEWHHBlcnNvbmFsLWZyZWVtYWlsQHRoYXd0ZS5jb20w
HhcNMDAwODMwMDAwMDAwWhcNMDIwODI5MjM1OTU5WjCBkjELMAkGA1UEBhMCWkExFTATBgNV
BAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMQ8wDQYDVQQKEwZUaGF3dGUx
HTAbBgNVBAsTFENlcnRpZmljYXRlIFNlcnZpY2VzMSgwJgYDVQQDEx9QZXJzb25hbCBGcmVl
bWFpbCBSU0EgMjAwMC44LjMwMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDeMzKmY8cJ
JUU+0m54J2eBxdqIGYKXDuNEKYpjNSptcDz63K737nRvMLwzkH/5NHGgo22Y8cNPomXbDfpL
8dbdYaX5hc1VmjUanZJ1qCeu2HL5ugL217CR3hzpq+AYA6h8Q0JQUYeDPPA5tJtUihOH/7Ob
nUlmAC0JieyUa+mhaQIDAQABo04wTDApBgNVHREEIjAgpB4wHDEaMBgGA1UEAxMRUHJpdmF0
ZUxhYmVsMS0yOTcwEgYDVR0TAQH/BAgwBgEB/wIBADALBgNVHQ8EBAMCAQYwDQYJKoZIhvcN
AQEEBQADgYEAcxtvJmWL/xU0S1liiu1EvknH6A27j7kNaiYqYoQfuIdjdBxtt88aU5FL4c3m
ONntUPQ6bDSSrOaSnG7BIwHCCafvS65y3QZn9VBvLli4tgvBUFe17BzX7xe21Yibt6KIGu05
Wzl9NPy2lhglTWr0ncXDkS+plrgFPFL83eliA0gxggMnMIIDIwIBATCBmjCBkjELMAkGA1UE
BhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBUb3duMQ8wDQYD
VQQKEwZUaGF3dGUxHTAbBgNVBAsTFENlcnRpZmljYXRlIFNlcnZpY2VzMSgwJgYDVQQDEx9Q
ZXJzb25hbCBGcmVlbWFpbCBSU0EgMjAwMC44LjMwAgMGzk8wCQYFKw4DAhoFAKCCAWEwGAYJ
KoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDIwMzE0MTYzMjAyWjAj
BgkqhkiG9w0BCQQxFgQUofh1GH/MdvB3YSh1m/23W3D1KHkwUgYJKoZIhvcNAQkPMUUwQzAK
BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI
KoZIhvcNAwICASgwga0GCyqGSIb3DQEJEAILMYGdoIGaMIGSMQswCQYDVQQGEwJaQTEVMBMG
A1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlDYXBlIFRvd24xDzANBgNVBAoTBlRoYXd0
ZTEdMBsGA1UECxMUQ2VydGlmaWNhdGUgU2VydmljZXMxKDAmBgNVBAMTH1BlcnNvbmFsIEZy
ZWVtYWlsIFJTQSAyMDAwLjguMzACAwbOTzANBgkqhkiG9w0BAQEFAASCAQBV6//X/vGW0Bim
BkOfS/tF3WKWT/rOXhwnR76wJ8UaMlZyusTYbNCyv8Ik9Anml/rrNVuptzT/AqMbQsUzqgZC
9GkvppgTTfznxp5Gpf5nucMKiDWqqgpo7/alhNa51mkCPUb6EQDgNVEY2WQp2v8yPkTO8gJF
BOIKCQR77Ll/nUMc5I4fkJ3l52KuM582G4FFAdIhmSVrLLxSNsvLVJLNqi6Z6iij3g7/uwQx
PJ54B8t4J6PQUwAa3XCxUf0w+erUbU3PECMaY/mhUi8c0hjaRoAeEq1h4duq8hxvMIYScmR2
03JaKLvozz9JMc6GqCR0xGDZ3X+6dAjacYy2FT66AAAAAAAA
--------------ms020404070803000901000505--