[Zope-dev] Memory Leaks

Tue, 6 Aug 2002 16:36:23 +0200

On Tuesday July 23 2002 12:37, Stefan H. Holek wrote:
> I do also see the ZPT expression stuff leaking. In my case in this orde=
r:
>
> Products.PageTemplates.Expressions.SubPathExpr
> Products.PageTemplates.Expressions.PathExpr
> Products.PageTemplates.ZRPythonExpr.PythonExpr

This is usually what I see but today I noticed this in debug info after t=
he=20
site had been running for a couple of hours - it doesn't look good :-(:

RestrictedPython.compiler_2_1.misc.Set: 37488
RestrictedPython.compiler_2_1.pycodegen.CodeGenerator: 18123
RestrictedPython.compiler_2_1.pyassem.Block: 14876
RestrictedPython.compiler_2_1.ast.Const: 12063
RestrictedPython.compiler_2_1.ast.CallFunc: 11864
RestrictedPython.compiler_2_1.ast.Name: 11314
RestrictedPython.compiler_2_1.pyassem.FlowGraph: 10329
Products.PageTemplates.Expressions.SubPathExpr: 10269
RestrictedPython.compiler_2_1.ast.Stmt: 8768
RestrictedPython.compiler_2_1.visitor.ASTVisitor: 7746
RestrictedPython.compiler_2_1.pyassem.PyFlowGraph: 7740
RestrictedPython.compiler_2_1.misc.Stack: 5165
RestrictedPython.compiler_2_1.pyassem.LineAddrTable: 5159
Products.PageTemplates.Expressions.PathExpr: 4635
RestrictedPython.compiler_2_1.ast.Return: 4584
RestrictedPython.compiler_2_1.ast.Assign: 3571
RestrictedPython.compiler_2_1.ast.AssName: 3546
RestrictedPython.compiler_2_1.ast.Function: 2587
RestrictedPython.compiler_2_1.pycodegen.NestedFunctionCodeGenerator: 2586
RestrictedPython.compiler_2_1.symbols.FunctionScope: 2582
RestrictedPython.compiler_2_1.ast.Module: 2581
RestrictedPython.compiler_2_1.symbols.ModuleScope: 2578
RestrictedPython.compiler_2_1.ast.Global: 1970
Products.PageTemplates.ZRPythonExpr.PythonExpr: 1949
RestrictedPython.compiler_2_1.ast.Compare: 1559
Products.CMFLocalizer.GettextExpr.GettextExpr: 1204
RestrictedPython.compiler_2_1.ast.Keyword: 1136
RestrictedPython.compiler_2_1.ast.Add: 858
RestrictedPython.compiler_2_1.ast.And: 853
Persistence.PersistentMapping: 828
RestrictedPython.compiler_2_1.ast.Discard: 815
Shared.DC.Scripts.Bindings.NameAssignments: 792
RestrictedPython.compiler_2_1.ast.Or: 723
RestrictedPython.compiler_2_1.ast.If: 653
Products.PageTemplates.Expressions.StringExpr: 577
ExtensionClass: 537
RestrictedPython.compiler_2_1.ast.Mod: 444
AccessControl.cAccessControl.PermissionRole: 430
RestrictedPython.compiler_2_1.ast.Pass: 424
App.special_dtml.DTMLFile: 372
Products.CMFCore.FSPageTemplate.FSPageTemplate: 291
Shared.DC.Scripts.Signature.FuncCode: 288
RestrictedPython.compiler_2_1.ast.Tuple: 276
RestrictedPython.compiler_2_1.ast.Not: 238
Products.CMFCore.FSPythonScript.FSPythonScript: 203
Interface.Method.Method: 183
Products.ZGadflyDA.gadfly.kjParser.ParseRule: 161
RestrictedPython.compiler_2_1.ast.Subscript: 152
RestrictedPython.compiler_2_1.ast.List: 151
App.PersistentExtra.Persistent: 146
RestrictedPython.compiler_2_1.ast.For: 142
AccessControl.SecurityInfo.ClassSecurityInfo: 137
App.ImageFile.ImageFile: 135DocumentTemplate.DT_Util.Eval: 128
RestrictedPython.compiler_2_1.ast.Dict: 127
RestrictedPython.compiler_2_1.ast.Sliceobj: 114O
FS.SimpleItem.SimpleItem: 113
Products.CMFCore.PortalFolder.PortalFolder: 102
Products.CMFCore.FSDTMLMethod.FSDTMLMethod: 100
Acquisition.Acquirer: 100
Products.PageTemplates.Expressions.NotExpr: 96
DateTime.DateTime.DateTime: 96O
FS.PropertySheets.PropertySheets: 95
Products.DRM.PurseTool.TransactionObject: 90
Products.CMFDefault.DublinCore

> This one does *not* go away when setting ZOPE_SECURITY_POLICY=3DPYTHON.=
 I am
> also leaking refs to persistent User objects; may be a side effect thou=
gh -
> like your DateTimes.
>
> The site in question serves large ZSQL result sets via ZPT to authentic=
ated
> users. No CMF/Plone involved.
>
> Stefan
>
> --On Montag, 22. Juli 2002 13:45 -0700 Andy McKay <andy@agmweb.ca> wrot=
e:
> > Hey all,
> >
> > A client of mine seems to be plagued with memory leaks. I have a CMF =
/
> > Plone site on We fixed some security issues that caused a major leak =
this
> > is the same I believe as http://collector.zope.org/Zope/421, by jiggl=
ing
> > settings this no longer an issue. Anyway we are still getting some mi=
nor
> > leaks that severly limit the amount of the traffic the box is going t=
o be
> > able take. Lots of different objects are being leaked, including good=
 old
> > DateTime, however I dont believe its this, DateTime just happens to b=
e
> > there.
> >
> > Possible culprits are (trimmed down debug page) ZPT:
> > Products.PageTemplates.Expressions.PathExpr,
> > Products.PageTemplates.Expressions.SubPathExpr,
> > Products.PageTemplates.TALES.TALESError etc...
> > or AccessControl AccessControl.unauthorized.Unauthorized,
> > AccessControl.SecurityManager.SecurityManager etc...
> >
> > A quick rummage through LeakFinder hasn't helped too much so Im not s=
ure
> > what too recommend. Good old install ZEO and restart Zope every few
> > hours? Is anyone else having issues?
> >
> > Configuration:
> >
> > Plone 0.99 "Almost There"
> > CMF Beta 1.3 beta 1
> > Zope 2.5.1
> > Python 2.1.3
> > RedHat Linux 7.1
> > Using Apache and pcgi to serve...
> > --
> >   Andy McKay
> >
> >
> >
> >
> > _______________________________________________
> > Zope-Dev maillist  -  Zope-Dev@zope.org
> > http://lists.zope.org/mailman/listinfo/zope-dev
> > **  No cross posts or HTML encoding!  **
> > (Related lists -
> >  http://lists.zope.org/mailman/listinfo/zope-announce
> >  http://lists.zope.org/mailman/listinfo/zope )

--=20
Regards,
=09Thomas Olsen