- Zope - Zope lists

Does this create a leak?
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 18 May '04

18 May '04

Hello, Does setting a persistent object as attribute to another persistent object, and then accessing it directly through the web, create a leak? For example: from OFS.Image import Image class myclass(Image): def __init__(self) self.thumbnail = Image(id='thumbnail') and then access it using something like: http://host.com/myinstance/thumbnail Wouldn't this leave the thumbnail lying around after the GC cycle, since once the system is done with the parent instance, the refcount falls to zero, it's cleaned out, and the thumbnail is orphaned, creating a memory leak? I was told at some point that this was OK, but now that I'm hunting memory leaks and learning more about that, this no longer seems sensible. And since I do it all over the place, it'd explain my horrible leak of AcquisitionWrappers and HTTPRequests and so on ... As well as high refcount for CMFImage.Image ... Thanks, J.F.

2 1

RE: Leaking HTTP requests (was: RE: [Zope] LeakingAcquisition.Imp licitAcquirerWrapper)
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 18 May '04

18 May '04

Chris, No problem, thanks for the effort! I've been told to devote all of my resources to this myself, so that's what I'm doing ... Unfortunately, I'm pushing my skillset as far as deep debugging of Zope/Python, so it means a learning curve for me, which takes time ... The one great thing I'd like to be able to do is "attach" myself to the instances left around so I can inspect them ... Is that at all doable? I have the monitor port open, maybe I can go in that way ... There's also gdb, but I've never used it at all :( Oh and there's pdb ... can I run Zope within the debugger somehow? Maybe from within the monitor? Anyways, I guess I'll find out the hard way! Cheers, J.F. -----Original Message----- From: Chris McDonough [mailto:chrism@plope.com] Sent: May 14, 2004 1:47 PM To: Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca Cc: brian(a)zope.com; stefan(a)epy.co.at; zope(a)zope.org Subject: RE: Leaking HTTP requests (was: RE: [Zope] LeakingAcquisition.Imp licitAcquirerWrapper) FWIW, I've been trying to fix the leak Tres found (which appears to be unrelated to your leak), but I'm pretty close to giving up after ~5 hours, as I'm pretty much out of time. - C On Fri, 2004-05-14 at 13:23, Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca wrote: > G'Day, > > Preliminary information seems to suggest the patch isn't helping either. > > So right now I've both removed the standard_error_message AND applied the > LeakBGone > monkey patch. > > I'll leave my production site in this state through the week-end and see > what the > numbers look like on monday. > > In the mean time, I'll try to dig deeper ... > > Thanks, > J.F. > > -----Original Message----- > From: Chris McDonough [mailto:chrism@plope.com] > Sent: May 13, 2004 5:50 PM > To: Brian Lloyd > Cc: Stefan H. Holek; Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca; zope(a)zope.org > Subject: RE: Leaking HTTP requests (was: RE: [Zope] > LeakingAcquisition.ImplicitAcquirerWrapper) > > > Tres and me were playing around with this a little and the easiest way > to provoke a REQUEST leak is to do an anonymous request to a resource > inside a subfolder where the subfolder has all permission acquisition > turned off (and only "authenticated" granted view access). It will turn > around and try to run "standard_error_message", which will fail due to > security (and leak in the process). The code responsible for this is > SimpleItem.raise_standardErrorMessage, which does some funky passing > around/munging of traceback objects. However, > "raise_standardErrorMessage" never gets called if > "standard_error_message" doesn't exist in the acquisition path. If it > never gets called, the leak does not occur. > > The simplest way to rid yourself of the leak temporarily is to remove > "standard_error_message". > > On Thu, 2004-05-13 at 17:41, Brian Lloyd wrote: > > Zope.org doesn't use Localizer (or Archetypes - another thing > > that has come up in this thread). > > > > In our experience, this sort of thing has almost always turned > > out to be a wrapped object ending up in the REQUEST or a wrapped > > object holding onto a request for some reason. > > > > I've attached a quick product you can drop in to test that > > theory on your own instance (just make a directory > > Products/LeakBGone and drop this __init__.py into it and > > restart). > > > > If it fixes the leak, we can extend it to do some logging and > > try to figure out the root cause. I'll try it out on zope.org > > as soon as I'm able. > > > > > > Brian Lloyd brian(a)zope.com > > V.P. Engineering 540.361.1716 > > Zope Corporation http://www.zope.com > > > > > > > -----Original Message----- > > > From: zope-bounces+brian=zope.com(a)zope.org > > > [mailto:zope-bounces+brian=zope.com@zope.org]On Behalf Of Stefan H. > > > Holek > > > Sent: Thursday, May 13, 2004 3:14 PM > > > To: Brian Lloyd > > > Cc: Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca; zope(a)zope.org > > > Subject: Re: Leaking HTTP requests (was: RE: [Zope] > > > LeakingAcquisition.ImplicitAcquirerWrapper) > > > > > > > > > Does zope.org use Localizer or some type of "global request" patch? > > > > > > Stefan > > > > > > > > > On Donnerstag, Mai 13, 2004, at 21:42 Europe/Vienna, Brian Lloyd wrote: > > > > > > > FWIW - zope.org is suffering hugely from this as well, so > > > > I'm following this thread eagerly ;) > > > -- > > > The time has come to start talking about whether the emperor is as well > > > dressed as we are supposed to think he is. /Pete McBreen/ > > > > > > > > > _______________________________________________ > > > Zope maillist - Zope(a)zope.org > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > ______________________________________________________________________ > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://mail.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope-dev )

4 3

How to define input parameters to zpt ?
by fowlertrainer＠anonym.hu 18 May '04

18 May '04

Hello ! I remember: anyone say to me that zpt has parameter dictionary. If I have zpt named zpt1, I can call it by py script: context.zpt1("1","a",anobj) But how I get it in zpt ? I forget this... I think, that is params, or globals like this: <p tal:replace="python:_globals[0]"/> Anyone help me ? Thanx. -- Üdv/Kind of Regards: fowlertrainer(a)anonym.hu mailto:fowlertrainer@anonym.hu

3 2

Error with LDAPUserFolderExt
by Gitte Wange 18 May '04

18 May '04

Hello, I'm trying to setup a LDAPUserFolder inside GRUF. (It's my first attempt so). When I'm trying to add the user folder, I get this error: Exception Type TypeError Exception Value __init__() got multiple values for keyword argument 'local_groups' Traceback (innermost last): * Module ZPublisher.Publish, line 98, in publish * Module ZPublisher.mapply, line 88, in mapply * Module ZPublisher.Publish, line 39, in call_object * Module Products.LDAPUserFolderExt.LDAPUserFolder, line 268, in manage_addLDAPUserFolderExt TypeError: __init__() got multiple values for keyword argument 'local_groups' I'm not sure what this error means. I have looked at the code but can't really see what the multiple values should be - local_groups is a select-box. Anyone with a hint ? Greetings, Gitte Wange

1 0

Leaking HTTP requests (was: RE: [Zope] Leaking Acquisition.Implic itAcquirerWrapper)
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 18 May '04

18 May '04

Oh, wait a minute ... Looks like I'm actually leaking HTTP requests! Class May 12, 2004 5:08 pm May 13, 2004 3:26 pm Delta Acquisition.ImplicitAcquirerWrapper 7190 138920 +131730 ZPublisher.HTTPRequest.HTTPRequest 352 18123 +17771 ZPublisher.BaseRequest.RequestContainer 329 18095 +17766 ZServer.HTTPResponse.ZServerHTTPResponse 338 18103 +17765 I saw some traffic on this same topic about archetypes & plone ... Hopefully I'll be able to track this down more easily than wrapper problems. Still any input will be appreciated, tracking down memory leaks always seems like black magic to me :P Thanks, J.F. -----Original Message----- From: zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]On Behalf Of Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca Sent: May 13, 2004 1:46 PM To: stefan(a)epy.co.at Cc: zope(a)zope.org Subject: RE: [Zope] Leaking Acquisition.ImplicitAcquirerWrapper Stefan, Hmmm actually yes ... Not quite as high as the wrapper, but higher than I'd expect, right this moment I've got 124219 for the wrapper and 48965 for DateTime ... I use standard user folders everywhere, I don't do anything special with them ... So I have one in the root and one in each of two CMF instances. I removed the "Members" folder ... I have about 4 or 5 users in each, most access to the site is anonymous. Although now that you say it, it'd be interesting to see if removing user-based/authenticated access solves the problem. I've been trying to replicate the problem on a second copy of the site without success ... But then I never authenticated against it other than through the ZMI ... I'm looking forward to your response now that you've peaked my curiosity :) Thanks for the help, J.F. -----Original Message----- From: zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]On Behalf Of Stefan H. Holek Sent: May 13, 2004 1:00 PM To: Jean-Francois.Doyon(a)ccrs.nrcan.gc.ca Cc: zope(a)zope.org Subject: Re: [Zope] Leaking Acquisition.ImplicitAcquirerWrapper a) Are you also seeing high refcounts for DateTime objects? b) Which user folder do you have? Stefan On Donnerstag, Mai 13, 2004, at 17:02 Europe/Vienna, Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca wrote: > I'm using Zope 2.7 w/ python 2.3.3 on RH7.3 with > - CMF 1.4.2 > - TranslationService > - Localizer > - mxmRelations > - ZPsycopgDA > -- The time has come to start talking about whether the emperor is as well dressed as we are supposed to think he is. /Pete McBreen/ _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

6 7

Mysterious data.fs increase
by Danny Bloemendaal 18 May '04

18 May '04

Hi folks, I have a production zope database with a size of 225Mb (after pack) and a local database (identical environment) which is a copy of production that is a few days old with a size of 45Mb. In a desperate attempt to find out where all these hundreds of Mb came from in only a few days while not much was added in the production database I did some tests: When I delete all the content from my Plone site, production db decreased to 7Mb, so I concluded that nearly all the size sits in the content. When I export all the content in import it into my local version (after removing the local content first), the size of my local db increased with only a few Mb. So local was about 50Mb after import and after packing. The export files where roughly 30Mb. So, my question is: where are those 190Mb (roughly)!??? Packing doesn't solve it. Besides, the catalog in my plone site takes about 45minutes to reindex the content and locally about 69seconds. Again, with the same content, same products installed, same python/zope versions etc etc. Please give me some insight. Cheers, Danny

6 9

Recommended books on Python?
by Alan Ezust 18 May '04

18 May '04

I have the first edition of Oreilly but it's terribly out of date and doesn't have many good examples using the a lot of important libraries. What's the best Python book to get these days? -- Alan Ezust ottawa, canada

2 1

Re: Your product
by host＠hi-co.com 17 May '04

17 May '04

This is an autoresponder. I'll never see your message.

1 0

lame newbie product intallation q's...
by Ken Gunderson 17 May '04

17 May '04

Greets Folks: I have really basic question- I want to run a couple different Zope/Plone sites. My assessment is that multiple zope instances offer a better fit for my needs than VHM. Some products will be shared between sites, and others not. My question is where to best install these products and why? Plone docs say INSTANCE_HOME. Seems rather redundant to install multiple copies, so can just maintain one plone product dir somewhere and symlink as needed. Else another possibility is to just put into top level /usr/local/www/Zope/Products dir and let all instances inherit. Or is there some downside to this?? Enlightenment appreciated. Thanks bunches. -- Best regards, Ken Gunderson GPG Key-- 9F5179FD "Freedom begins between the ears." -- Edward Abbey

2 3

CIA~L1S & LEV~ITRA---huqe savings cOmpared to V1AG'RA~ !
by Scarlett Rahman 17 May '04

17 May '04

2 1