January 2005 - Zope - Zope lists

Memory and Large Zope Page Templates
by Santi Camps 20 Jan '05

20 Jan '05

Hi all, I'm trying to understand some questions about Zope and Memory management. I've configured a Zope with minimal Cache settings: 100 objects of cache, 4 threads and 20 Mb of ZEO Cache. The Storage is a DirectoryStorage of 4Gb. Monitoring the Zope process, all is running fine: it takes about 30 Mb of RAM. I've see that just 2 of the threads are working. The problem begins when I execute a report. The report is a PageTemplateFile that calls a method to obtain a list of processed results and send them to the user. It takes some time of process, but it works fine. What I don't understand is why, after this report, Zope is taking 120 Mb of RAM !! Too much for the cache I have. I've look for for a memory leak, showing refcounts in method like this: def _get_refcounts(self): import sys import types d = {} sys.modules # collect all classes for m in sys.modules.values(): for sym in dir(m): o = getattr (m, sym) if type(o) is types.ClassType: d[o] = sys.getrefcount(o) # sort by refcount pairs = map (lambda x: (x[1],x[0]), d.items()) pairs.sort() pairs.reverse() return pairs But there is nothing rare. I can see how the refcounts of some objects are heavely incresed during the process of the report, but when finished they are freed. But RAM of the Zope process don't decrease. Anybody have an explanation ? It's recomended to run this kind of reports in a new process ? In this case, there are any products to help this way ? Thanks in advance Santi Camps

4 7

Mailman integration with Zope
by zope-list＠mcvfifesanddrums.org 20 Jan '05

20 Jan '05

I asked this on the Mailman list, but got nothing but crickets (come to think of it, maybe I should have asked on the developer's list....) Is there any ongoing, current work on integrating Mailman with Zope? I read something somewhere that said there was such a project, but I can't find any recent work or activity. I currently use Mailman for my mailing lists and am embarking on rebuilding a Zope/Plone based site. Integrating it with Mailman would be ideal. Thanks in advance, Jeff D ---- Jeff Donsbach Webmaster (and bass drummer) Middlesex County Volunteers Fifes and Drums http://www.mcvfifesanddrums.org/

2 1

RE: [Zope] http header question
by Nathaniel Wingfield 19 Jan '05

19 Jan '05

OK, I found the solution and it's really wacky. Apparently IE is misreading the header, and if the word "attachment" shows up anywhere on the Content-Disposition line, including in the file name itself, it will spawn the dialog. For example, the following will cause IE to launch the open/save/cancel dialog every time: Content-Disposition: inline; filename="spb_bar_codes_attachment.pdf" While the following will launch the plugin every time: Content-Disposition: inline; filename="spb_bar_codes_xyz.pdf" -----Original Message----- From: Phillip Hutchings [mailto:sitharus@gmail.com] Sent: Wednesday, January 19, 2005 3:50 PM To: Nathaniel Wingfield Cc: zope(a)zope.org Subject: Re: [Zope] http header question On Wed, 19 Jan 2005 12:24:25 -0500, Nathaniel Wingfield <NWingfield(a)dixon-hughes.com> wrote: > > My application streams pdf files from disk (not zodb) to the user, and I've > been writing the http header more or less manually. I've had some strange > problems with downloading - one particular third-party pdf plugin acts as if > the file can not be found, and Internet Explorer arbitrarily, yet > consistently pops the Open/Save/Cancel dialog for 1% of files, while > launching a plugin for the other 99%. > > My header looks like this: > > HTTP/1.1 200 OK > Server: Zope/(Zope 2.7.3-0, python 2.3.4, linux2) ZServer/1.1 > Date: Wed, 19 Jan 2005 17:08:30 GMT > Content-Length: 20004 > Content-Type: application/pdf > Connection: close > Content-Disposition: filename="attachment.pdf" > > Is there anything missing or malformed that could be causing trouble? I had this problem with PHP powered site. IE would always ask to save and never display with the plugin. Even when the headers were identical it wouldn't work, but everything other than IE worked. I just ended up serving directly with Apache. A quick thing first, the Content-Disposition header should look like this: Content-Disposition: inline; filename="attachment.pdf" to make IE display in the PDF plugin. -- Phillip Hutchings http://www.sitharus.com/ sitharus(a)gmail.com / sitharus(a)sitharus.com ID:[{20050119155530.24590.7625540730-66.208.180.43}] _______________________________________________ CONFIDENTIALITY NOTICE This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation. ID:[{20050119161840.24590.7613879936-66.208.180.43}]

1 0

metal Macros from PageTemplateFiles?
by Robert Casties 19 Jan '05

19 Jan '05

Is it possible (and how?) to use a procedure in a product to produce a PageTemplate that defines a macro, that can be used in another PageTemplate? I tried: class SomeClass(Folder): content_template = PageTemplateFile("/some/file/template.zpt") and the direct ssignment to a variable works, but it is not exactly what I need (I need to check with the actual instance). But when I try to do: def content_template(self): pt = PageTemplateFile("/some/file/template.zpt") return pt then the procedure is never called and I get an error in the ZPT that tries to use the macro: Error Type: AttributeError Error Value: content_templatemacros Somewhere I read a vage reference to invoke "cook" but I don't know how. Thanks Robert

3 4

http header question
by Nathaniel Wingfield 19 Jan '05

19 Jan '05

My application streams pdf files from disk (not zodb) to the user, and I've been writing the http header more or less manually. I've had some strange problems with downloading - one particular third-party pdf plugin acts as if the file can not be found, and Internet Explorer arbitrarily, yet consistently pops the Open/Save/Cancel dialog for 1% of files, while launching a plugin for the other 99%. My header looks like this: HTTP/1.1 200 OK Server: Zope/(Zope 2.7.3-0, python 2.3.4, linux2) ZServer/1.1 Date: Wed, 19 Jan 2005 17:08:30 GMT Content-Length: 20004 Content-Type: application/pdf Connection: close Content-Disposition: filename="attachment.pdf" Is there anything missing or malformed that could be causing trouble? Nathaniel _______________________________________________ CONFIDENTIALITY NOTICE This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation. ID:[{20050119123043.24590.577798887-66.208.180.43}]

3 2

generating an acquisition wrapper from generated code
by davelists2＠peoplemerge.com 19 Jan '05

19 Jan '05

Hi all, ====Aclass.py==== class Aclass(ZSI.TCcompound.Struct): def __init__: self._attr = "Attribute" def getAttr(): return self.attr ====myTool.py==== from Aclass import Aclass from Globals import InitializeClass from OFS.SimpleItem import SimpleItem from AccessControl import ClassSecurityInfo from Products.CMFCore.utils import getToolByName, UniqueObject from Products.CMFCore import CMFCorePermissions class myTool(SimpleTool,UniqueObject): meta_type="myTool" id="myTool" def getAclass(self): inter = [base.Aclass(),] return inter Now I want to myTool.getAclass().getAttr() What's by importing myTool from unrestricted python, there's no problem. When I access the tool from a (restricted) script or ZPT, it gives me: Insufficient Privileges or AccessControl.unauthorized.Unauthorized: You are not allowed to access 'getAttr' in this context. I gather (thanks kosh@freenode#zope) that I need to wrap the objects in inter in an acquisition wrapper. But I can't inherit from SimpleItem as well as ZSI.TCcompound.Struct: File "/usr/lib/python2.3/site-packages/ZSI/TCcompound.py", line 65, in __init__ raise TypeError('pyclass must be None or a class, not <extension class ExtensionClass at f6b..> Any Suggestions? Thanks... And sorry for my bad python. This pseudocode should be an accurate representation of what I get from ZSI's wsdl2py from Amazon's Web Services 3.0 WSDL. Complex stuff, so try to not suggest something that would require I change Aclass -- been down that road already.

2 4

Clearing _v_ attributes
by Pascal Peregrina 19 Jan '05

19 Jan '05

Hi, To clear some data caching I have made using _v_ attributes on one particular object, I would need a way to programmatically clear its _v_ attributes. As far as I understand, _v_ attributes are set per ZODB connection. And they are cleared when the object is, for some reason, reloaded from the ZODB to the connection cache. As I use the current configuration : + ZEO + 1 Zope instance with RW connections to ZEO + several Zope instances with RO connections to ZEO I was wondering if, setting self._p_changed=1 on the object from the Zope RW would work. Thanks for your help. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

3 2

Hou to write out a dutch (european) currency
by Martin Koekenberg 19 Jan '05

19 Jan '05

Hello, I want to write out a Currency in euro's : € 1.234,10 But when I use <dtml-var stand fmt="%.2f"> I get € 1234.10. What is the right fmt tag for this ? Thanks, Martin

2 1

RE: [Zope] http header question
by Pascal Peregrina 19 Jan '05

19 Jan '05

Have you tried actually uploading a PDF File (as a ZODB File object) in Zope, then setting the content-type to application/pdf, in order to compare the headers you get when requesting that file ? Pascal P.S. : please use text format when posting to the Zope mailing-lists. :)) -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Nathaniel Wingfield Envoyé : mercredi 19 janvier 2005 18:24 À : zope(a)zope.org Objet : [Zope] http header question My application streams pdf files from disk (not zodb) to the user, and I've been writing the http header more or less manually. I've had some strange problems with downloading - one particular third-party pdf plugin acts as if the file can not be found, and Internet Explorer arbitrarily, yet consistently pops the Open/Save/Cancel dialog for 1% of files, while launching a plugin for the other 99%. My header looks like this: HTTP/1.1 200 OK Server: Zope/(Zope 2.7.3-0, python 2.3.4, linux2) ZServer/1.1 Date: Wed, 19 Jan 2005 17:08:30 GMT Content-Length: 20004 Content-Type: application/pdf Connection: close Content-Disposition: filename="attachment.pdf" Is there anything missing or malformed that could be causing trouble? Nathaniel _______________________________________________ CONFIDENTIALITY NOTICE This e-mail is intended only for the addressee named above. It contains information that is privileged, confidential or otherwise protected from use and disclosure. If you are not the intended recipient, you are hereby notified that any review, disclosure, copying, or dissemination of this transmission, or taking of any action in reliance on its contents, or other use is strictly prohibited. If you have received this transmission in error, please reply to the sender listed above immediately and permanently delete this message from your inbox. Thank you for your cooperation. ID:[{20050119123043.24590.577798887-66.208.180.43}] ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

1 0

RE: [Zope] Clearing _v_ attributes
by Pascal Peregrina 19 Jan '05

19 Jan '05

Pointers about what ? If you mean about "And your ZODB grows everytime you want to flush the cache..." : Andrew is just saying that changing a persistent attribute of an object will led to storing a new version of the object in the ZODB. If you mean about "why I was asking how to clear _v_ attributes" : I am using CMF 1.5.0 and SpeedPack 0.3, which monkey patches 2 CMF classes to speed up skinned objects lookup by caching the result of previous lookups in a new _v_ attribute on "CMF Site" objects. The performance increase is huge (if you have lots of skins defined, and lots of folders for each skin to be traversed). However, the situations that SpeePack "catches" to decide to clear the _v_ attribute data are not enough for my needs. I need a way to make sure that data is flushed in all connections. Hope this answer your question. Pascal -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Marco Bizzarri Envoyé : mercredi 19 janvier 2005 14:27 À : Andrew Milton Cc : zope(a)zope.org Objet : Re: [Zope] Clearing _v_ attributes Andrew Milton wrote: > +-------[ Toby Dickenson ]---------------------- > | On Wednesday 19 January 2005 11:51, Andrew Milton wrote: > | > +-------[ Pascal Peregrina ]---------------------- > | > | If I do a clearCaches() method that clears _v_ attributes on the object, > | how > | > | can I make sure it will clear these attributes in all the Zope connections > | > | that may have a cached copy of the object ? > | > > | > Basically you can't. > | > | There is one very obvious way.... change a non-_v_ attribute of the object and > | commit it. Every other connection with an instance of that object in memory > | will lose the _v_ attribute at its next transaction boundary. > > And your ZODB grows everytime you want to flush the cache... > Could you please further detail the reason of the above (or provide pointers on this?) Regards Marco _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

1 0