January 2005 - Zope - Zope lists

ZEO connections cache
by Pascal Peregrina 06 Jan '05

06 Jan '05

Hi, I am using Zope 2.7.3 with this configuration : + a ZEO instance with one ZODB + a Zope instance with Read/Write connections to the whole ZEO ZODB + several Zope instances with Read Only connections to one folder of the ZEO ZODB (+ a small local ZODB for the root folder, that never changes) It looks like some object changes (specially objects located in CMF portal_skins subfolders), are not always "seen" from one connection to another (either on the Zope instance where the changes were made or any other Zope instance). The problem is fixed when I minimize the connection caches. Anyone knows what could cause such an issue ? It appeared with Zope 2.7.3... (was ok on 2.7.2) But as we did other changes at the same time, I am 100% sure it's because of the Zope upgrade itself. Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

3 2

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 06 Jan '05

06 Jan '05

> > You did this flushing and looking at the reference counts in > a process that already had run for several days (and therefore was quite > huge)? > It took about 24 hours. > > Do you use C extensions that create non-Python objects (and > therefore do not have reference counts and show up in the list)? > Maybe, such a C extension is leaking. No we do not use C extensions. In fact we can reproduce this behavior on a fresh install. On a fresh system create a python script that puts data in a session object. s = context.REQUEST.SESSION t = ' ' * 1024 s['data'] = t print "foo" return printed Then call this script with your favorite bench marking program. We used apache bench (ab). This will cause python2.3 to consume all available memory and crash or lockup. The speed at which this happens depends on the amount of data you assign to 't' and how fast you call the script. The session timeout does not seem to affect the memory use. We even tried setting the session timeout to 1 minute. In a very basic sense this is all our production server does. When a user first comes to our site we query a mysql database for several hundred values. These values are then stored in the session object as a map. All other pages are built dynamically based on the values stored in the session object. Is the session object system just not supposed to be used like this? > > Are your sessions huge? > Usually, they are stored as pickles in RAM. > If they were huge, some thousands of sessions might > consume a considerable amount of RAM. You would not see > them in the reference counts because Pickles are strings > and you see only instances. > > -- > Dieter I would say they are less than 15K each. Andy

3 2

Zope slow if left unused for hours
by Jeff Rodriguez 06 Jan '05

06 Jan '05

I'm running Zope with Plone, specifically the windows installer version distributed on the Plone website. The first time I hit the site (even the ZMI) the first page takes a long time to load; everything after that is speedy. I'm thinking it's some sort of caching issue but I'm not sure where to look to remedy the probelm. I am not running debug mode either. Info from control panel: Zope Version (unreleased version, python 2.3.3, win32) Python Version 2.3.3 (#51, Dec 18 2003, 20:22:39) [MSC v.1200 32 bit (Intel)] System Platform win32 SOFTWARE_HOME C:\Program Files\Plone 2\Zope\lib\python ZOPE_HOME C:\Program Files\Plone 2\Zope INSTANCE_HOME C:\Program Files\Plone 2\Data CLIENT_HOME C:\Program Files\Plone 2\Data\var Network Services ZServer.HTTPServer.zhttp_server (Port: 80) ZServer.HTTPServer.zhttp_server (Port: 8080) Process Id 1964 (3048) Running For 1 day 17 hours 6 min 34 sec -- Jeffrey Alan Rodriguez Jeffrey.Rodriguez(a)gmail.com

3 3

RE: [Zope] Zope slow if left unused for hours
by Pascal Peregrina 06 Jan '05

06 Jan '05

This is because the first time you make a request to your Zope instance, it retrieves lots of objects from the ZODB (file). For subsequent requests, most of this objects are cached in a connection object cache. See your /Control_Panel/Database/manage_workspace, select a database, and then have a look at the Cache Parameters tab. There is one cache per connection, and usually there are 4 connections to the ZODB. But in general, under reasonable load on your site, the cache should be efficient. I don't know of any way of optimizing this. Hope this helps. Pascal -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Jeff Rodriguez Envoyé : jeudi 6 janvier 2005 17:31 À : zope(a)zope.org Objet : [Zope] Zope slow if left unused for hours I'm running Zope with Plone, specifically the windows installer version distributed on the Plone website. The first time I hit the site (even the ZMI) the first page takes a long time to load; everything after that is speedy. I'm thinking it's some sort of caching issue but I'm not sure where to look to remedy the probelm. I am not running debug mode either. Info from control panel: Zope Version (unreleased version, python 2.3.3, win32) Python Version 2.3.3 (#51, Dec 18 2003, 20:22:39) [MSC v.1200 32 bit (Intel)] System Platform win32 SOFTWARE_HOME C:\Program Files\Plone 2\Zope\lib\python ZOPE_HOME C:\Program Files\Plone 2\Zope INSTANCE_HOME C:\Program Files\Plone 2\Data CLIENT_HOME C:\Program Files\Plone 2\Data\var Network Services ZServer.HTTPServer.zhttp_server (Port: 80) ZServer.HTTPServer.zhttp_server (Port: 8080) Process Id 1964 (3048) Running For 1 day 17 hours 6 min 34 sec -- Jeffrey Alan Rodriguez Jeffrey.Rodriguez(a)gmail.com _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

1 0

Re: searching in different servers
by Tres Seaver 06 Jan '05

06 Jan '05

osmarmantovani(a)globo.com wrote: > I read your answer to the question "how to query multiple catalogs using > search button?" at mail.zope.org and I would like to ask you another one... > Is it possible to search the catalogs in different plone servers? Sorry for the delayed response. I would recommend asking / CC'ing the list, so that you get the benefit of the whole community's experience. I have CC'ed the list. WRT to your question: I don't know of any off-the-shelf way to do what you ask. We have built solutions for such problems based around syndicating RSS from "spoke" sites to a "hub" site, but the software isn't part of any freely-available offering. Mike Pelletier has an RDF-based product which might be of interest: http://zemantic.org/ Tres. -- =============================================================== Tres Seaver tseaver(a)zope.com Zope Corporation "Zope Dealers" http://www.zope.com

1 0

Re: return a pdf from a python script
by Sam Boggess 05 Jan '05

05 Jan '05

I figured out how to return a pdf from a python script: context.REQUEST.RESPONSE.setHeader('Content-Type','application/pdf') return context['blach.pdf'] Sam

2 1

return a pdf from a python script
by Sam Boggess 05 Jan '05

05 Jan '05

Could someone please tell me how I can return a pdf from a python script? return context.blah.pdf() does not work. thanks

4 3

Hiding header?
by Shane Graber 05 Jan '05

05 Jan '05

Is it possible to hide the header that Zope advertises? Currently, Zope is advertising "Server: Zope/(Zope 2.7.3-0, python 2.3.4, linux2) ZServer/1.1 Plone/2.0.5", that is forwarded as is by Apache. I know that apache can be set to hide its current version. It would be nice if we could do the same with Zope. Is this possible? Where/how do we do it? Shane

4 3

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 05 Jan '05

05 Jan '05

> -----Original Message----- > From: Dieter Maurer [mailto:dieter@handshake.de] > Sent: Monday, January 03, 2005 12:29 PM > To: Andy Yates > Cc: zope(a)zope.org > Subject: RE: [Zope] Zope 2.7.3 Memory Leaks > > Andy Yates wrote at 2005-1-3 09:06 -0600: > > ... > >I've been watching the debug page in the control panel and the refcounts > >fluctuate up and down by small amounts but the trend is always up. They > >never seem to level off, they always climb. > > > >Is this typical or does this suggest a problem? > > Flush the ZODB caches ("Control_Panel --> Database Management --> > <database> --> "Flush cache" --> "minimize"). > > After that, all reference counts should be small. > If not, you have a leak. The classes with high reference counts > probably will give you glues which objects are leaking... > After flushing main and temporary Class January 2, 2005 5:57 pm January 3, 2005 12:54 pm Delta DocumentTemplate.DT_In.InClass 37 53 +16 compiler.misc.Set 10 19 +9 compiler.pyassem.PyFlowGraph 9 15 +6 compiler.visitor.ASTVisitor 8 14 +6 RestrictedPython.RCompile.RestrictedExpressionCodeGenerator 9 14 +5 compiler.ast.Compare 6 11 +5 compiler.pyassem.Block 5 9 +4 pyrad.dictionary.Dictionary 4 8 +4 pyrad.client.Client 4 8 +4 compiler.ast.Const 10 13 +3 compiler.ast.Expression 8 11 +3 DocumentTemplate.DT_With.With 8 11 +3 compiler.symbols.SymbolVisitor 3 6 +3 compiler.ast.Name 18 20 +2 App.ApplicationManager.DebugManager 7 9 +2 compiler.pycodegen.LocalNameFinder 5 7 +2 compiler.misc.Stack 5 7 +2 compiler.pycodegen.ClassCodeGenerator 4 6 +2 DocumentTemplate.DT_Var.Var 25 26 +1 compiler.pycodegen.FunctionCodeGenerator 7 8 +1 compiler.symbols.ModuleScope 4 5 +1 compiler.pyassem.LineAddrTable 4 5 +1 RestrictedPython.RCompile.RestrictedFunctionCodeGenerator 3 4 +1 OK so the numbers are small. This means there is no leak right? It may not be leaking, but python still consumes all available memory and dies unless I restart Zope every few days. ;-) > > ... > >Products.Transience.TransientObject.TransientObject 4041 14891 > >+10850 > > It is strange that you have that many session objects... > > What is your session limit? What is your session exiration time? > Maximum number of subobjects is infinite (0) Data object timeout is 45 minutes Andy

3 3

Re: [Zope] Hiding header?
by Shane Graber 05 Jan '05

05 Jan '05

And where would one find the source for this information in the Zope source code? Shane On Wed, 05 Jan 2005 07:28:56 +0100, Andreas Jung <lists(a)andreas-jung.com> wrote: > > > --On Mittwoch, 5. Januar 2005 1:22 Uhr -0500 Shane Graber > <sgraber(a)gmail.com> wrote: > > > Is it possible to hide the header that Zope advertises? > > > > Currently, Zope is advertising "Server: Zope/(Zope 2.7.3-0, python > > 2.3.4, linux2) ZServer/1.1 Plone/2.0.5", that is forwarded as is by > > Apache. > > > > I know that apache can be set to hide its current version. It would > > be nice if we could do the same with Zope. Is this possible? > > Where/how do we do it? > > > > Likely by hacking the sources. > > -aj >

6 16