January 2005 - Zope - Zope lists

[ANN] Zope 2.7.4 released
by Andreas Jung 14 Jan '05

14 Jan '05

Dear Zope Community, on behalf of Zope Corporation and all Zope 2 developers and contributors I am pleased to announce the release of Zope 2.7.4. This release is a maintenance release and fixes a lot of bugs (too much to mention them all here). Zope 2.7.4 can be downloaded from http://www.zope.org/Products/Zope/2.7.4 The release notes can be found at http://www.zope.org/Products/Zope/2.7.4/CHANGES.txt For informations on using Python 2.4 with Zope 2.7: see doc/INSTALL.txt Andreas Jung

1 0

RE: [Zope] Undo problem
by Pascal Peregrina 14 Jan '05

14 Jan '05

Ok, I am using Zope 2.7.3, which includes ZODB 3.2.4 In the code below, I am not doing any transaction handling by myself. When I modify A properties, the call to the B method (that modifies B PersistentMapping) is made from the method of A that actually modidies A pesistent data. So why wouldn't A and B object changes be part of the same transaction ? Is there any explicit code to make sure to remain in a single transaction ? Thanks. Pascal -----Message d'origine----- De : Dieter Maurer [mailto:dieter@handshake.de] Envoyé : jeudi 13 janvier 2005 22:34 À : Pascal Peregrina Cc : 'zope(a)zope.org' Objet : Re: [Zope] Undo problem Pascal Peregrina wrote at 2005-1-13 17:00 +0100: > ... 2 objects A and B modified in same transaction ... >Unfortunately, when I undo a change on A (using undo tab in ZMI), >information is not removed from B. > >Can someone tell me what I did wrong ? When the change to A and B happens in the same transaction, then the undo must revert both changes. If it does not, you hit a bug. Note that in older Zope versions, invalidation messages were not sent correctly for "undo" (from ZEO). This was fixed with ZODB 3.2. -- Dieter -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Pascal Peregrina Envoyé : jeudi 13 janvier 2005 17:00 À : 'zope(a)zope.org' Objet : [Zope] Undo problem Hi, I have made 2 Zope products. One of them is a content object that extends PropertyManager. The : + _update_property + _set_property + _del_property methods have been redefined to add a call to my 2nd product, in order to notify it about the changes. --- code excerpt --- def _del_property(self,id): <call to the PropertyManager method> try: getToolByName(self,'change_tracker').manage_addChange(<params>) except: pass ----- I created an object A of this type. The 2nd product is a tool with a simple PersistentMapping() that store these changes information. --- code excerpt --- def manage_addChange(self,<params>): ... self._changes[<somekey>]=<somevalue> # self._changes is the PersistentMapping self._changes=self._changes #to be sure PersistentMapping is updated in ZODB ... ----- I created an object B of this type. When I modify properties on A, I get the information added to B. So I thought eveything was working fine. Unfortunately, when I undo a change on A (using undo tab in ZMI), information is not removed from B. Can someone tell me what I did wrong ? Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

2 1

RE: [Zope] Undo problem
by Pascal Peregrina 14 Jan '05

14 Jan '05

One last thing I noticed : Although when displaying B PersistentMapping content I can see A changes, the undo tab of B says there is nothing to undo (while the undo tab of A says I can undo whatever property change I did to it). B class is declared as extending : UniqueObject, SimpleItem, Persistent Pascal -----Message d'origine----- De : Pascal Peregrina Envoyé : jeudi 13 janvier 2005 23:06 À : 'dieter(a)handshake.de' Cc : 'zope(a)zope.org' Objet : RE: [Zope] Undo problem Ok, I am using Zope 2.7.3, which includes ZODB 3.2.4 In the code below, I am not doing any transaction handling by myself. When I modify A properties, the call to the B method (that modifies B PersistentMapping) is made from the method of A that actually modidies A pesistent data. So why wouldn't A and B object changes be part of the same transaction ? Is there any explicit code to make sure to remain in a single transaction ? Thanks. Pascal -----Message d'origine----- De : Dieter Maurer [mailto:dieter@handshake.de] Envoyé : jeudi 13 janvier 2005 22:34 À : Pascal Peregrina Cc : 'zope(a)zope.org' Objet : Re: [Zope] Undo problem Pascal Peregrina wrote at 2005-1-13 17:00 +0100: > ... 2 objects A and B modified in same transaction ... >Unfortunately, when I undo a change on A (using undo tab in ZMI), >information is not removed from B. > >Can someone tell me what I did wrong ? When the change to A and B happens in the same transaction, then the undo must revert both changes. If it does not, you hit a bug. Note that in older Zope versions, invalidation messages were not sent correctly for "undo" (from ZEO). This was fixed with ZODB 3.2. -- Dieter -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Pascal Peregrina Envoyé : jeudi 13 janvier 2005 17:00 À : 'zope(a)zope.org' Objet : [Zope] Undo problem Hi, I have made 2 Zope products. One of them is a content object that extends PropertyManager. The : + _update_property + _set_property + _del_property methods have been redefined to add a call to my 2nd product, in order to notify it about the changes. --- code excerpt --- def _del_property(self,id): <call to the PropertyManager method> try: getToolByName(self,'change_tracker').manage_addChange(<params>) except: pass ----- I created an object A of this type. The 2nd product is a tool with a simple PersistentMapping() that store these changes information. --- code excerpt --- def manage_addChange(self,<params>): ... self._changes[<somekey>]=<somevalue> # self._changes is the PersistentMapping self._changes=self._changes #to be sure PersistentMapping is updated in ZODB ... ----- I created an object B of this type. When I modify properties on A, I get the information added to B. So I thought eveything was working fine. Unfortunately, when I undo a change on A (using undo tab in ZMI), information is not removed from B. Can someone tell me what I did wrong ? Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

2 1

Copying Data.fs
by John Poltorak 14 Jan '05

14 Jan '05

Would there be any problem in copying Data.fs from one system to another and being able to use it? -- John

5 5

RE: [Zope] Copying Data.fs
by Tariq Rashid 14 Jan '05

14 Jan '05

so is the new Data.fs.index regenerated when Zope is restarted? ps - i've migrated Data.fs successfully and repeatedly between a netbsd 2.0 install a linux server with no issues. (and i didn't copy the .index file, only the Data.fs) tariq -----Original Message----- From: Tim Peters [mailto:tim.peters@gmail.com] Sent: 14 January 2005 14:41 To: zope(a)zope.org Subject: Re: [Zope] Copying Data.fs [John Poltorak] > Would there be any problem in copying Data.fs from one system > to another and being able to use it? You can even move it across operating systems (the FileStorage format is platform-independent). You take a small risk if you try to copy a Data.fs *while* it's in active use, because it's in a temporarily non-sane state during the time a transaction is being committed. More here: http://zope.org/Wikis/ZODB/FileStorageBackup _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

meta flow
by lists＠densxl.de 14 Jan '05

14 Jan '05

hello is there an actual version of the meta-flow-product? and where can i download it? peter w

1 0

Re: [Zope] Format date fields
by Zorze 14 Jan '05

14 Jan '05

1 0

Format date fields
by Zorze 14 Jan '05

14 Jan '05

Hi, I'am new to Zope so please excuse me about some stupid questions. How can I format a date field from in a DTML from ZSQL Method e.i.: It shows 2005-01-12 22:49:33:00 but I want to show just 2005-01-12 or change de order of the date :01-12-2005. Thank you for your help. Regards, Zorze

3 8

Undo problem
by Pascal Peregrina 13 Jan '05

13 Jan '05

Hi, I have made 2 Zope products. One of them is a content object that extends PropertyManager. The : + _update_property + _set_property + _del_property methods have been redefined to add a call to my 2nd product, in order to notify it about the changes. --- code excerpt --- def _del_property(self,id): <call to the PropertyManager method> try: getToolByName(self,'change_tracker').manage_addChange(<params>) except: pass ----- I created an object A of this type. The 2nd product is a tool with a simple PersistentMapping() that store these changes information. --- code excerpt --- def manage_addChange(self,<params>): ... self._changes[<somekey>]=<somevalue> # self._changes is the PersistentMapping self._changes=self._changes #to be sure PersistentMapping is updated in ZODB ... ----- I created an object B of this type. When I modify properties on A, I get the information added to B. So I thought eveything was working fine. Unfortunately, when I undo a change on A (using undo tab in ZMI), information is not removed from B. Can someone tell me what I did wrong ? Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

2 1

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 13 Jan '05

13 Jan '05

> > Andy Yates wrote at 2005-1-5 15:30 -0600: > > ... > >In fact we can reproduce this behavior > >on a fresh install. On a fresh system create a python script that puts > >data in a session object. > > > >s = context.REQUEST.SESSION > >t = ' ' * 1024 > >s['data'] = t > >print "foo" > >return printed > > > >Then call this script with your favorite bench marking program. We used > >apache bench (ab). This will cause python2.3 to consume all available > >memory and crash or lockup. > Can anybody else reproduce these results? > And I am not surprised at all: > > You allow an unlimited number of sessions. > > Your session timeout is 45 minutes > > "ab" does not honour the "set cookie" requests for the sessioning. > Thus, each request creates a new session. > Yes, I understand that ab will not set the cookie and each request will look like a new connection to Zope. That is not the point. The point is that whatever memory is used by these sessions should be released once the session has expired. This does not seem to happen. Memory use just grows and grows until the server dies. We turned on the debug output in Transient.py and the buckets seem to get expired as expected but like I said memory used just grows without bound. For example if I have ab make X requests, X new sessions are created and memory use goes up by 100MB. I also see about X objects in the transient object container. Now I wait for the sessions to expire based on the "Data object timeout value". Then I make a few calls to tickle the Transient system's garbage collection. The objects in the toc goes down but memory use does not. Some have posted that python does not release memory it just reuses it. Well, when I make X more requests the memory is not reused. Now it is using 200MB. > This way, it should not be difficult to use > a large amount of RAM. > My Zope serves about 500 request/s, 30.000 request/min > and 1.350.000 requests in 45 min. > You must expect a number of sessions in this order > > ... > >In a very basic sense this is all our production server does. When a > >user first comes to our site we query a mysql database for several > >hundred values. These values are then stored in the session object as a > >map. All other pages are built dynamically based on the values stored > >in the session object. > > > >Is the session object system just not supposed to be used like this? > > We use the session system in quite a similar way -- without problems. > But, we have a maximal session count of 5.000. > > We, too, observe some increase in memory requirements which we do > not yet understand: memory seems to increase from about 300 MB > to about 600 MB within a week. Therefore, we restart > once every Sunday night. But, the problem has not yet been pressing > and we did not yet seriously tried to understand it. > Consider the problem pressed. ;-) Well, I guess I'll just restart Zope every day for now. Could it be possible that the BTrees code which is written in C is leaking? Memory leaked here would not show up as refcounts in Zope right? It is FULL of malloc and free calls. Isn't this a fairly new addition to Zope? Thanks again for your help and insight! Andy

4 5