- Zope - Zope lists

Copying Data.fs
by John Poltorak 14 Jan '05

14 Jan '05

Would there be any problem in copying Data.fs from one system to another and being able to use it? -- John

5 5

RE: [Zope] Copying Data.fs
by Tariq Rashid 14 Jan '05

14 Jan '05

so is the new Data.fs.index regenerated when Zope is restarted? ps - i've migrated Data.fs successfully and repeatedly between a netbsd 2.0 install a linux server with no issues. (and i didn't copy the .index file, only the Data.fs) tariq -----Original Message----- From: Tim Peters [mailto:tim.peters@gmail.com] Sent: 14 January 2005 14:41 To: zope(a)zope.org Subject: Re: [Zope] Copying Data.fs [John Poltorak] > Would there be any problem in copying Data.fs from one system > to another and being able to use it? You can even move it across operating systems (the FileStorage format is platform-independent). You take a small risk if you try to copy a Data.fs *while* it's in active use, because it's in a temporarily non-sane state during the time a transaction is being committed. More here: http://zope.org/Wikis/ZODB/FileStorageBackup _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

meta flow
by lists＠densxl.de 14 Jan '05

14 Jan '05

hello is there an actual version of the meta-flow-product? and where can i download it? peter w

1 0

Format date fields
by Zorze 14 Jan '05

14 Jan '05

Hi, I'am new to Zope so please excuse me about some stupid questions. How can I format a date field from in a DTML from ZSQL Method e.i.: It shows 2005-01-12 22:49:33:00 but I want to show just 2005-01-12 or change de order of the date :01-12-2005. Thank you for your help. Regards, Zorze

3 8

Re: [Zope] Format date fields
by Zorze 14 Jan '05

14 Jan '05

1 0

Undo problem
by Pascal Peregrina 13 Jan '05

13 Jan '05

Hi, I have made 2 Zope products. One of them is a content object that extends PropertyManager. The : + _update_property + _set_property + _del_property methods have been redefined to add a call to my 2nd product, in order to notify it about the changes. --- code excerpt --- def _del_property(self,id): <call to the PropertyManager method> try: getToolByName(self,'change_tracker').manage_addChange(<params>) except: pass ----- I created an object A of this type. The 2nd product is a tool with a simple PersistentMapping() that store these changes information. --- code excerpt --- def manage_addChange(self,<params>): ... self._changes[<somekey>]=<somevalue> # self._changes is the PersistentMapping self._changes=self._changes #to be sure PersistentMapping is updated in ZODB ... ----- I created an object B of this type. When I modify properties on A, I get the information added to B. So I thought eveything was working fine. Unfortunately, when I undo a change on A (using undo tab in ZMI), information is not removed from B. Can someone tell me what I did wrong ? Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

2 1

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 13 Jan '05

13 Jan '05

> > Andy Yates wrote at 2005-1-5 15:30 -0600: > > ... > >In fact we can reproduce this behavior > >on a fresh install. On a fresh system create a python script that puts > >data in a session object. > > > >s = context.REQUEST.SESSION > >t = ' ' * 1024 > >s['data'] = t > >print "foo" > >return printed > > > >Then call this script with your favorite bench marking program. We used > >apache bench (ab). This will cause python2.3 to consume all available > >memory and crash or lockup. > Can anybody else reproduce these results? > And I am not surprised at all: > > You allow an unlimited number of sessions. > > Your session timeout is 45 minutes > > "ab" does not honour the "set cookie" requests for the sessioning. > Thus, each request creates a new session. > Yes, I understand that ab will not set the cookie and each request will look like a new connection to Zope. That is not the point. The point is that whatever memory is used by these sessions should be released once the session has expired. This does not seem to happen. Memory use just grows and grows until the server dies. We turned on the debug output in Transient.py and the buckets seem to get expired as expected but like I said memory used just grows without bound. For example if I have ab make X requests, X new sessions are created and memory use goes up by 100MB. I also see about X objects in the transient object container. Now I wait for the sessions to expire based on the "Data object timeout value". Then I make a few calls to tickle the Transient system's garbage collection. The objects in the toc goes down but memory use does not. Some have posted that python does not release memory it just reuses it. Well, when I make X more requests the memory is not reused. Now it is using 200MB. > This way, it should not be difficult to use > a large amount of RAM. > My Zope serves about 500 request/s, 30.000 request/min > and 1.350.000 requests in 45 min. > You must expect a number of sessions in this order > > ... > >In a very basic sense this is all our production server does. When a > >user first comes to our site we query a mysql database for several > >hundred values. These values are then stored in the session object as a > >map. All other pages are built dynamically based on the values stored > >in the session object. > > > >Is the session object system just not supposed to be used like this? > > We use the session system in quite a similar way -- without problems. > But, we have a maximal session count of 5.000. > > We, too, observe some increase in memory requirements which we do > not yet understand: memory seems to increase from about 300 MB > to about 600 MB within a week. Therefore, we restart > once every Sunday night. But, the problem has not yet been pressing > and we did not yet seriously tried to understand it. > Consider the problem pressed. ;-) Well, I guess I'll just restart Zope every day for now. Could it be possible that the BTrees code which is written in C is leaking? Memory leaked here would not show up as refcounts in Zope right? It is FULL of malloc and free calls. Isn't this a fairly new addition to Zope? Thanks again for your help and insight! Andy

4 5

TM and commit/abort regarding RDBMS
by Marco Bizzarri 13 Jan '05

13 Jan '05

Hi all. Thanks to suggestions provided by Dieter on this mailing list, we've been successfull in creating transaction-aware objects, which correctly register. My next question is where I could find more information about the protocol used by Zope/ZODB with TM-aware classes. I think it is a two phase commit, but, in this case, I've some doubt. The two phase commit, IIRC, works as follows: phase 1) all the involved parties in a transaction are asked if the transaction should commit or abort phase 2) if all the parties agrees on commit, then commit (i.e. call the commit for) all objects, otherwise abort. Now, if I understand correctly, phase 1) is done in the tpc_vote. According to the implementation of some DA (ZMysqlDA, ZPsycopgDA), the tpc_vote is actually not defined, therefore it will always vote for finalizing. At this point, all transactions will try to commit... including the open database transaction. The question are two: 1) where can I learn more about this process inside Zope? 2) is there a scenario where a commit from Zope will face an abort from the RDB (i.e. Zope will call the commit, and the RDB will refuse due to concurrency problems) ? Thanks to all for patience and support. Regards Marco

2 1

create user from script
by mgagnon1＠gmu.edu 13 Jan '05

13 Jan '05

Is it possible to create / edit objects from within a python script? What I really want to do is have a form which will allow users to create new users. Thanks! -- Mike G

2 1

ZSQL and python script performance
by Sion Morris 13 Jan '05

13 Jan '05

Hi, In an attempt to speed up an application I came across a bottle neck with Python Scripts in Zope. Using apache's 'ab' utility I tested a simple query (sql_course_components) directly with the following URL: ab -n 20 -c 4 'http://myserver/portal_skins/acs/sql_course_components/manage_test?gcom_id= 19030&term_code=200405&SUBMIT=Submit+Query' ----- Requests per second: 23.22 [#/sec] (mean) Using a Python Script (ptest) to return the result from the query is much slower: return context.sql_course_components(gcom_id=19030, term_code=200405) ab -n 20 -c 4 'http://myserver/portal_skins/acs/ptest' ----- Requests per second: 2.59 [#/sec] (mean) I tried the same test with an external method with similar results. Why is there such a big difference between accessing the ZSQL query directly and using a python script (which is needed to process the query in the real application) to return the query? TIA, Sion

2 1