August 2001 - Zope-Dev

RE: [Zope-dev] RE:: Zope 2.4.1 beta 1 released
by Randall F. Kern 27 Aug '01

27 Aug '01

Just with regard to severity, the bug Martijn is referring to results in big nasty data destroying bugs with 2.3 spec products. -Randy > -----Original Message----- > From: Martijn Faassen [mailto:faassen@vet.uu.nl] > Sent: Saturday, August 25, 2001 6:04 AM > To: Brian Lloyd > Cc: zope-dev(a)zope.org > Subject: Re: [Zope-dev] RE:: Zope 2.4.1 beta 1 released > > > Brian Lloyd wrote: > [snip] > > I don't know that I can allay your dissappointment, but I didn't > > want this to go by unanswered. > [snip good stuff] > > I'll take the opportunity to complain about the non-reversion of the > latest change to OFS/CopySupport.py. Of course I already have to > support this new broken behavior in Formulator to support 2.4.0, but > I'd like to have some hope this'll be reverted. See: > > http://classic.zope.org:8080/Collector/2442/view > > See also this thread: > > http://lists.zope.org/pipermail/zope-dev/2001-July/012392.html > > And also this here: > > http://lists.zope.org/pipermail/zope-dev/2001-July/012398.html > > Regards, > > Martijn > > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) >

2 1

ANNOUNCE: Zope 2.4.1 beta 1 released
by Brian Lloyd 25 Aug '01

25 Aug '01

Hello all, Zope 2.4.1 beta 1 has been released - you can download it from Zope.org: http://www.zope.org/Products/Zope/2.4.1b1/ Zope 2.4.1 contains several fixes including fixes to product auto-refresh, WebDAV locking and the ZCatalog. It also contains all hotfixes to date. For more information on what is new in this release, see the CHANGES.txt and HISTORY.txt files for the release: http://www.zope.org/Products/Zope/2.4.1b1/CHANGES.txt http://www.zope.org/Products/Zope/2.4.1b1/HISTORY.txt For more information on the available Zope releases, guidance for selecting the right distribution and installation instructions, please see: http://www.zope.org/Documentation/Misc/InstallingZope.html Brian Lloyd brian(a)zope.com Zope Corporation www.zope.com

3 3

"Record" instances and therefore Z SQL brains behave strange
by Dieter Maurer 25 Aug '01

25 Aug '01

For the archives: "Record" instances and instances of derives classes are very strange objects. * they do not have a "__dict__" attribute * they define a "__setattr__" that allows to modify the "Record" attributes but raise an Attribute Error if one tries to modify any other attribute. As a consequence, there are no instance attributes beside that defined by the record schema. This applies especially to Z SQL Method brains. They cannot use instance attributes. What a mess! Dieter

1 0

Patchs to TreeTag.py and DT_Var.py (xhtml issues)
by Hélio Nunes 25 Aug '01

25 Aug '01

Hi, I don't know if here is the best place to send patches... If not, tell-me. It can be questionable: DT_Var.py (newline_to_br): if find(v,' ') >= 0: v=join(split(v,' '), ' ') But ll be very nice for post python code in zope.org :) Cya. -- [], Helio Nunes (dedalu(a)linuxbr.com.br) counter.li.org -> 76442 (jun/97)

1 0

RE: [Zope-dev] Memory Leak debug - help
by J�lio Dinis Silva 25 Aug '01

25 Aug '01

>I use a catalog-intensive setup, and my memory footprint for Zope >seems to slowly increase over several days. Might this be a leak? >On my 2 ZEO identical clients, I get about an average of 50-60 >catalog queries per minute each, and load is distributed equally >(round-robin) over the 2 nodes by my proxy server. Both nodes were >restarted at the same time yesterday, yet the one node that performed >a re-indexing of about 16,000 objects early this morning has an RSS >of 242 MB vs. 219 MB on the other node. The RSS on both nodes had >grown to over 450 MB earlier yesterday before I restarted Zope, so I >wonder if that is a leak, esp. in regard to re-indexing a catalog, or >something else. I know one can do some bad coding that leads into memory leaks. The first one is when you perform a query in a zcatalog. Its very common to put results in the REQUEST using REQUEST.set. This procedure creates a potencial risk for memory leaks. I actually tracked one down: I had a heavy query to a zcatalog that each time it was executed the python footprint increased in 5 Mb when query started and decrease 3Mb as query ends "leaking" 2Mb. I was using the REQUEST.set code and after converting this into a set of dtml-let and dtml-return the "leak" from executing the mentioned query was no more, ceased to be. Another thing I done was to track down code which create objects and dont implement nothing to delete them from memory. The tipical error is, for instance, when you in a external method do something like: ---------------- file = open('BIG','r') buffer = file.read(4000000) [... execute some code with buffer ...] del buffer return something ---------------- Most people forget the "del buffer" part. Another possibility I ran was concerned with the new BTree implementation since zope2-I-dont-remember-version. With this new BTrees one can use a manage_convertBTrees to convert the existing catalogs to the new implementation. I converted all my zcatalogs to this new implementation and, I cant put my hands on fire for this but, I think the leaks started to increase. And this rumour gain another strength when I saw on Top of RefCounts this BTree class, which is a C extension and probably impossible to patch with the leakFinder, just like Shane said. I'll continue to look on zcatalogs because of this relation between the manage_convertBtrees and the finding of BTrees.IIBtree.IIBucket at the top of my servers refcount. Regards, Julio Dinis Silva _________________________________________________________________ Get your FREE download of MSN Explorer at http://explorer.msn.com/intl.asp

2 1

What can cause an InvalidObjectReference?
by kosh 24 Aug '01

24 Aug '01

When a product I have was stuck on a windows server this seems to happen a lot. On the unix servers I have been running the product on normally this seems to happen about once/week under pretty heavy usage. This is the error message Error Type: InvalidObjectReference Error Value: Attempt to store an object from a foreign database connection This is the traceback for it Traceback (innermost last): File D:\ZOPE1\lib\python\ZPublisher\Publish.py, line 223, in publish_module File D:\ZOPE1\lib\python\ZPublisher\Publish.py, line 187, in publish File D:\ZOPE1\lib\python\Zope\__init__.py, line 221, in zpublisher_exception_hook File D:\ZOPE1\lib\python\ZPublisher\Publish.py, line 175, in publish File D:\ZOPE1\lib\python\Zope\__init__.py, line 235, in commit File D:\ZOPE1\lib\python\ZODB\Transaction.py, line 300, in commit File D:\ZOPE1\lib\python\ZODB\Connection.py, line 375, in commit (Info: (('Products.CompoundDoc.inputtext', 'InputText'), '\000\000\000\000\000\000-t', '')) InvalidObjectReference: (see above) I am mostly wondering what kinds of things in my code could cause this problem. Mostly I need a place to start to try and debug this. The "fix" I have normally used is that if I hit refresh the problem will go away until it happens again. It just allows you to keep working with it again until whatever it is that causes it causes it again. I hope that helps some also. Thanks Kosh

4 5

uncatchable 'Bad Request' exceptions ?
by Florent Guillaume 24 Aug '01

24 Aug '01

I guess this is the better place to ask this. Zope 2.3.3, python 1.5.2. >From a python script I can't seem to catch a 'Bad Request' exception. This doesn't work: # script1 raise 'Bad Request', 'foo' # script2 try: context.script1() except 'Bad Request', x: return x return 'nothing' I get a Zope error: Error Type: Bad Request Error Value: foo But the following one works... # script1 raise 'bar', 'foo' # script2 try: context.script1() except 'bar', x: return x return 'nothing' And this one too... # script1 raise 'Bad Request', 'foo' # script2 try: context.script1() except: return 'something' return 'nothing' Anyone has an idea ? The exception is raised by another product which I don't want to touch (CMF RegistrationTool), and I think I should be able to catch them ! Florent Guillaume Nuxeo

2 2

unittest best-practices with Zope.
by Erik Enge 24 Aug '01

24 Aug '01

Bonjour, I'm wondering, when testing big zope applications, with a lot of interdependencies (say, you need to create object A before creating B), and in the spirit of _unit_ tests, do one let all the tests run and then pull a serious tearDown at the end of the suite to delete/clean up? Or does on set up everything for each test?

3 2

pthreads and BSD
by Giorgos Verigakis 24 Aug '01

24 Aug '01

Hello, I was having some problems on Zope's perfomance on FreeBSD and OpenBSD. I've sent some mails to zope/freebsd-hackers and openbsd-tech but I couldn't get any usefull info. To summarize, I've written a small program (see below) that makes a lot of requests to Zope. While on Linux I didn't have any problems, on FreeBSD and OpenBSD it slowed Zope down and when I tried to access some page from my browser it would make even more than 5 minutes to load. I tried this with both 2.3.3 and 2.4.0 + HotFix. Now, when I compile python 2.1.1 with PTH instead of pthreads, the problem is solved and Zope responses normally. So, is this a bug on Free/OpenBSD's libc_r or is it Zope's? (I tried FreeBSD 4.3-Release, FreeBSD 4-stable and OpenBSD 2.9-Release) Giorgos Verigakis PS: please cc me, because I'm not on this list --------------------- 8< --------------------- #include <stdio.h> #include <stdlib.h> #include <unistd.h> #include <sys/types.h> #include <sys/socket.h> #include <netinet/in.h> #include <netdb.h> int main(int argc, char *argv[]) { struct sockaddr_in sa; struct hostent *hp; int s, c; int i, t, len; unsigned long sleeptime; char request[128]; char *url="/foo"; if (argc != 4) { printf("Usage: %s <host> <port> <rate>\n", argv[0]); printf("rate in hits/sec\n"); exit(1); } if ((hp = gethostbyname(argv[1])) == NULL) { printf("error looking up host\n"); exit(1); } sprintf(request, "GET %s HTTP/1.0\015\012\015\012", url); len = strlen(request); sleeptime = (1 / atof(argv[3])) * 1000000; bzero(&sa, sizeof(sa)); bcopy(hp->h_addr, (char *)&sa.sin_addr, hp->h_length); sa.sin_family = hp->h_addrtype; sa.sin_port = htons(atoi(argv[2])); for (i = 0;; i++) { if (( s = socket(hp->h_addrtype, SOCK_STREAM, 0)) < 0) { printf("Socket error\n"); continue; } if (c = connect(s, (struct sockaddr *) &sa, sizeof sa) < 0) { printf("Connection error\n"); close(s); continue; } t = write(s, request, len); printf("i=%d: %d bytes\n", i, t); usleep(sleeptime); close(c); close(s); } } --------------------- 8< ---------------------

1 0

another DateTime bug ?
by Steve Alexander 24 Aug '01

24 Aug '01

Again, I'm in a GMT+1 timezone. This time, I'm surprised that the GMT+0 timezone is considered different than the GMT timezone. I'd have thought they would be just the same. >>> from DateTime.DateTime import DateTime >>> a=DateTime('2000/08/20').pCommonZ() >>> b=DateTime('2000-08-20').pCommonZ() >>> c=DateTime('2000/08/20 GMT').pCommonZ() >>> d=DateTime('2000/08/20 GMT+0').pCommonZ() >>> >>> a 'Aug. 20, 2000 12:00 am GMT+1' >>> b 'Aug. 20, 2000 12:00 am GMT+0' >>> c 'Aug. 20, 2000 12:00 am GMT' >>> d 'Aug. 20, 2000 12:00 am GMT+0' >>> >>> b==c 0 >>> b==d 1 Here, I'd expect b==c to evaluate as true. Bug or feature? -- Steve Alexander Software Engineer Cat-Box limited

1 1