- Zope-Dev - Zope lists

Root partition growing uncontrolably during a transaction
by Jason Spisak 02 Sep '99

02 Sep '99

Zopists, Does anyone know the best way to find which file is growing to insane proportions during an Catalog Update? It's not in /Zope's partition. Zope has it's own parition, as does /Zope/var. I'm trying to find it, but to now avail. The "/" root partition is growing and is now at 70% in a disk free results. It started at 30%. It's a 1GB partition. The only partition growing is "/" Now it's at 71%. Any ideas. RH 5.2 Linux 2.0.36 kernel Python 1.5.2 Zope beta5 I have a ~100 MB Data.fs file, and about 22,000 objects after a recent pack. All my best, Jason Spisak

3 4

Owner Role and ZCatalog
by Jason Spisak 02 Sep '99

02 Sep '99

Zopists, Does anyone know if the ZCatalog catalog's the Owner role of an object. This sounds strange, but I'd like someone to only search their own stuff. Is that possible? Is Owner a searchable indexable item? Michel? Jason Spisak

1 0

Re: [Zope-dev] Root partition growing uncontrolably during atransaction
by Jason Spisak 01 Sep '99

01 Sep '99

Andrew, I didn't know about the du tool. Here it goes. BTW it completely trashes everything when this happens, so I hope I can find out and give evryone a heads up when using large datasets and the Catalog. Thanks Andrew! Jason Andrew Lahser wrote: > > Jason, > > I am assuming that you have done "du -s *" in the root partition, and > you can not find a file that is growing. > > Install lsof (list open files). Use lsof to query the open files. Potentially, > a file may have been deleted while a process was still holding it open. If > this occurs, the file no longer appears in the filesystem, but continues to > take up space. > > For example, try > > lsof | grep tmp | less > > Once, we left a "tail -f filel.log" running on a virtual console, but deleted > the file.log from the filesystem. When we killed the tail -f process, the > file was automatically deleted. > > HTH > Drew > > Jason Spisak <webmaster(a)mtear.com> said: > > > Scott, > > > > My /tmp had only one file and that was for KDE in it. ls -a revealed > > nothing else in there. I looked in all of the tmp directories, because > > I thought the same thing. > > > > Jason > > > > Scott Robertson wrote: > > > > > > On Wed, 1 Sep 1999, Jason Spisak wrote: > > > > > > > Zopists, > > > > > > > > Does anyone know the best way to find which file is growing to insane > > > > proportions during an Catalog Update? It's not in /Zope's partition. > > > > Zope has it's own parition, as does /Zope/var. I'm trying to find it, > > > > but to now avail. The "/" root partition is growing and is now at 70% in > > > > a disk free results. It started at 30%. It's a 1GB partition. The > > > > only partition growing is "/" Now it's at 71%. Any ideas. > > > > RH 5.2 Linux > > > > 2.0.36 kernel > > > > Python 1.5.2 > > > > Zope beta5 > > > > > > > > I have a ~100 MB Data.fs file, and about 22,000 objects after a recent > pack. > > > > > > > > All my best, > > > > > > > > > > Um, here's a shot in the dark, Is your /tmp directory part of your root > > > partition? > > > > > > --------------------------------------------------- > > > - Scott Robertson Phone: 714.972.2299 - > > > - CodeIt Computing Fax: 714.972.2399 - > > > - http://codeit.com - > > > --------------------------------------------------- > > > > _______________________________________________ > > Zope-Dev maillist - Zope-Dev(a)zope.org > > http://www.zope.org/mailman/listinfo/zope-dev > > > > (To receive general Zope announcements, see: > > http://www.zope.org/mailman/listinfo/zope-announce > > > > For non-developer, user-level issues, > > zope(a)zope.org, http://www.zope.org/mailman/listinfo/zope ) > >

1 0

reindex_object
by Jason Spisak 01 Sep '99

01 Sep '99

Michel, I have tried to get  to update a uniqueValuesFor, and it will not. I have tried unindex and then index. I made sure it was  in the DTML. This is just a heads up, because I'm using beta5 and I'll let you know if it persists in 2 final. Basically I still have a blank selection at the top a uniqueValuesFor select box, and that shouldn't be there. I can't get the blank selection to disappear. I also can't make a value for which I have only one entry, go away when I reindex that entry with another value. Jason

1 0

RE: [Zope-dev] ZSybaseDA 1.0.1 and MS-SQL (was Re: ANN: ZSybaseDA 1.0.1)
by Michel Pelletier 01 Sep '99

01 Sep '99

> -----Original Message----- > From: Anthony Baxter [mailto:anthony@interlink.com.au] > Sent: Tuesday, August 31, 1999 6:33 AM > To: Michel Pelletier > Cc: 'zope-dev(a)zope.org' > Subject: [Zope-dev] ZSybaseDA 1.0.1 and MS-SQL (was Re: ANN: ZSybaseDA > 1.0.1) > > > > A subsequent request gives: > > Error, SybaseError: ct_cursor failed > > The rollback transaction request has no corresponding > BEGIN TRANSACTION. > ct_results(): user api layer: external error: This > routine cannot be called when the command structure is idle. > ct_cursor(): user api layer: external error: The > connection's capabilities do not support this type of request. > The cursor problem is unknown to me, and I suspect many of it's problems have something to do with cysybasemodule. The 'no corresponding' transaction error was a bug in b6, and is fixed in the final. If an error was raised during a transaction, the transaction machinery bugged out. This is why the two errors you got were different. -Michel

1 0

RE: [Zope-dev] Re: ZCatalog algorithms
by Michel Pelletier 01 Sep '99

01 Sep '99

> -----Original Message----- > From: morton(a)dennisinter.com [mailto:morton@dennisinter.com] > Sent: Wednesday, September 01, 1999 1:21 AM > To: Zope Development > Subject: [Zope-dev] Re: ZCatalog algorithms > > > This is a note to the Zope dev team. > > Perhaps I'm out of place suggesting this, but theres an > extremely good indexing package, which is open source (i > think), and is available, called MG. Theres a book that goes > with it called "Managing Gigabytes" co-authored by an old > university lecturer of mine, Allistair Moffat. the book and > package can be found at http://www.cs.mu.oz.au/mg/ > > The focus of the package, and the book, is in creating highly > efficient compressed indexes and data. They use Perfect > Hashing for their indexes. Their indexing technique is geared > to creating static indexes, and they rebuild the Perfect Hash > tables and the compression dictionary once in a while. > > I note from reading through the ZCatalog code that the > authors have some performance concerns, and were wondering > where to go next. You could do worse than taking a look at > the MG code and/or book. > Cool. Thanks for the tip! -Michel

1 0

temporary object storage
by Robin Becker 01 Sep '99

01 Sep '99

My web application has a point at which a medium sized object (say 50-100k) has to be temporarily stored to allow the kids some time to choose what to view or plot. I'm currently storing these objects (with some token & creation info) in a python list. I then access the information using an external method (using a token to get the right object). I can see that this will work for up to 100-200 outstanding elements. If the objects were larger would it be sensible to store these in the Zope data base as objects or files? -- Robin Becker

1 0

I won't be using ZDaemons heartbeat for ZScheduler
by Martijn Pieters 01 Sep '99

01 Sep '99

At 01:14 28/08/99 , Michel Pelletier wrote: >Getting back to to original idea for this whole thing is testing. An >internal heartbeat system is not such a bad thing, in fact there is one >but I don't think it's documented anywhere, it's a hack with zdaemon >anyway. I think this could be handy. Two problems with using this: 1) It prints a damn annoying 'tha-thump' every heartbeat. Fixable, I know. 2) It only runs on Unix. ZDaemon is not used on NT (z2.py line 213: if sys.platform=='win32': Zpid='') -- Martijn Pieters, Web Developer | Antraciet http://www.antraciet.nl | Tel: +31-35-7502100 Fax: +31-35-7502111 | mailto:mj@antraciet.nl http://www.antraciet.nl/~mj | PGP: http://wwwkeys.nl.pgp.net:11371/pks/lookup?op=get&search=0xA8A32149 ------------------------------------------

3 3

XMLDocument appears to leak memory
by Martijn Faassen 31 Aug '99

31 Aug '99

Hi there, I think I've seen an earlier report and I'd like to confirm this. XML Document appears to leak memory pretty badly: * When rendering it with DTML to HTML, Zope's memory use often goes up a few kilobytes. Not all the time, it appears, but a reload often does the trick. * It also appears that doing a DOM manipulation (for instance appendChild) increases Zope's memory use significantly; by a few 10s of k. Now, I'm using some external methods to render and manipulate this document, so I may be introducing some circular references there instead. I'll try to find a simple test case. Zope's memory use is easily driven up by a couple of megabytes in a short time by what I'm doing, which is rather annoying. Anyone has any idea on what may be going on? Regards, Martijn

2 1

Re: [Zope-dev] ZSybaseDA 1.0.1 and MS-SQL (was Re: ANN: ZSybaseDA 1.0.1)
by Anthony Baxter 31 Aug '99

31 Aug '99

>>> Anthony Baxter wrote > I'm attempting to connect from a Linux (RH5.2ish) box using Sybase client > libs from Sybase ASE 11.0.3.3 to MS-SQL 6.5sp3. > > The SQL Method > select count(name) as cnt from sysobjects > > gives the following when you try to do a Test: > > Error, SybaseError: ct_cursor failed > ct_cursor(): user api layer: external error: The connection's capabili ties do not support this type of request. Quick update: It seems that you can't use a cursor under ctsybase (both old and new versions) when talking to MS SQL. The old ZSybaseDA just uses connection.execute()'s results (rather than the DB-SIG interface). It's quite possible that the cursor is being opened with the wrong options or something - I have no idea about the ctsybase C interface (learning Oracle's OCI interface was bad enough). I have a brutally hacked version that goes back to the previous version of ZSybaseDA's use of the db.execute's return results, and it seems to work. What's the best way to deal with this? Maybe have a checkbox on the Properties screen saying 'use a cursor' (default)? (with a note saying that this may be needed to talk to MS-SQL...) Anthony

2 1