September 1999 - Zope-Dev

RE: [Zope-dev] Owner Role and ZCatalog
by Brian Lloyd 03 Sep '99

03 Sep '99

> Thanks Brian! > > This is terrific. I tried yesterday to test to see if the owner role > was working in Zope 2, and I wasn't having any luck. I tried the: >  >  > foo >  >  > > And no matter who had created the object I got back foo for the Users > with the manager role, and nothing for everyone else. > > Jason Yes - note that "local roles" are just that - local to a particular object. The has_role method of the User objects can take an optional second argument, which is the object to be used as context for determining if the User has the given role. If the second argument is passed, has_role will take local roles into account - otherwise it will only look through the roles actually assigned to the User itself. If you try:   foo   ...then you should get the right answer. This is something that needs to go into the API documentation for 2.0. Along these same lines, if you ever use the getRoles method of User objects, note that this will only give you the roles actually assigned to the User. To get the list of the roles of a user taking into account the local roles of an object, you can call: AUTHENTICATED_USER.getRolesInContext(object) Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

2 2

zope developers?
by Damien Morton 02 Sep '99

02 Sep '99

Hypothetically speaking, if I posted to this list looking for a handfull of python coders, and more specifically, zope coders, to work on a large portal site in Manhatten, how many people might be interested (assuming competetive pay rates).

2 1

RE: [Zope-dev] Owner Role and ZCatalog
by Brian Lloyd 02 Sep '99

02 Sep '99

> Zopists, > > Does anyone know if the ZCatalog catalog's the Owner role of > an object. > This sounds strange, but I'd like someone to only search their own > stuff. Is that possible? Is Owner a searchable indexable > item? Michel? > > Jason Spisak Jason, This is possible - currently you have to do a little bit of work to make it happen though. Ownership is basically a convention - when an object is created, the user who created the object is given the "Owner" local role on the object automatically. While there is currently no built-in API call to get the "owner" of an object (ownership is still kind of new, so we are letting it percolate before providing a formalized ownership api), here is an example external method that will give you the names of the users who have the "Owner" role on a given object. Note that there can be more than one, since site managers can go into an object and give multiple users the "Owner" local role on an object just as they could with any other local role. def owner(self): """Return a space-separated string of user names who have the local Owner role on an object.""" parent=self.aq_parent roles=parent.aq_acquire('__ac_local_roles__') dict=roles or {} items=[] for key, val in dict.items(): if 'Owner' in val: items.append(key) return string.join(items, ' ') You can either use this as an external method at the top of your site that objects can acquire, or add it to your ZClass definitions if you are indexing ZClass instances. That should effectively give your objects an "owner" method that the Catalog can use. Next, you need to create an "owner" index in your Catalog (you probably want to make this a Text Index instead of a field index so that you can search for a single name and find it though there may be multiple owners). Hope this helps! Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

2 1

RE: [Zope-dev] XMLDocument appears to leak memory
by Amos Latteier 02 Sep '99

02 Sep '99

> David Kankiewicz wrote: > > Martijn Faassen wrote: > > I think I've seen an earlier report and I'd like to confirm > this. XML > > Document appears to leak memory pretty badly: > > > > * When rendering it with DTML to HTML, Zope's memory use > often goes up a > > few kilobytes. Not all the time, it appears, but a reload > often does the > > trick. > > > > * It also appears that doing a DOM manipulation (for instance > > appendChild) increases Zope's memory use significantly; by > a few 10s of > > k. > > > I've been working with the Zope Quick reference in XML and have found > Zope's internal XML Documents are on about 10 times the size > compared to > stand alone file. (my guess, seems to be the DOM > information?). With the > manipulation, it might be the storage required to undo (not sure?). Well, I suppose that it is possible there are memory leaks in XML Document, however I'd like to see stronger evidence before I jump to that conclusion. XML Document uses a lot of resources. DOM creates a lot of objects, and the estimate that a Zope DOM representation of an xml file is 10 times as large as the file is probably a reasonable estimate. Displaying an XML Documents wakes up quite a few objects. Editing XML Documents can create quite a few new objects since it is difficult for XML Document to know when to change existing Nodes and when to create entirely new Nodes. It is on my todo list to improve memory use in XML Document. For example steps can be taken to move temporarily needed objects out of memory. If anyone has more specific problems or reproducible cases of memory getting out of control, I'd love to hear them. Please remember, however, that XML Document is unsupported; I just work on in my spare time. Thanks! -Amos P.S. Another version of XML Document is coming out today. It is a *lot* better than the first alpha release.

2 2

Root partition growing uncontrolably during a transaction
by Jason Spisak 02 Sep '99

02 Sep '99

Zopists, Does anyone know the best way to find which file is growing to insane proportions during an Catalog Update? It's not in /Zope's partition. Zope has it's own parition, as does /Zope/var. I'm trying to find it, but to now avail. The "/" root partition is growing and is now at 70% in a disk free results. It started at 30%. It's a 1GB partition. The only partition growing is "/" Now it's at 71%. Any ideas. RH 5.2 Linux 2.0.36 kernel Python 1.5.2 Zope beta5 I have a ~100 MB Data.fs file, and about 22,000 objects after a recent pack. All my best, Jason Spisak

3 4

Owner Role and ZCatalog
by Jason Spisak 02 Sep '99

02 Sep '99

Zopists, Does anyone know if the ZCatalog catalog's the Owner role of an object. This sounds strange, but I'd like someone to only search their own stuff. Is that possible? Is Owner a searchable indexable item? Michel? Jason Spisak

1 0

Re: [Zope-dev] Root partition growing uncontrolably during atransaction
by Jason Spisak 01 Sep '99

01 Sep '99

Andrew, I didn't know about the du tool. Here it goes. BTW it completely trashes everything when this happens, so I hope I can find out and give evryone a heads up when using large datasets and the Catalog. Thanks Andrew! Jason Andrew Lahser wrote: > > Jason, > > I am assuming that you have done "du -s *" in the root partition, and > you can not find a file that is growing. > > Install lsof (list open files). Use lsof to query the open files. Potentially, > a file may have been deleted while a process was still holding it open. If > this occurs, the file no longer appears in the filesystem, but continues to > take up space. > > For example, try > > lsof | grep tmp | less > > Once, we left a "tail -f filel.log" running on a virtual console, but deleted > the file.log from the filesystem. When we killed the tail -f process, the > file was automatically deleted. > > HTH > Drew > > Jason Spisak <webmaster(a)mtear.com> said: > > > Scott, > > > > My /tmp had only one file and that was for KDE in it. ls -a revealed > > nothing else in there. I looked in all of the tmp directories, because > > I thought the same thing. > > > > Jason > > > > Scott Robertson wrote: > > > > > > On Wed, 1 Sep 1999, Jason Spisak wrote: > > > > > > > Zopists, > > > > > > > > Does anyone know the best way to find which file is growing to insane > > > > proportions during an Catalog Update? It's not in /Zope's partition. > > > > Zope has it's own parition, as does /Zope/var. I'm trying to find it, > > > > but to now avail. The "/" root partition is growing and is now at 70% in > > > > a disk free results. It started at 30%. It's a 1GB partition. The > > > > only partition growing is "/" Now it's at 71%. Any ideas. > > > > RH 5.2 Linux > > > > 2.0.36 kernel > > > > Python 1.5.2 > > > > Zope beta5 > > > > > > > > I have a ~100 MB Data.fs file, and about 22,000 objects after a recent > pack. > > > > > > > > All my best, > > > > > > > > > > Um, here's a shot in the dark, Is your /tmp directory part of your root > > > partition? > > > > > > --------------------------------------------------- > > > - Scott Robertson Phone: 714.972.2299 - > > > - CodeIt Computing Fax: 714.972.2399 - > > > - http://codeit.com - > > > --------------------------------------------------- > > > > _______________________________________________ > > Zope-Dev maillist - Zope-Dev(a)zope.org > > http://www.zope.org/mailman/listinfo/zope-dev > > > > (To receive general Zope announcements, see: > > http://www.zope.org/mailman/listinfo/zope-announce > > > > For non-developer, user-level issues, > > zope(a)zope.org, http://www.zope.org/mailman/listinfo/zope ) > >

1 0

reindex_object
by Jason Spisak 01 Sep '99

01 Sep '99

Michel, I have tried to get  to update a uniqueValuesFor, and it will not. I have tried unindex and then index. I made sure it was  in the DTML. This is just a heads up, because I'm using beta5 and I'll let you know if it persists in 2 final. Basically I still have a blank selection at the top a uniqueValuesFor select box, and that shouldn't be there. I can't get the blank selection to disappear. I also can't make a value for which I have only one entry, go away when I reindex that entry with another value. Jason

1 0

RE: [Zope-dev] ZSybaseDA 1.0.1 and MS-SQL (was Re: ANN: ZSybaseDA 1.0.1)
by Michel Pelletier 01 Sep '99

01 Sep '99

> -----Original Message----- > From: Anthony Baxter [mailto:anthony@interlink.com.au] > Sent: Tuesday, August 31, 1999 6:33 AM > To: Michel Pelletier > Cc: 'zope-dev(a)zope.org' > Subject: [Zope-dev] ZSybaseDA 1.0.1 and MS-SQL (was Re: ANN: ZSybaseDA > 1.0.1) > > > > A subsequent request gives: > > Error, SybaseError: ct_cursor failed > > The rollback transaction request has no corresponding > BEGIN TRANSACTION. > ct_results(): user api layer: external error: This > routine cannot be called when the command structure is idle. > ct_cursor(): user api layer: external error: The > connection's capabilities do not support this type of request. > The cursor problem is unknown to me, and I suspect many of it's problems have something to do with cysybasemodule. The 'no corresponding' transaction error was a bug in b6, and is fixed in the final. If an error was raised during a transaction, the transaction machinery bugged out. This is why the two errors you got were different. -Michel

1 0

RE: [Zope-dev] Re: ZCatalog algorithms
by Michel Pelletier 01 Sep '99

01 Sep '99

> -----Original Message----- > From: morton(a)dennisinter.com [mailto:morton@dennisinter.com] > Sent: Wednesday, September 01, 1999 1:21 AM > To: Zope Development > Subject: [Zope-dev] Re: ZCatalog algorithms > > > This is a note to the Zope dev team. > > Perhaps I'm out of place suggesting this, but theres an > extremely good indexing package, which is open source (i > think), and is available, called MG. Theres a book that goes > with it called "Managing Gigabytes" co-authored by an old > university lecturer of mine, Allistair Moffat. the book and > package can be found at http://www.cs.mu.oz.au/mg/ > > The focus of the package, and the book, is in creating highly > efficient compressed indexes and data. They use Perfect > Hashing for their indexes. Their indexing technique is geared > to creating static indexes, and they rebuild the Perfect Hash > tables and the compression dictionary once in a while. > > I note from reading through the ZCatalog code that the > authors have some performance concerns, and were wondering > where to go next. You could do worse than taking a look at > the MG code and/or book. > Cool. Thanks for the tip! -Michel

1 0