July 2000 - Zope-Dev

Now; - problems using ZODB/ZCatalog in Python
by Thomas Weholt 25 Jul '00

25 Jul '00

First off, sorry for posting a huge, stinkin' post like this, but instead of posting ten times trying to explain what I do, I post this once and hope somebody can point out what's wrong and I'll leave you all alone, at least for a while. The example is from the Catalog outside Zope-tutorial available at Zope.org. I'm using Zope 2.2.0. This might have been written for Zope 2.1.6. I dunno. I understand the error message, just don't why it is raised. If I should call some form of commit() or close(), where should this be done? And, by the way, does Catalog support different kinds of searches, like matching all the search-words, some, does the order count ? Can this options be set, if any exists? Anyway, thanks for your patience and bandwidth. Thomas import sys sys.path.append('d:\\progra~1\\website\\lib\\python\\') import ZODB import Persistence from Persistence import Persistent from ZODB.FileStorage import FileStorage from Products.ZCatalog.Catalog import Catalog ### create some classes to be persistent class Nobody( Persistent ): def identify( self ): print "I am Nobody!" class Person( Persistent ): def __init__( self, first, name, email, friend=Nobody() ): self.first = first self.name = name self.email = email self.friend= friend def identify( self ): print "I am " + self.first + " " + self.name print "and my Email is " + self.email ### OK, the ZODB-API together with a Catalog-Class class Application: def __init__( self, file='test.fs' ): self.file= file self.db = ZODB.DB( FileStorage( file ) ) self.co = self.db.open() self.root= self.co.root() if self.root.has_key( 'cat' ): self.cat= self.root['cat'] else: self.cat = Catalog() ### This is, how I get it to work self.cat.aq_parent= self.root self.root['cat']= self.cat ### Add indexes to the Catalog-Class ### The names must match the fields of the Person-Class! self.cat.addIndex('first','FieldIndex' ) self.cat.addIndex('name' ,'FieldIndex' ) self.cat.addIndex('email','FieldIndex' ) get_transaction().commit() def storePerson( self, person ): uid= id( person ) print "stored as " + str( uid ) self.root[uid]= person ### Let the Catalog know from this object self.cat.catalogObject( person, uid ) get_transaction().commit() def searchPerson( self, **kw ): r= self.cat.searchResults( kw ) paths= self.cat.paths root = self.root k= [] for i in r: id= i.data_record_id_ k.append( root[paths[id]] ) return k if __name__ == '__main__': a= Application() p1= Person( 'marian','kelc','marian.kelc(a)ruhr-uni-bochum.de' ) p2= Person( 'tanja', 'kreierhoff','tanja.kreierhoff(a)web.de', p1 ) p1.friend= p2 a.storePerson( p1 ) a.storePerson( p2 ) ### test2.py a= Application() ### perform searches with keyword-arguments ids= a.searchPerson( name='kelc' ) for i in ids: i.identify() print "Friend is:" i.friend.identify() i.friend.friend.identify() print str( id( i ) ) print str( id( i.friend.friend ) ) stored as 24111488 stored as 16520248 Traceback (innermost last): File "D:\Program Files\Python\Pythonwin\pywin\framework\scriptutils.py", line 307, in RunScript debugger.run(codeObject, __main__.__dict__, start_stepping=0) File "D:\Program Files\Python\Pythonwin\pywin\debugger\__init__.py", line 71, in run _GetCurrentDebugger().run(cmd, globals,locals, start_stepping) File "D:\Program Files\Python\Pythonwin\pywin\debugger\debugger.py", line 533, in run _doexec(cmd, globals, locals) File "D:\Program Files\Python\Pythonwin\pywin\debugger\debugger.py", line 868, in _doexec exec cmd in globals, locals File "D:\python\life\zodb_zcatalog.py", line 84, in ? a= Application() File "D:\python\life\zodb_zcatalog.py", line 28, in __init__ self.db = ZODB.DB( FileStorage( file ) ) File "D:\PROGRA~1\WebSite\lib\python\ZODB\FileStorage.py", line 262, in __init__ lock_file(f) File "D:\PROGRA~1\WebSite\lib\python\ZODB\lock_file.py", line 115, in lock_file raise error, ( StorageSystemError: Could not lock the database file. There must be another process that has opened the file. <p>

2 1

RE: [Zope-dev] Now; - problems using ZODB/ZCatalog in Python
by Jens Vagelpohl 25 Jul '00

25 Jul '00

thomas, this error message is raised when the zope instance that contains the ZODB you're trying to work with is already running (and thereby put its own lock on the ZODB). are you trying to execute this script while zope is running? you need to shut it down first. jens > -----Original Message----- > From: zope-dev-admin(a)zope.org > [mailto:zope-dev-admin@zope.org]On Behalf > Of Thomas Weholt > Sent: Tuesday, July 25, 2000 06:34 > To: 'Zope-Dev(a)zope.org' > Subject: [Zope-dev] Now; - problems using ZODB/ZCatalog in Python > > I understand the error message, just don't why it is raised. > If I should > call some form of commit() or close(), where should this be done? > > And, by the way, does Catalog support different kinds of > searches, like > matching all the search-words, some, does the order count ? > Can this options > be set, if any exists? > > Anyway, thanks for your patience and bandwidth. > Thomas > > import sys > sys.path.append('d:\\progra~1\\website\\lib\\python\\') > import ZODB > import Persistence > from Persistence import Persistent > from ZODB.FileStorage import FileStorage > from Products.ZCatalog.Catalog import Catalog > > ### create some classes to be persistent > class Nobody( Persistent ): > def identify( self ): > print "I am Nobody!" > > class Person( Persistent ): > def __init__( self, first, name, email, friend=Nobody() ): > self.first = first > self.name = name > self.email = email > self.friend= friend > def identify( self ): > print "I am " + self.first + " " + self.name > print "and my Email is " + self.email > > ### OK, the ZODB-API together with a Catalog-Class > class Application: > def __init__( self, file='test.fs' ): > self.file= file > self.db = ZODB.DB( FileStorage( file ) ) > self.co = self.db.open() > self.root= self.co.root() > if self.root.has_key( 'cat' ): > self.cat= self.root['cat'] > else: > self.cat = Catalog() > ### This is, how I get it to work > self.cat.aq_parent= self.root > > self.root['cat']= self.cat > > ### Add indexes to the Catalog-Class > ### The names must match the fields of the Person-Class! > self.cat.addIndex('first','FieldIndex' ) > self.cat.addIndex('name' ,'FieldIndex' ) > self.cat.addIndex('email','FieldIndex' ) > get_transaction().commit() > > def storePerson( self, person ): > uid= id( person ) > print "stored as " + str( uid ) > self.root[uid]= person > > ### Let the Catalog know from this object > self.cat.catalogObject( person, uid ) > get_transaction().commit() > > def searchPerson( self, **kw ): > r= self.cat.searchResults( kw ) > paths= self.cat.paths > root = self.root > k= [] > for i in r: > id= i.data_record_id_ > k.append( root[paths[id]] ) > return k > > if __name__ == '__main__': > a= Application() > p1= Person( 'marian','kelc','marian.kelc(a)ruhr-uni-bochum.de' ) > p2= Person( 'tanja', 'kreierhoff','tanja.kreierhoff(a)web.de', p1 ) > p1.friend= p2 > a.storePerson( p1 ) > a.storePerson( p2 ) > > ### test2.py > a= Application() > > ### perform searches with keyword-arguments > ids= a.searchPerson( name='kelc' ) > > for i in ids: > i.identify() > print "Friend is:" > i.friend.identify() > i.friend.friend.identify() > print str( id( i ) ) > print str( id( i.friend.friend ) ) > > stored as 24111488 > stored as 16520248 > Traceback (innermost last): > File "D:\Program > Files\Python\Pythonwin\pywin\framework\scriptutils.py", > line 307, in RunScript > debugger.run(codeObject, __main__.__dict__, start_stepping=0) > File "D:\Program > Files\Python\Pythonwin\pywin\debugger\__init__.py", line > 71, in run > _GetCurrentDebugger().run(cmd, globals,locals, start_stepping) > File "D:\Program > Files\Python\Pythonwin\pywin\debugger\debugger.py", line > 533, in run > _doexec(cmd, globals, locals) > File "D:\Program > Files\Python\Pythonwin\pywin\debugger\debugger.py", line > 868, in _doexec > exec cmd in globals, locals > File "D:\python\life\zodb_zcatalog.py", line 84, in ? > a= Application() > File "D:\python\life\zodb_zcatalog.py", line 28, in __init__ > self.db = ZODB.DB( FileStorage( file ) ) > File "D:\PROGRA~1\WebSite\lib\python\ZODB\FileStorage.py", > line 262, in > __init__ > lock_file(f) > File "D:\PROGRA~1\WebSite\lib\python\ZODB\lock_file.py", > line 115, in > lock_file > raise error, ( > StorageSystemError: Could not lock the database file. There must be > another process that has opened the file. > <p> >

1 0

RE: [Zope-dev] Use ZODB3 and ZCatalog for indexing purposes
by Jens Vagelpohl 25 Jul '00

25 Jul '00

thomas, putting together a zope python product to represent a CD isn't hard at all. if you go the product route you'll be able to index and search across all attributes of the CD object using ZCatalog. check out the "boring product" at http://www.zope.org/Members/gtk/Boring/HowTo-Boring, it is a good guide to the framework making up a zope product. jens > -----Original Message----- > From: zope-dev-admin(a)zope.org > [mailto:zope-dev-admin@zope.org]On Behalf > Of Thomas Weholt > Sent: Tuesday, July 25, 2000 05:28 > To: 'Zope-Dev(a)zope.org' > Subject: [Zope-dev] Use ZODB3 and ZCatalog for indexing purposes > > > Hi, > > I'm wondering about using ZODB3 and ZCatalog for a > CD-indexing project. The > actual cd-roms will seldom change after they've been > registered, and I'd > like to have some sort of auto-full-text-search feature. > How does ZODB3 and ZCatalog fit in this picture? I'm NOT making a > Zope-product yet, just a plain python-script, using ZODB/ZCatalog for > storage. Later, the thing will have a Zope-interface, but for > now I'm having > so much trouble with my current implementation using > PostgreSQL, mostly due > to the fact that I cannot get full-text-searching, that I > really need some > progress now. I'm dealing with plain python objects the > entire time, but > searching is alpha/omega in this case and will break it > completly if not > implemented correctly. > > Any hints, tips, flames or just emails sent out of boredome, > I'm a lonely > coder who needs a stinkin' break before I go completly nuts, > so any feedback > will be great. :-> > > Thomas

1 0

LoginManager patch considered harmful (was Re: can't add loginmanager below root) loginmanager below root)
by Phillip J. Eby 25 Jul '00

25 Jul '00

At 09:21 PM 6/28/00 +0000, Ty Sarna wrote: >In article <39541FC1.A239BC5(a)digicool.com>, >Shane Hathaway <shane(a)digicool.com> wrote: >> Ok folks, >> >> I thought I had made it clear that this problem has been solved. I have >> sent a patch to Ty (about two weeks ago) as well as made the change in > >Sorry for the delay. I'm just now cacthing up on all my zope-related >mail. I've applied this patch, and it will be in the release tonight. >However, I am a bit concerned about what happens if _owner is deleted. >For purposes of setuid code, we'd like to use the owner as the user to >setuid to, but if we can't force it to be the right user, that could be >a problem. This will definately need more thought. > I'm afraid I've confirmed Ty's fears. The LoginManager patch to fix the "can't add below root" problem creates a new issue: ownership of objects within the LoginManager. I will be asking Ty to make a re-release of 0.8.7 to unpatch part of the patch, but for now, here's a short synopsis of the problem and how to fix it. Shane's patch changes manage_addLoginManager to set ob._owner = UnownableOwner, which is good, because this ensures that AccessControl.Owned.Owned._deleteOwnershipAfterAdd() can del self._owner. (I think that Owned shouldn't be doing this this way, but as yet I don't have a good alternative to propose that DC implement.) The problem is that once this is done, the LoginManager is no longer "unowned". To fix this, add the line: _owner = UnownableOwner to the body of the LoginManager class. This will ensure that even after _deleteOwnershipAfterAdd(), the LoginManager will remain "unowned". After you have made this fix and restarted Zope, you may want to "un-own" any objects contained within your LoginManagers which might have been created with ownership. To do this, you should go to each page of each LoginManager's management interface and copy all objects, then paste them. Delete the originals, and rename the copies back to their old names. The copies will then be "unowned". You can verify this by checking each object's management interface: if it is unowned, it will have no "Ownership" tab. Why does LoginManager want its contents unowned? It has to do with the new security model. When an executable object is owned, the security machinery wants to validate that its owner is allowed to do whatever the executable is doing. This is great except for the fact that in many sites, the owner of the LoginManager's objects is actually a user that was retrieved from that LoginManager. This means that if LoginManager executes an object to find out information about a user, and that object is owned by a user from that LoginManager, infinite recursion and a core dump will swiftly follow. For this reason, you should make sure that all executable objects in a LoginManager are either unowned or owned by a user who is *not* supplied by that LoginManager. In practice, making sure they're unowned is usually easier.

4 17

Memebrship User management
by Bill Anderson 25 Jul '00

25 Jul '00

OK, so I have been working on a set of user management methods for Membership by tazzzz. I have it where I can see a list of users, and their roles. now, what I need is a way to modify Roles. So, looking into the source, I see that roles exists (as currently implemented) as __roles. This means that you can't modify roles from the web. So, I added this to the MemberMixin: def changeRoles(self,roles): self.__roles=roles return self.getRoles() Restartted zope, yadda yadda. Now, it appears to be setting the roles (if I return self.__roles I see the changes), but the changes are not persistent, since the roles don't seem to be changed. The above will return the same roles the user had prior to the call to changeRoles. :( So, thinking back to the transactional nature of the ZODB, I added a: get_transaction().commit(1) ...before the return ... no luck. Then tried: get_transaction().commit(1) ...same result. Now, it is getting early (you know, once you past 'late' ;^) ... and my brain is shutting down. So I figured I would post this to the list, to see if anyone has any bright (or not-so-bright) ideas. Yeah, I know the above is a total kludge, but I wan't to get this working before re-implenting a 'bettr' default PUS, to make sure I understand what I am doing. {:^)= Bill -- Do not meddle in the affairs of sysadmins, for they are easy to annoy, and have the root password.

1 0

Problem
by Anvita 25 Jul '00

25 Jul '00

Hello Sir, I want to create a portal for indian languages using zope. The problem is that the programms which handles all font related issues or text to speech conversion etc for the site (for Indian Languages) are in C and Visual Basic and the programmes are too lenthy that we cann't rewrite them. Kindly tell me is there any way to use tham with zope. Thanking you, Yours truly, Anvita Bajpai Research Engineer IIT Kanpur - India.

1 0

ZPatterns illustrated
by Chui Tey 25 Jul '00

25 Jul '00

If anyone would like to illustrate ZPatterns concept, why not draw it on a piece of A4 sheet, and fax it to my jfax number at 17029739987 (US only). I will stick it on this site http://teyc.editthispage.com . (Certainly beats drawing with a mouse). I have an illustrated implementation of LoginManager already. Please contribute! Chui __________________________________________________________________ Get your free Australian email account at http://www.start.com.au

1 0

Online Docs
by Kapil Thangavelu 25 Jul '00

25 Jul '00

I've been playing around with the ACS a bit lately. Its got one feature which i would desparately like to see in zope. namely that every ACS server is self documenting with regards to all of its methods. to see it in an action check out http://www.arsdigita.com/doc/procs this documentation is generated on startup of the server for all available functions which make a call to a function proc_doc. i looked at the existing python code auto documentors and the one i saw that looked the best was http://www.lfw.org/python (at the bottom of the page) for documenting live objects. it could use some modifiying to generate zope objects which would get cataloged and also to include a functions/modules source. does anyone think that this would be a good resource to have in zope. searchable docs for developers on their servers of all the Zope Internal Python Code and the Code for all the installed Products? Kapil

2 1

Zope bug (w/ patch): hard coded Unix separator in special_dtml.py
by Yves-Eric Martin 25 Jul '00

25 Jul '00

Hello Zopistas, When trying to figure out why our Product zzLocale was behaving strangely under Windows, I found that the raw attribute of management screens was weird (had a unix separator '/' before the template name), and I traced it back to what I believe is a bug in Zope: In lib/python/App/special_dtml.py, we have: > def __init__(self,name,_prefix=None, **kw): > if _prefix is None: _prefix=SOFTWARE_HOME > elif type(_prefix) is not type(''): > _prefix=Common.package_home(_prefix) > > args=(self, '%s/%s.dtml' % (_prefix,name)) ^ hard-coded unix separator > if not kw.has_key('__name__'): kw['__name__']=name > apply(HTMLFile.inheritedAttribute('__init__'),args,kw) I think this should rather be (tested and working patch): > args=(self, os.path.join(_prefix, name + '.dtml')) Does that sound right to you? If no one disagrees, I'll fill a bug report w/ patch in the Collector. -- Yves-Eric Martin Digital Garage Inc. yemartin(a)garage.co.jp

2 2

RE: [Zope-dev] Request for amplification on new Product permissio ns API.
by Brian Lloyd 24 Jul '00

24 Jul '00

> > > > Are you calling: > > > > Globals.default__class_init__(MyBasketClass) > > > > on your Basket class? This is (poorly documented but) > > necessary for permissions declared in __ac_permissions__ > > to be correctly initialized. > > Should I have this in Squishdot too? > > Chris Yes - basically any class that defines *or inherits from a class that defines* permissions should do this to make sure that the permissions along the inheritance heirarchy are cobbled together correctly at class initialization time. Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

2 1