- Zope-Dev - Zope lists

unit testing framework proposal
by Chris McDonough 15 Aug '00

15 Aug '00

Please see http://dev.zope.org/Wikis/DevSite/Proposals/UnitTestingFramework for a propsal for inclusion of a unit testing framework within Zope. Comments appreciated. Chris McDonough Digital Creations Publishers of Zope - http://www.zope.org

1 0

proposal for better spelling of security assertions
by Brian Lloyd 14 Aug '00

14 Aug '00

Hi all (esp. product authors!)- I've put a proposal for much-improved spelling of security information in Zope (and product) code at: http://dev.zope.org/Wikis/DevSite/Proposals/DeclarativeSecurity This is part of the ongoing push to improve usability (and comprehensibility) and I'd _really_ like to get this on the fast track for the next feature release of Zope. Please review this and make any comments (in the discussion page linked in the proposal) by Wednesday (Aug. 16th) to make sure your voice is heard! Thanks! Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

1 0

RE: [Zope-dev] zope221b1 - zclass zexp import into clean database error
by Brian Lloyd 14 Aug '00

14 Aug '00

Shane has tracked this down to a mis-bugfix in the beta - the fix will be in the 2.2.1 final. Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com > -----Original Message----- > From: Dr. Ross Lazarus [mailto:rossl@med.usyd.edu.au] > Sent: Saturday, August 12, 2000 9:49 PM > To: zope-dev(a)zope.org > Cc: Brian Lloyd > Subject: [Zope-dev] zope221b1 - zclass zexp import into clean database > error > > > More on testing zope221b1 - source tar, redhat 6.2 > I seem to be the only one reporting problems on the list (0-:) - it > really is just me. > Thought I better try again - start with a clean slate > > So, I restarted zope with a new empty Data.fs from the 221b1 source > distribution. > Started as superuser, made a real user with manager/owner rights. > Logged in as the real user, took ownership of the entire heirarchy. > Tried to import a zclass zexp file freshly exported from > 2.2.0 that I've > been happily using with 2.2.0 and previously. > Traceback appears below > > =========================================================== > Zope Error > Zope has encountered an error while publishing this resource. > > Error Type: Permission mapping error > Error Value: Attempted to map a permission to a permission, Add SMP > Blocks, that is not valid. This should never happen. (Waaa). > > > > -------------------------------------------------------------- > ------------------ > > Troubleshooting Suggestions > > The URL may be incorrect. > The parameters passed to this resource may be incorrect. > A resource that this resource relies on may be encountering an error. > For more detailed information about the error, please refer > to the HTML > source for this page. > > If the error persists please contact the site maintainer. > Thank you for > your patience. > > > > > Traceback (innermost last): > File > /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, > line 222, in publish_module > File > /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, > line 187, in publish > File > /usr/local/home/rossl/zope221b1/lib/python/Zope/__init__.py, line > 221, in zpublisher_exception_hook > (Object: Traversable) > File > /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, > line 171, in publish > File > /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/mapply.py, > line 160, in mapply > (Object: manage_importObject) > File > /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, > line 112, in call_object > (Object: manage_importObject) > File > /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, > line 508, in manage_importObject > (Object: Traversable) > File > /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, > line 263, in _setObject > (Object: Traversable) > File > /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, > line 271, in manage_afterAdd > (Object: Traversable) > File /usr/local/home/rossl/zope221b1/lib/python/ZClasses/ZClass.py, > line 422, in manage_afterAdd > (Object: ZBlockStore) > File > /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, > line 271, in manage_afterAdd > (Object: Traversable) > File /usr/local/home/rossl/zope221b1/lib/python/App/Factory.py, line > 144, in manage_afterAdd > (Object: RoleManager) > File > /usr/local/home/rossl/zope221b1/lib/python/AccessControl/Permi > ssionMapping.py, > line 137, in manage_setPermissionMapping > (Object: RoleManager) > (Info: (['', 'Access contents information', 'Add Database > Methods', > 'Add Documents, Files, and Images', 'Add Documents, Images, > and Files', > 'Add External Methods', 'Add Folders', 'Add LDAPAdapter Object', 'Add > MailHost objects', 'Add Survey Creator', 'Add Sybase Database > Connections', 'Add TinyTable', 'Add User Folders', 'Add > Versions', 'Add > Vocabularies', 'Add Z Gadfly Database Connections', 'Add ZCatalogs', > 'Add ZWiki Pages', 'Add Zope Tutorials', 'Browse LDAPAdapter', 'Change > DTML Documents', 'Change DTML Methods', 'Change Database Connections', > 'Change Database Methods', 'Change External Methods', 'Change > Images and > Files', 'Change LDAPAdapter', 'Change TinyTable', 'Change Versions', > 'Change ZWiki Pages', 'Change configuration', 'Change permissions', > 'Change proxy roles', 'Change survey', 'Create class > instances', 'Create > survey', 'Delete objects', 'Edit Factories', 'FTP access', > 'Import/Export objects', 'Join/leave Versions', 'Manage Vocabulary', > 'Manage Z Classes', 'Manage ZCatalog Entries', 'Manage properties', > 'Manage users', 'Open/Close Database Connection', 'Open/Close Database > Connections', 'Query TinyTable Data', 'Query Vocabulary', > 'Save/discard > Version changes', 'Search ZCatalog', 'Submit survey', 'Take > ownership', > 'Test Database Connections', 'Undo changes', 'Use Database Methods', > 'Use Factories', 'Use mailhost services', 'View', 'View > History', 'View > management screens'], 'Add SMP Blocks', 0)) > Permission mapping error: (see above) > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) >

1 0

Re: [Zope-dev] Re: Zope security alert and hotfix product...
by Andrew Wilcox 14 Aug '00

14 Aug '00

>Now - should methods of mutable types be off-limits in the >future? [...] I don't think it would >be acceptable for 'append' to be off-limits in this case, so >the alternative is that the security machinery would somehow >have to be able to distinguish mutables created by the user >from those obtained from the secure environment. That would >probably mean that API code would have to make some sort of >security assertions about mutables they returned. I have another alternative -- Unless I really intend to return an unprotected mutable across subsystems, most often it's a mistake. Even if security isn't an issue, it leads to wonderfully obscure bugs if a customer of my class blithely modifies my return value. (I returned it to you, after all, you thought it was yours now!) If I do want to return a dictionary for you to *read*, I could just as easily code my intention and return a read-only class that implements __getitem__. Since on occasion I might deliberately want to return an unprotected mutable value for a good reason, what would be helpful is if the security system forbid me from returning unprotected mutable values unless I explicitly say I intend to do so. I'd encourage the check to recursively descend through tuples and, if we create a standard read-only dictionary for everyone to use, through read-only dictionaries. Note such a check would be just as helpful for products written using Python Methods, or DTML, as it would be for products written in plain Python. Then the security system doesn't need to keep track of where unprotected mutables came from. Once I've said explicitly that I intend to return an unprotected mutable, I can take care to return a copy that I don't use after I've passed it on to you. Andrew

1 0

Re: Zope security alert and hotfix product...
by Brian Lloyd 14 Aug '00

14 Aug '00

> > The issue involves the fact that the getRoles method of > user objects > > contained in the default UserFolder implementation returns > a mutable > > Python type. Because the mutable object is still > associated with the > > persistent User object, users with the ability to edit DTML could > > arrange to give themselves extra roles for the duration of > a single > > request by mutating the roles list as a part of the request > >processing. > > OK, so I can exploit this with something similar to > user.getRoles().append('A Role That I Dont Have') > > But, why isnt the append method covered by the new > inaccessible-by-default 2.2 security rules? Back when we were considering how much tightening would be considered acceptable in one dose, we ended up not preventing access to methods of mutable python types ([], {}). The main reason that we were aware of a fair number of people using this (including one or two internal things) for legitimate things: <dtml-var "REQUEST.set('some_stuff', [])"> <dtml-in other_stuff> <dtml-call "some_stuff.append(_['sequence-item'])"> </dtml-in> etc. So we made the decision not to break those things. The real problem, of course, is that the Zope APIs (and the APIs of add on products) should not return references to mutable subobjects. If an API method must return a mutable Python type, it should return a copy rather than a direct reference: def myMethod(self): # self.stuff is a dict # dont do this! return self.stuff # do this instead return self.stuff.copy() # or if stuff is a list either do: return self.stuff[:] # or return tuple(self.stuff) Now - should methods of mutable types be off-limits in the future? I'm not sure that the jury is in yet on that. Consider that PythonMethods (that soon will be part of the core) play by basically the same rules as dtml. While it might be pretty easy to argue that the list-juggling in my DTML example above is bad practice, I think most people would expect to be able to do: mylist=[] mylist.append('one') return mylist ...in a PythonMethod and have it work. I don't think it would be acceptable for 'append' to be off-limits in this case, so the alternative is that the security machinery would somehow have to be able to distinguish mutables created by the user from those obtained from the secure environment. That would probably mean that API code would have to make some sort of security assertions about mutables they returned. Exactly how that would work I don't know... Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

1 0

ZCatalog brains
by Steve Alexander 14 Aug '00

14 Aug '00

Is there any good reason that the "brains" returned by ZCatalog searches don't have a standard property that reflects the URL of the object they have meta-data from? This would seem to me to be more object-oriented, and would save calls to someCatalog.getpath(data_record_id_) in loops. Am I missing something? -- Steve Alexander Software Engineer Cat-Box limited http://www.cat-box.net

2 3

Re: Zope security alert and hotfix product...
by Toby Dickenson 14 Aug '00

14 Aug '00

On Thu, 10 Aug 2000 14:15:29 -0400, Brian Lloyd <Brian(a)digicool.com> wrote: > The issue involves the fact that the getRoles method of user objects > contained in the default UserFolder implementation returns a mutable > Python type. Because the mutable object is still associated with the > persistent User object, users with the ability to edit DTML could > arrange to give themselves extra roles for the duration of a single > request by mutating the roles list as a part of the request >processing. OK, so I can exploit this with something similar to user.getRoles().append('A Role That I Dont Have') But, why isnt the append method covered by the new inaccessible-by-default 2.2 security rules? Toby Dickenson tdickenson(a)geminidataloggers.com

1 0

RE: [Zope-dev] Cache-bug in handling of files
by Brian Lloyd 14 Aug '00

14 Aug '00

> I am using IE 5 (5.00.2919.6307), cache settings set to: > "Check for newer versions of stored pages: > Automatically > > Those settings should get the new file if it has changed. > > I am accessing the server through a proxy.. could that be a problem? I > think it would be strange if everyone accessing the website I am > building can see the new files.. > > What do you think? > > Peter Peter - I have done some testing here and I can demonstrate that this is an IE issue. I set my cache to "Automatically" like yours and restarted it. I then opened a Netscape and created a new file object. I instrumented the code in the 'index_html' method of File objects so that I could tell _for sure_ whether things were actually being called at the server or not. Here's what I did: - create a file 'myfile.txt', uploading a contents of text1.txt into it. - visit the view tab with IE. The server confirms that the index_html was called, and the whole content was sent, not a 304. - now (using netscape again) upload the contents of text2.txt into the file object. The mgmt screen correctly shows the updated byte length, etc. - click the 'view' tab again on IE. My instrumenting confirms that IE is not contacting the server *at all* no matter how many times I click the 'view' tab, and I keep seeing the old content. A look at the headers produced by this shows nothing that tells IE it should be doing that: HTTP/1.1 200 OK Server: Zope/(unreleased version) ZServer/1.1b1 Date: Fri, 11 Aug 2000 15:18:50 GMT Connection: close Content-Type: text/plain Content-Length: 944 Last-Modified: Fri, 11 Aug 2000 15:16:06 GMT Interestingly, if you open the "view" tab in a new window, you'll see the updated content. Now, using that same new window, set your cursor at the end of the url string in the url bar and hit return. IE seems to reload the page, but it is not actually even contacting the server. Stranger yet, if you click the "refresh" button it *will* contact the server (and it passes an If-Modified-Since header, and correctly gets a 304 Not Modified). Now, use netscape to change the content again. The whole thing starts over. Clicking the 'view' link on the page or pressing return in the URL bar will not even contact the server and the only way to get the updated content is to explicitly press "refresh" or open a new window, even though the resource returned no caching information one way or the other. I'm going to close that bug report and include this report for those who may find it useful in the future. Brian Lloyd brian(a)digicool.com Software Engineer 540.371.6909 Digital Creations http://www.digicool.com

4 3

zope221b1 - zclass zexp import into clean database error
by Dr. Ross Lazarus 13 Aug '00

13 Aug '00

More on testing zope221b1 - source tar, redhat 6.2 I seem to be the only one reporting problems on the list (0-:) - it really is just me. Thought I better try again - start with a clean slate So, I restarted zope with a new empty Data.fs from the 221b1 source distribution. Started as superuser, made a real user with manager/owner rights. Logged in as the real user, took ownership of the entire heirarchy. Tried to import a zclass zexp file freshly exported from 2.2.0 that I've been happily using with 2.2.0 and previously. Traceback appears below =========================================================== Zope Error Zope has encountered an error while publishing this resource. Error Type: Permission mapping error Error Value: Attempted to map a permission to a permission, Add SMP Blocks, that is not valid. This should never happen. (Waaa). -------------------------------------------------------------------------------- Troubleshooting Suggestions The URL may be incorrect. The parameters passed to this resource may be incorrect. A resource that this resource relies on may be encountering an error. For more detailed information about the error, please refer to the HTML source for this page. If the error persists please contact the site maintainer. Thank you for your patience. Traceback (innermost last): File /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, line 222, in publish_module File /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, line 187, in publish File /usr/local/home/rossl/zope221b1/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook (Object: Traversable) File /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, line 171, in publish File /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_importObject) File /usr/local/home/rossl/zope221b1/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_importObject) File /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, line 508, in manage_importObject (Object: Traversable) File /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, line 263, in _setObject (Object: Traversable) File /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, line 271, in manage_afterAdd (Object: Traversable) File /usr/local/home/rossl/zope221b1/lib/python/ZClasses/ZClass.py, line 422, in manage_afterAdd (Object: ZBlockStore) File /usr/local/home/rossl/zope221b1/lib/python/OFS/ObjectManager.py, line 271, in manage_afterAdd (Object: Traversable) File /usr/local/home/rossl/zope221b1/lib/python/App/Factory.py, line 144, in manage_afterAdd (Object: RoleManager) File /usr/local/home/rossl/zope221b1/lib/python/AccessControl/PermissionMapping.py, line 137, in manage_setPermissionMapping (Object: RoleManager) (Info: (['', 'Access contents information', 'Add Database Methods', 'Add Documents, Files, and Images', 'Add Documents, Images, and Files', 'Add External Methods', 'Add Folders', 'Add LDAPAdapter Object', 'Add MailHost objects', 'Add Survey Creator', 'Add Sybase Database Connections', 'Add TinyTable', 'Add User Folders', 'Add Versions', 'Add Vocabularies', 'Add Z Gadfly Database Connections', 'Add ZCatalogs', 'Add ZWiki Pages', 'Add Zope Tutorials', 'Browse LDAPAdapter', 'Change DTML Documents', 'Change DTML Methods', 'Change Database Connections', 'Change Database Methods', 'Change External Methods', 'Change Images and Files', 'Change LDAPAdapter', 'Change TinyTable', 'Change Versions', 'Change ZWiki Pages', 'Change configuration', 'Change permissions', 'Change proxy roles', 'Change survey', 'Create class instances', 'Create survey', 'Delete objects', 'Edit Factories', 'FTP access', 'Import/Export objects', 'Join/leave Versions', 'Manage Vocabulary', 'Manage Z Classes', 'Manage ZCatalog Entries', 'Manage properties', 'Manage users', 'Open/Close Database Connection', 'Open/Close Database Connections', 'Query TinyTable Data', 'Query Vocabulary', 'Save/discard Version changes', 'Search ZCatalog', 'Submit survey', 'Take ownership', 'Test Database Connections', 'Undo changes', 'Use Database Methods', 'Use Factories', 'Use mailhost services', 'View', 'View History', 'View management screens'], 'Add SMP Blocks', 0)) Permission mapping error: (see above)

1 0

RE: [Zope-dev] OFS.objectManager checking object Ids
by Jay, Dylan 11 Aug '00

11 Aug '00

As I said, when the url is quoted there is no problem. http://azonia.auslabs.lucent.com/Auslabs/AuslabsFAQ/Where%20is%20X%3f causes no problems. The above object is sitting happily inside Zope with a question mark at the end. I had to let the bad_id check let it pass but is there any reason why it shouldn't? > -----Original Message----- > From: David C. Kankiewicz [mailto:kankie@thegrid.net] > Sent: Thursday, August 10, 2000 3:52 PM > To: Jay, Dylan > Subject: Re: [Zope-dev] OFS.objectManager checking object Ids > > > "Jay, Dylan" wrote: > > > > This seems to be a new thing in Zope 2.2, however it is breaking > > functionality that I had before. I was able to add objects > with ids that had > > a "?" in them. This gets quoted in links and seems to be > handled fine by > > zope (both 2.2 and older versions). Why can't I have > question marks in my > > objects then? Should I submit the inclusion of a the "?" as > a valid char in > > and id as a bug? > > The reason is related to the URL to your object could be > misinterpreted as a 'get' method... > > Server/path_to_object/object?name=foo > > The '?' means place the names:values in REQUEST, if the object has a > '?' in its id anything after it would be interpreted has such and zope > would try to publish a object with the id minus the '?' and anything > after it (which probably doesn't exist...). > > > Did you ever run into the above problem with the id 'names?'? No pun > intended ;). > I curious, maybe you were using for just this reason? > > > David > > > > > ---- > > Dylan Jay Tel: +61 2 9886-8961 > > Avaya Communication FAX: +61 2 9352 9224 > > Level 5, 15 Talavera Road Mobile:+61 409 606 171 > > Nth Ryde, NSW, 2113 ICQ: 520341 > > AUSTRALIA >

4 3