- Zope-Dev - Zope lists

ZCatalog text index search bugs?
by R. David Murray 12 Jun '00

12 Jun '00

I am very confused. I'm looking at the SearchIndex source under 2.1.4 (2.1.6 seems to be the same). In Lexicon.py the 'query' method defines the default_operator to be 'or'. I can't see that TextIndex overrides this when it calls it. But the response to PR 1141 (against 2.1.6) in the collector says: The TextIndex search does an AND, not an OR, of the search words: if you ask it to find "foo bar", it returns only objects matching *both* "foo" and "bar", rather than object matching *either* "foo" or "bar" (which Jason expected). Indeed, if you do a search that includes a word that is not on an item, the item is not returned. So how is that working? A possible answer is: if you do a search like 'something or somethingelse', this *also* does not return the object if one of those words is not on the object. So is 'or' searching broken? Note that if you do a search like "something or with", this returns the object, "with" being a stop word. So does "something with". On the other hand, "something and with" does *not* return the object. So I think 'or' searching is broken, and that text indexes being a default 'and' search is just an accident <grin>. Following up on the 'something and with', though: Since "with" is a stop word, it can never be on the object. Since the user entering search words into the search form doesn't know what the list of stop words is, this stikes me as broken behavior. Anyone disagree? I also have a problem with a word such as "T-shirt". If I search on "T-shirt", my object that has that word in its text index does not show up. The splitter should be breaking that into "t" and "shirt", right? Is the problem that single letters are discarded by the Splitter, therefore T is like a stop word (but it isn't in the stopword table), therefore the implicit 'and' search(*) fails? To corroborate this, a search for "something t" finds that record, but "something and t" does not. This can't be the whole answer, though, since searching on just 'shirt' does *not* return the object. (*) I recall reading that the 'near' operator, which is used if the splitter breaks up a word in the search string, is not really supported and that the 'and' operator is used instead.) I can't tell yet if this bug is (these bugs are?) fixed in 2.2.0b1 since I can't see the source release yet. Looking at the a1 source, things have moved around a bit. But I see that "default_operator" is still set to 'or', so I suspect these bugs may remain... If I can reproduce this in 2.2.0b I'll file it in the collector. --RDM

1 0

More useful CatalogAware class?
by Michel Pelletier 12 Jun '00

12 Jun '00

Amos and I and the guys at Activestate were discussing cataloging at a recent training sessions and we came up with the following possible successor to CatalogAware. The idea is that a CatalogAware object looks for two methods that return sequecnes of Catalogs that many be interested in this object. The first is class defined method 'getClassCatalogs', the second is an instance defined method 'getLocationCatalogs' that the instance can get from its classes, its instance dict, or acquisition. The idea is that you provide methods that define the policy for finding Catalogs. The default class defined 'getClassCatalogs' is identical behavior to the old CatalogAware, but you can and probably will override it. Thoughts? -Michel """ This is a candidate successor to the CatalogAware class. """ class CatalogAware: meta_type = 'CatalogAware' default_catalog = 'Catalog' def getClassCatalogs(self): """ You want to over ride this method if you don't like the default policy of acquire a Catalog named 'Catalog' """ if hasattr(self, self.default_catalog): return [getattr(self, self.default_catalog)] def manage_afterAdd(self, item, container): self.catalog_object() for object in self.objectValues(): try: s=object._p_changed except: s=0 object.manage_afterAdd(item, container) if s is None: object._p_deactivate() def manage_afterClone(self, item): self.catalog_object() for object in self.objectValues(): try: s=object._p_changed except: s=0 object.manage_afterClone(item) if s is None: object._p_deactivate() def manage_beforeDelete(self, item, container): self.uncatalog_object() for object in self.objectValues(): try: s=object._p_changed except: s=0 object.manage_beforeDelete(item, container) if s is None: object._p_deactivate() def get_catalogs(self): cats = [] # first, try and call a class defined method to get # catalogs... we don't want to acquire... if hasattr(self.aq_base, getClassCatalogs): for cat in self.getClassCatalogs(): if cat not in cats: cats.append(cat) if hasattr(self, getLocationCatalogs): # next, try and call a method that can be class defined, # instance defined, or acquired. for cat in self.getLocationCatalogs(): if cat not in cats: cats.append(cat) return cats def catalog_object(self): """ Call this to catalog yourself """ for catalog in self.get_catalogs(): catalog.catalog_object(self, self.getPhysicalPath()) def uncatalog_object(self): """ Call this to uncatalog yourself """ for catalog in self.get_catalogs(): catalog.uncatalog_object(self.getPhysicalPath()) def recatalog_object(self): self.uncatalog_object() self.catalog_object()

2 1

Proposed interface for application-level conflict resolution in ZODB
by Jim Fulton 12 Jun '00

12 Jun '00

Zope takes a pretty optimistic approach to dealing with conflicting database changes. Sometimes, there may be "hot spots" in an application that get a lot of simultaneous writes. These hot spots can often be designed away. An alternative is to provide application-level logic for sorting out the changes made by conflicting writes. The proposed interface at: http://www.zope.org/Members/jim/ZODB/ApplicationLevelConflictResolution provides a way to provide this application logic. Jim -- Jim Fulton mailto:jim@digicool.com Python Powered! Technical Director (888) 344-4332 http://www.python.org Digital Creations http://www.digicool.com http://www.zope.org Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.

1 0

advice on MountedFileStorage changes.
by Anthony Baxter 12 Jun '00

12 Jun '00

I've nearly completed the code to make MountedFileStorage able to create new FileStorages on demand, _however_... I'm hitting a bit of a problem with the Product initialisation. Right now I'm just calling OFS.Application.initialize(), which goes through and re-imports all the products, and adds them to the global meta_types list. This is bad - it means it's slow as hell reimporting everything, and everything gets listed twice. It's fine after a restart, but that's not much help. I can't just skip product initialisation, as it's kinda needed to create objects in the sub-zodb. So, approaches I'm considering: passing a flag through initialize() saying 'don't put products in the meta_types' (seems hacky). subclassing OFS.Application.Application, and copying the method except for the last line that alters the meta_types (fragile - have to track changes to the main body of code). trying something else entirely, such as copying the products from the main products folder, and installing them that way... ? Any ideas appreciated. (There's an ongoing issue, too - there will need to be some sort of way to copy any new/changed Products from the main ZODB to the children...) Anthony

2 1

Testing external methods with arguments [PATCH]
by Gisle Aas 12 Jun '00

12 Jun '00

While writing on the perl external method product I back ported its "Try It!" support to also work for python external methods that take arguments. The change is fairly simple. Clicking the "Try it!" tab takes you to a screen where you get a chance to fill out the arguments for the method before you actually call it. If the function takes no arguments, then things work the same as they do today. I introduced a "call" alias for "__call__" in order to be able to actaully call the method object from the DTML method. Is there a better way? Regards, Gisle Index: lib/python/Products/ExternalMethod//ExternalMethod.py =================================================================== RCS file: /local/src/CVSROOT/Zope2/lib/python/Products/ExternalMethod/ExternalMethod.py,v retrieving revision 1.1.1.1 diff -u -p -u -r1.1.1.1 ExternalMethod.py --- lib/python/Products/ExternalMethod//ExternalMethod.py 2000/06/07 20:38:02 1.1.1.1 +++ lib/python/Products/ExternalMethod//ExternalMethod.py 2000/06/12 13:41:22 @@ -160,7 +160,7 @@ class ExternalMethod(OFS.SimpleItem.Item ( {'label':'Properties', 'action':'manage_main', 'help':('ExternalMethod','External-Method_Properties.dtml')}, - {'label':'Try It', 'action':'', + {'label':'Try It', 'action':'manage_try', 'help':('ExternalMethod','External-Method_Try-It.dtml')}, ) +OFS.SimpleItem.Item.manage_options @@ -205,6 +205,8 @@ class ExternalMethod(OFS.SimpleItem.Item action =REQUEST['URL1']+'/manage_main', target ='manage_main') + manage_try=HTMLFile('methodTry', globals()) + def getFunction(self, check=0, reload=0): f=getObject(self._module, self._function, reload) @@ -271,7 +273,8 @@ class ExternalMethod(OFS.SimpleItem.Item raise TypeError, v, tb finally: tb=None - + + call = __call__ def function(self): return self._function def module(self): return self._module The 'methodTry.dtml' file looks like this: ------------------------------------------------------------------>8-------- <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd"> <HTML lang="en"> <HEAD> <TITLE>Edit <dtml-var title_or_id></TITLE> </HEAD> <BODY BGCOLOR="#FFFFFF" LINK="#000099" VLINK="#555555" ALINK="#77003B"> <dtml-var manage_tabs> <FORM ACTION="<dtml-var URL1>" METHOD="GET"> <h2>Calling <dtml-var title_or_id> <dtml-with func_code> <dtml-if co_argcount> with arguments: </h2> <table border=0> <dtml-in co_varnames> <dtml-if "_['sequence-index'] < co_argcount"> <tr><td align=right><b><dtml-var sequence-item html_quote></b>:</td> <td> <dtml-if "_['sequence-item'] in ('self', 'REQUEST')"> <i>Provided by Zope's ZPublisher internally</i> <dtml-else> <input name="<dtml-var sequence-item html_quote>" size=30> </dtml-if> </td> </tr> </dtml-if> </dtml-in> </table> <dtml-else> with no arguments!</h2> <dtml-comment> <dtml-raise type="Redirect"><dtml-var URL1></dtml-raise> </dtml-comment> <dtml-return call> </dtml-if> </dtml-with> <INPUT TYPE="SUBMIT" VALUE="Execute"></TD> </FORM> </BODY> </HTML> ------------------------------------------------------------------>8--------

1 0

broken products after update
by Doug Wyatt 11 Jun '00

11 Jun '00

Hi, I just updated from Zope 2.0.1 to 2.1.6. All of the Python-based products I was using previously have been migrated successfully. But I have a number of products that I created with ZClasses. I can examine these products in the control panel, and everything is there and looks fine, but all of these classes' object instances are broken. I get this message when clicking on one in the management interface: "This object is broken because the unknown product that created it is no longer installed or is installed incorrectly. Please contact your product vendor for assistance." "Note that the data associated with this product has not been lost, and will be accessible again if the product is reinstalled." I'll keep digging for documentation I may have missed, but I'd really appreciate some help. Doug (would appreciate copies by private email as I am on the digest) -- Doug Wyatt doug(a)sonosphere.com http://www.sonosphere.com/

2 1

SOLVED: broken products after update
by Doug Wyatt 11 Jun '00

11 Jun '00

OK, I finally dug far enough through the list archives to find a suggestion that worked. My old Zope had lots of products installed. I wasn't using a lot of them, so I didn't install them into the new Zope. To solve the problem, I had to delete from the database the products that were no longer installed. To be able to delete ZDiscussions (I think it was), I had to actually copy Products/ZDBase into the new installation. Then I could delete the products that depended on it. Now that the database no longer refers to products which are no longer installed, all is well. I seem to remember a comment somewhere, saying that this was on DC's radar as something to fix. Please :-) Thanks, Doug - - - - - Hi, I just updated from Zope 2.0.1 to 2.1.6. All of the Python-based products I was using previously have been migrated successfully. But I have a number of products that I created with ZClasses. I can examine these products in the control panel, and everything is there and looks fine, but all of these classes' object instances are broken. I get this message when clicking on one in the management interface: "This object is broken because the unknown product that created it is no longer installed or is installed incorrectly. Please contact your product vendor for assistance." "Note that the data associated with this product has not been lost, and will be accessible again if the product is reinstalled." I'll keep digging for documentation I may have missed, but I'd really appreciate some help. Doug (would appreciate copies by private email as I am on the digest) -- Doug Wyatt doug(a)sonosphere.com http://www.sonosphere.com/

1 0

Re: [Zope-dev] advice on MountedFileStorage changes.
by Anthony Baxter 11 Jun '00

11 Jun '00

>>> Anthony Baxter wrote > > I've nearly completed the code to make MountedFileStorage able to > create new FileStorages on demand, _however_... > > I'm hitting a bit of a problem with the Product initialisation. Right > now I'm just calling OFS.Application.initialize(), which goes through > and re-imports all the products, and adds them to the global meta_types > list. This is bad - it means it's slow as hell reimporting everything, > and everything gets listed twice. It's fine after a restart, but that's > not much help. Ok, I've gone with the 'subclass Application' approach, and made a couple of slight changes to the core code. Now, stuff won't be added to global registries like Products.meta_types if the application doesn't have isTopLevelPrincipiaApplicationObject set to true. It seems to work well, patch follows - any comments? Anthony. This patch (against current CVS, 2000-06-11) stops the addition of a new MountedFileStorage adding all the products to the master meta_types list. It's not _essential_, but without it, you'll find you need to restart Zope to get the 'Add' list back to sanity. Index: OFS/Application.py =================================================================== RCS file: /cvs-repository/Zope2/lib/python/OFS/Application.py,v retrieving revision 1.128 diff -u -r1.128 Application.py --- Application.py 2000/06/09 23:52:45 1.128 +++ Application.py 2000/06/11 07:00:30 @@ -511,7 +511,8 @@ error=sys.exc_info()) get_transaction().abort() - Products.meta_types=Products.meta_types+tuple(meta_types) + if app.isTopLevelPrincipiaApplicationObject: + Products.meta_types=Products.meta_types+tuple(meta_types) Globals.default__class_init__(Folder) Index: App/ProductContext.py =================================================================== RCS file: /cvs-repository/Zope2/lib/python/App/ProductContext.py,v retrieving revision 1.22 diff -u -r1.22 ProductContext.py --- ProductContext.py 2000/06/09 01:22:13 1.22 +++ ProductContext.py 2000/06/11 07:00:30 @@ -202,12 +202,13 @@ if not hasattr(pack, '_m'): pack._m={} m=pack._m - Products.meta_types=Products.meta_types+( - { 'name': meta_type or instance_class.meta_type, - 'action': ('manage_addProduct/%s/%s' % (pid, name)), - 'product': pid, - 'permission': permission, - },) + if app.isTopLevelPrincipiaApplicationObject: + Products.meta_types=Products.meta_types+( + { 'name': meta_type or instance_class.meta_type, + 'action': ('manage_addProduct/%s/%s' % (pid, name)), + 'product': pid, + 'permission': permission, + },) m[name]=initial m[name+'__roles__']=pr

1 0

Re: [Zope-dev] Externalize or Adapt? (ZPatterns)
by Phillip J. Eby 10 Jun '00

10 Jun '00

At 05:46 PM 6/9/00 +0800, Mike wrote: >Great! Excellent! >Thank you Phillip for a good explanation. >I guess should write something like for the ZPatterns Wiki. Ty added it yesterday, and I've linked to it as DropZoneExample from various points in the Wiki. > >One more thing we still need is a set of 'right hand' rules. >Let me try to formalize ZPatterns-based design process. > >1. Write scenario (client comes to skydiving office blah blah blah...) >2. Detect roles learning scenario (Orders, Planes, Students etc) >3. Create an empty (blackbox) Specialist for each role >4. Populate the specialists with methods implementing roles >5. Create (whitebox) specialists implementing scenario > >Thus, the object classes (Customer, Order) went nowhere. The things >ruled by black specialists are just identity markers, without methods, >types and names. Not quite. There are three problem domains here: two reused horizontal domains (accounting and resource scheduling) and one vertical domain (skydiving facility). The two horizontal domains contain blackbox Specialists such as Invoices and Reservations. You don't modify the black boxes, because that's what you're reusing. The horizontal domains also contain whiteboxes: Customer, Resource, ResourceUser, etc. These just contain the data handling needed to adapt a "Party" or other basic object to be usable as a Customer or ResourceUser. These whiteboxes are your hook point to interface the framework to a larger application. You just tell it where "Party" objects are. >Or is the object an specialist specific internal abstraction which never >leaves specialist's frames and have methods and type just for >specialist's fun? Not quite. See below. >"Phillip J. Eby" wrote: >> First, I'm going to create some ZClasses, and specialists to go with them: >> SkyDiver, Pilot, Airplane, FlightManifest, RentalTicket, RentalItem >> (w/subclass for Parachute, Helmet, and certain other specific items). Then >> I'm going to set up the Resources and Products specialists to access my own >> specialists for these ZClasses. (Notice that I am going in and directly > >How you will set up those specialists? By adding >get(Resources|Products)Specialist methods? I will add a "retrieveItem" method to the Specialist which, instead of accessing a rack in the local specialist (the default implementation), it will instead call (for example) SkyDivers.getItem(). Thus, when you call Customers.getItem(), you will actually get an object from the SkyDivers specialist. In other words, I make the horizontal domain specialist delegate to the vertical specialist. >> that a Party plays in a resource scheduling system. SkyDiver, then should >> implement a Party interface, allowing it to be *used as* a Customer or >> ResourceUser. Thus, SkyDiver can be used by *any* framework that needs to >> collaborate with a Party object, although it may have a new *role* in which >> the party will be used. For example, if I later add a curriculum >> management system to cover my skydiver training courses, I will want >> SkyDiver to fill the Student role. > >Well, we have two specialists, implementing roles (again, who _actually_ >implements the role, specialist or class, CustomerSpecialist or >Customer?). The SkyDiver implements its own behavior. The Customers specialist implements anything relating to customers as a group, or to creating a new customer. To do this, it may have to ask the SkyDivers specialist to do things on its behalf. For example, if the billing system lets you add customers, it will end up actually asking the SkyDivers specialist to add a SkyDiver, and will use the SkyDivers specialist's forms to get the necessary information to create one. >Now, "SkyDiver ... *used as*" means we should: > > 1. subclass (not a good choice) > 2. implement interface > 2.1. by copying and pasting methods code (or whole methoids) > 2.2. by proxiyng (SkyDiver has a references to actual Customer > and ResourceUser) > 2.3. by transmitting messages to SkyDiverSpecialist which will pass > unhandled messages to CustomerSpecialist and > ResourceUserSpecialist (this is a variant of 2.2. case) > >The 2.3. case means we should use objects without types (identity >markers). None of the above. SkyDiver should inherit from a Party base class. For Customer and ResourceUser behavior, one adds propertysheets whose class is provided by the respective frameworks. This is extension through *composition*, rather than inheritance. It is similar to the COM approach, where you can ask an object to give you a pointer to an interface. In this approach, you ask for a propertysheet that provides the interface. >> I will also make some changes to each of these specialists to replace >> certain common UI snippets to be relevant to the kinds of things I'm >> dealing with. For example, in the Customers and ResourceUsers Specialists, >> I will replace the findForm method (if that's what it's called) to be a >> call to SkyDivers.findForm - a form that searches for skydivers by their >> ratings, certification, or freefall style, as well as name or phone number. > >How about Editor and Renderer plug-ins for each specialist? I think that they are not necessarily a good idea. I don't really see a value-add over just having a DTML (or other) method. The requesting Specialist just wants a page snippet, with at most some parameters indicating what field name it would like the selected object to have. Now, it may make sense at some point to make (generally useful) Form objects which can return such snippets. I haven't had a chance to look at ZFormulator or MetaPublisher, which I understand may both have some applicable solutions in the form rendering area. >> lifting" machinery and plug it into their local specialists, then gut the >> collaborator specialist and wire it to the appropriate local specialist. > >If I understand something at all, whitebox specialist (Script?) called >SkyDiverSpecialist must have its own data source (rack) for SkyDiver >class and use 2.2. strategy mentioned above. (I just see no other way). Very close. It's just done more simply, and doesn't need the co-operation of the SkyDiver class. The SkyDivers specialist simply provides them as propertysheets. In this way, you can "adapt" between frameworks as long as you always use propertysheets as whitebox "decorators". So, if you have a document management system (knows about authors, revisions, etc.), and a project management system (knows about assigments, deadlines), you can make them work together if the project management system stores assignment/deadline stuff in a project management-specific sheet. And with ZPatterns, it's easy to add support for that sheet to existing objects - without altering existing code. Just plug the sheet providers into the appropriate specialists, and then extend the project management system's Tasks specialist to be able to delegate to your Documents specialist, as well as any others it needs to talk to. Granted, some integrations like this may be complex, especially once you start factoring indexes and searches and integrity rules. However, they are at least *possible* with ZPatterns, and the results should be worth the work. One of the very first inspirations for ZPatterns was a mailing-list discussion about event scheduling in Zope. It made me realize that there wasn't a good way to mingle horizontal and vertical frameworks in Zope. i.e., you couldn't easily go back in and add event scheduling or project management to a bunch of classes that you got from somebody else, or even your own classes, without changing your base classes or other really nasty things (like copying code). So, when used as framework glue, ZPatterns emphasises run-time composition rather than code-time inheritance. Of course, ZPatterns can be used as just an application-building framework on its own, but if used wisely, your applications should then be reusable as frameworks by others.

2 3

[TRACE] Unable to mount mountable storage
by Bill Anderson 10 Jun '00

10 Jun '00

OK, thought I would start playing with this... Figured I would load a separate site to start with . It fails, claiming it cant load oid. The site is orignally on 2.1.6, if it matters. Then I copied the current Data,fs to foo.fs, and figured I'd give it a try, being a new .fs and all. It complains about duplicate ids. What am I missing? I can copy Data.fs.in to a new name, and mount it fine. OID TRACEBACK: ========================== Traceback (innermost last): File /home/ucntcme/ZopeTest/lib/python/ZPublisher/Publish.py, line 222, in publish_module File /home/ucntcme/ZopeTest/lib/python/ZPublisher/Publish.py, line 187, in publish File /home/ucntcme/ZopeTest/lib/python/Zope/__init__.py, line 221, in zpublisher_exception_hook File /home/ucntcme/ZopeTest/lib/python/ZPublisher/Publish.py, line 171, in publish File /home/ucntcme/ZopeTest/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_addMountedFileStorage) File /home/ucntcme/ZopeTest/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_addMountedFileStorage) File /home/ucntcme/ZopeTest/lib/python/Products/MountedFileStorage/MountedFileStorage.py, line 24, in manage_addMountedFileStorage File /home/ucntcme/ZopeTest/lib/python/OFS/ObjectManager.py, line 260, in _setObject (Object: ApplicationDefaultPermissions) File /home/ucntcme/ZopeTest/lib/python/OFS/ObjectManager.py, line 267, in manage_afterAdd (Object: ApplicationDefaultPermissions) File /home/ucntcme/ZopeTest/lib/python/OFS/ObjectManager.py, line 267, in manage_afterAdd (Object: ElementWithAttributes) File /home/ucntcme/ZopeTest/lib/python/OFS/ObjectManager.py, line 267, in manage_afterAdd (Object: ElementWithAttributes) File /home/ucntcme/ZopeTest/lib/python/OFS/ObjectManager.py, line 267, in manage_afterAdd (Object: ElementWithAttributes) File /home/ucntcme/ZopeTest/lib/python/ZClasses/ZClass.py, line 417, in manage_afterAdd (Object: ManagedMeeting) File /home/ucntcme/ZopeTest/lib/python/ZClasses/ZClass.py, line 370, in _register (Object: ManagedMeeting) File /home/ucntcme/ZopeTest/lib/python/ZODB/Connection.py, line 441, in setstate File /home/ucntcme/ZopeTest/lib/python/ZODB/Connection.py, line 213, in _persistent_load (Info: onClass\012ExtensionClass\012q\001(U\006LMUserq\002(cZClasses.ZClass\012PersistentClass\012q\003cProducts.LoginManager.UserSources\012LoginUser\012q\004cOFS.SimpleItem\012SimpleItem\012q\005tq\006}q\007(U\004iconq\010U\000U\012_p_changedq\011K\001U\007__doc__q\012U\007LM Userq\013U\006_p_oidq\014U\010\000\000\000\000\000\000\004rq\015U\011meta_typeq\016U\007LM Userq\017U\005Fnameq\020U\000U\016propertysheetsq\021U\010\000\000\000\000\000\000\004wq\022QU\005Lnameq\023U\000U\016manage_optionsq\024)U\006passwdq\025U\000U\022__ac_permissions__q\026)U\011_p_serialq\027U\010\0034\353#\315f\322\346q\030U\012__module__q\031U\031*ykluV9yvI34UID2R6HV/dQ==q\032utq\033t.N.')) Could not load oid

2 2