- Zope - Zope lists

Re: ZCatalog searching bugs + fixes.
by Michel Pelletier 03 May '00

03 May '00

Maas-Maarten Zeeman wrote: > > Hello Michel, > > After some testing with ZCatalog I discovered that only one the AND > operator with UnTextIndexes works correctly. After some further > investigation I fixed the probles with the OR and the AND_NOT > opererator. Here are the fixes. Cool. > The ANDNOT operator was a silly bug. > > In ResultList.py change: <snip> This has actually be fixed in the CVS for a couple weeks now I believe. Were you working against a CVS version? > The OR bug was a bit more complicated. It only worked if the left and > right operands where filled with data so if you was searching for > something that was not in the Lexicon and something that was you would > get nothing as a search result. > > The problem is that a KeyError is raised when the search term is not in > the lexicon. So the search is stopped instantly. > > The fix for the OR bug > > An extra get operator for Lexicon > > def get(self, key, default=None): > """ overload mapping behavior """ > return self._lexicon.get(key, default) > > and change the following line in '__getitem__' in UnTextIndex > # r = self._index.get(self._lexicon[word], None) > too > r = self._index.get(self._lexicon.get(word), None) Ah yes, silly error. Could you please submit this to the Collector? > The Near operator also doesn't work. I'm not sure how to fix this > because UnTextIndexes don't safe position information. This code is legacy code from ZTables, I didn't write it and I also didn't take it out, it's kinda like your appendix, you don't use it but it's there. In the future, indexes may store positional information. > All these bugs leaves me wondering if the catch all used in > _indexedSearch is necessary. If this was programmed less blunt the > errors would have been noticed much more early. You're right. This method is also a carry over from ZTables. > Another question I have about ZCatalog is the following: Is ZCatalog > usable for searching and indexing gigabytes text? That's a hard question to answer. The short answer is yes. Over time, if you index your content incrementally, then you can easily text index gigabytes of text. If you were to try to feed gigabytes of text into Zope all in one shot, it would probably fail either due to: 1) not enough memory (no subtransations) 2) not enough tmp storage (with subtransactions) Since Zope is transactional, all changes are accumlated before commit. Because this commit happens 'all at once' for all objects a commit on gigabytes of objects *plus* indexes for them would take hours, days maybe. This is not a good way to do it. The best way index content is gradually, over time. We call this 'incremental' indexing. Using this slow scheme you could easily index gigabytes of text. -Michel

1 0

Properties disappearing inside <dtml-with>
by Mike Orr 02 May '00

02 May '00

I have a bunch of DTML Documents that call a group_html_footer (DTML Method) before standard_html_footer. Inside this method I need access to "title" (the document title) and "state" (a property in the document). I also need access to the images inside a "glue_images" folder. (The folder contains two images -- "glue_hr" and "gluemem" -- and nothing else.) Inside the method I have a <dtml-with glue_images> ... </dtml-with glue_images> block to pick up the images. For some reason, "title" and "state" are empty inside the block but are fine outside. I thought this was only supposed to happen with the "only" attribute. The following test code illustrates it. My state is <dtml-var state> My title is <dtml-var title> <dtml-with glue_images> My state is <dtml-var state> My title is <dtml-var title> ... REST OF METHOD </dtml-with glue_images> Results in: My state is CO My title is Colorado My state is My title is As a workaround, I turned the dtml-with to <dtml-let gluehr="glue_images.gluehr"> ... </dtml-let> This fortunately does not hide the other variables. Why is dtml-with eating my variables? -- -Mike Orr, mso(a)mso.oz.net -or- mso(a)oz.net (permanent: mso(a)jimpick.com) http://mso.oz.net/ English * Esperanto * Russkiy * Deutsch * Espan~ol

1 0

EOFError: end of stream during parse (Gadfly? SQLSession? Sybase?)
by Hung Jung Lu 02 May '00

02 May '00

Hi, I am getting this error quite often: Error Type: EOFError Error Value: end of stream during parse near :: "urOBv9CS7Mzi0g'"*"\012AND name = 'fi" I suspect that it is coming from Gadfly with SQLSession, but it could also be coming from Sybase. This happens randomly (so it's hard to repreduce) and goes away with a click on the Refresh button. Has anyone seen something similar? Any idea how to debug it? regards, Hung Jung ________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com

1 0

Looking for San Francisco Zope Developers (RFP)
by Om Dixon 02 May '00

02 May '00

Need Zope developer(s) to work with us here in San Francisco to set-up a content management system and tie it into our back end. Please email or call for further detail. Need to get this project underway ASAP. Thanks. -Om ----------- Om Dixon Senior Content Developer AuctionFlow 679 Bryant St. San Francisco, CA 94107 tel: 415/512.8000 x.112 fax: 415/512.0100

1 0

only folders and DTMLDocument's
by Jorge Magalhaes 02 May '00

02 May '00

In my <dtml-tree> </dtml-tree> i want see only the folders and DTMLDocument's. How i can do it? Have a nice day Thanks in advance || Jorge

2 1

newbie ?: zclass propertysheet datatypes
by Daniel Chudnov 02 May '00

02 May '00

Trying to add a date property to a class, Zope's giving me an "Invalid Date-Time String" when I leave the initial value blank. Is this a configuration problem (rh6.0, Zope 2.1.6 w/zserver) or by design? There shouldn't be a default value for this property in the interface I'm building... TIA, -Dan

1 0

Re: [Zope] Changing Zclass Base Classes
by julio dinis 02 May '00

02 May '00

>CatalogAware ensures that objects are added to the catalog *when they >are >created*. The easiest thing to do would be to use the Find >command in the >Catalog to add the objects. Ok, I know that... But in my case the best way is to have my objects indexed in the catalog automatically *when created* adding this base class. My problem remains with my older instances before the adition of the CatalogAware base class. They are somehow broken but I cant debug that. >BTW, those objects are aware that they have CatalogAware as a base > >class...you'll probably get an error if you try to delete one, >because >it is not in the catalog, and the CatalogAware code will try >to remove it >from the >catalog. No :( thats not the case. I can delete with no prob. I've made restarts and still the older instances arent aware that they have CatalogAware as base class. Something is wrong, but I dont no what because everything looks ok, no broken products, etc. The new instances I create are aware of the new base class, but the older ones are just something apart from my and zope's logic. Anyway, thanks Kevin. ps. I love kmnetnews ;-) ________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com

2 1

Transparent Folders
by Jason Spisak 02 May '00

02 May '00

I just tried this out and it is hot! I tried arbitrary nesting of multiple transparent folders. I'll keep testing it. Nice product. I think it should be in 2.0. All my best, -- Jason Spisak 444(a)hiretechs.com

1 0

Time Lapse Natural Wonder
by Jerry 02 May '00

02 May '00

Hi Zope Fans, Maybe I'm just a hopeless geek, but I have to say this. Watching the development of Zope and the Zope Community taking form on these lists is about as awe inspiring as trying to imagine a caterpiller pulling itself apart by the chromosomes and reconstructing itself into a butterfly. You can watch it happen, with your own eyes, know it's real, and still never comprehend even faintest glimmer of how such a thing can take place. Zope was a caterpiller, a natural wonder in its own right, however modest it may have appeared to many, who only saw a crawling leaf muncher. ZEO, PTK, ZopeStudio, RIPP, and all the rest are setting Zope up to blow the minds of any Web Hacker who ever thought he know what HTML was for. Thanks so much to all of you amazing folks! Sincerely, Jerry S.

1 0

DateTime.py patch
by Shane Hathaway 02 May '00

02 May '00

Zope fans, I have just done a line-by-line audit of DateTime.py. There were a number of issues, some of which have been submitted to the collector. I have corrected everything I could find. Gregor Hoffleit recently submitted a patch for DateTime.py as well. He made some of the same corrections I did, though in a different way. The major changes are: - Usage of integer arithmetic where possible to eliminate rounding errors. - Better support for daylight savings time. - Usage of long integer milliseconds, making it possible to do date comparisons with more predictable results. - Date comparisons are now time zone independent, meaning that a DateTime set to 3:00 PM in GMT-5 is equivalent to a DateTime set to 4:00 PM in GMT-4. If do any work with Zope's DateTime or have had any issues with it, please install this patch so it can be fully tested. I have already tested it to the best of my ability. I expect this to become part of the main distribution once it has been tested. http://www.zope.org/Members/hathawsh/DateTime.py There is one change made by Gregor which I feel I could not incorporate. Gregor added the "CET" and "CEST" time zones to the list of recognized time zones. Rather than add it now, I would prefer to get a complete list of zones which are not included (EDT, which happens to be the time zone I am in right now, is also missing.) For now, those zones should be correctly translated to GMT offsets. On a slightly different note: Recently there was a thread that described a problem with the time format of Z2.log. That problem is unrelated to DateTime.py. ZServer/medusa/http_server is written incorrectly; where it accesses gmtime() it ought to be calling localtime(). Also, it needs to be updated for daylight savings time the same way DateTime was. Shane

1 0