Howdy, I've begun using ZCatalogs and I really like them. I've run into a problem though. I've indexed about 10,000 folders, and I'm trying to query using the "path" to the objects. It seems like I can only look in a maximum of 32 paths before I get a Zope error (error traceback at the bottom). Are there any ideas on how to get around this limitation? I'm going to try and figure out where this error message is getting thrown, but my first glance into the PluginIndexes/PathIndex source didn't get me very far. Thanks, -Chris -------------------------------------------------------------------- Christopher N. Deckard | Lead Web Systems Developer cnd@ecn.purdue.edu | Engineering Computer Network http://www.ecn.purdue.edu/ | Purdue University ---- zlib.decompress('x\234K\316Kq((-J)M\325KM)\005\000)"\005w') --- Zope Error! Zope has encountered an error while publishing this resource. If this error persists, please Send Feedback. Error Type: TypeError Error Value: invalid argument Troubleshooting Suggestions * The URL may be incorrect. * The parameters passed to this resource may be incorrect. * A resource that this resource relies on may be encountering an error. For more detailed information about the error, please refer to the HTML source for this page. If the error persists please contact the site maintainer. Thank you for your patience. Traceback (innermost last): File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/ZPublisher/Publish.py, line 171, in publish File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: sumEvents) File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: sumEvents) File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: sumEvents) File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: sumEvents) File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Products/PythonScripts/PythonScript.py, line 363, in _exec (Object: sumEvents) (Info: ({'script': , 'context': , 'container': , 'traverse_subpath': []}, ('papers_and_proposals_reviewed', '1.0', '2001', 'papers_reviewed', 'person_type=[person_federal_unit_or_cru_staff]', None, None, None), {}, (None, None, None, None, None, None, None, None))) File Script (Python), line 185, in sumEvents File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Products/ZCatalog/ZCatalog.py, line 653, in searchResults (Object: CatalogEvents) File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Products/ZCatalog/Catalog.py, line 650, in searchResults File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Products/ZCatalog/Catalog.py, line 538, in _indexedSearch File /data/www/Zope.0/src/Zope-2.4.3-src/lib/python/Products/PluginIndexes/PathIndex/PathIndex.py, line 362, in _apply_index (Object: path) TypeError: invalid argument -------------------------------------------------------------------- Christopher N. Deckard | Lead Web Systems Developer cnd@ecn.purdue.edu | Engineering Computer Network http://www.ecn.purdue.edu/ | Purdue University ---- zlib.decompress('x\234K\316Kq((-J)M\325KM)\005\000)"\005w') ---
----- Original Message ----- From: "Christopher N. Deckard" <cnd@ecn.purdue.edu> To: <zope@zope.org> Sent: Friday, February 08, 2002 10:39 Subject: [Zope] zcatalog search limitations?
Howdy, I've begun using ZCatalogs and I really like them. I've run into a problem though. I've indexed about 10,000 folders, and I'm trying to query using the "path" to the objects. It seems like I can only look in a maximum of 32 paths before I get a Zope error (error traceback at the bottom).
There should not be such a limitiation ;-)
Are there any ideas on how to get around this limitation? I'm going to try and figure out where this error message is getting thrown, but my first glance into the PluginIndexes/PathIndex source didn't get me very far.
Is there a way to reproduce the problem ? How does your query look like ? I suggest to submit this issue to the Zope collector otherwise it might get lost of my mind. - aj
Andreas Jung wrote:
I've begun using ZCatalogs and I really like them. I've run into a problem though. I've indexed about 10,000 folders, and I'm trying to query using the "path" to the objects. It seems like I can only look in a maximum of 32 paths before I get a Zope error (error traceback at the bottom).
There should not be such a limitiation ;-)
I didn't figure there should be, but there is. :-)
Are there any ideas on how to get around this limitation? I'm going to try and figure out where this error message is getting thrown, but my first glance into the PluginIndexes/PathIndex source didn't get me very far.
Is there a way to reproduce the problem ? How does your query look like ? I suggest to submit this issue to the Zope collector otherwise it might get lost of my mind.
I can reproduce it like this: Index on a zcatalog object has a PathIndex index called "path". My query looks like this: query = {} query['path'] = [list with > 32 elements] zcatalog.searchResults(query) And I get the error message: Error Type: TypeError Error Value: invalid argument I checked, and there are no duplicate elements (though I don't think that should matter). My searchResults() works on anything else that has less than 32 elements in the path list. I haven't tried it for the other indexes. I'll post to the Zope collector now. -Chris
participants (2)
-
Andreas Jung -
Christopher N. Deckard