[Zope-dev] ZCatalog scalability

Michael Bernstein webmaven@lvcm.com
Mon, 22 Jan 2001 23:18:14 -0800


We seem to have disposed of the wildcard issue [snipped out
below], and I'm looking forward to Eric's results, but does
anyone else have any information about whether there is a
practical upper limit on how many objects can be indexed and
searched in a ZCatalog?

Michael Bernstein wrote:
> 
> After comsidering the feedback I got from the previous
> 'Massive scalability' thread, I decided to split my queries
> into two areas: Rack scalability and ZCatalog scalability.
> This email deals with the latter.
> 
> [snip]
>
> What I am interested in for my application are two things:
> 
> - ZTopics populated using one or more keyword indexes
> 
> - Full text search on a single computed attribute that
> concatenates several fields including the aforementioned
> keyword index fields and a few simple string attributes
> (title, caption, description, etc.)
> 
> I need to know how far the ZCatalog will scale using this
> indexing and search strategy. Does anyone have anectodal or
> benchmark data to suggest if (and when) I will hit a 'wall'
> regarding the number of objects being indexed and searched?
> Some anectodal data suggests that single field indexing will
> scale easily to 60,000 objects, but what about hundreds of
> thousands or even millions of objects?
>
> [snip]