[Zope-dev] ZCatalog scalability

[Michael R. Bernstein]

Erik Enge wrote:
> 
> [Michael Bernstein]
> 
> | I need to know how far the ZCatalog will scale using this indexing
> | and search strategy. Does anyone have anectodal or benchmark data to
> | suggest if (and when) I will hit a 'wall' regarding the number of
> | objects being indexed and searched?
> 
> I'm going to try to stuff 27 million objects into ZODB sometime in the
> next week or the week after that (all post addresses in England).  I
> haven't got a clue as to whether this will work or just... well not
> work.  I haven't come up with a strategy for segmenting the data, but
> that shouldn't be a problem at all.  This isn't actually much data, so
> I don't expect the Data.fs file to more than 500 MB.
> 
> I'm quite confident that ZODB, ZCatalog and BTree will scale very
> nicely for this.  I have a plan ;).
> 
> I'll let you know how it goes.  (And please, do poke at me if it takes
> too long.)

Ok, I'm poking :-).

How did it go?

Michael Bernstein.