[Zope-dev] ZCatalog scalability

[Erik Enge]

[Michael Bernstein]

| I need to know how far the ZCatalog will scale using this indexing
| and search strategy. Does anyone have anectodal or benchmark data to
| suggest if (and when) I will hit a 'wall' regarding the number of
| objects being indexed and searched?

I'm going to try to stuff 27 million objects into ZODB sometime in the
next week or the week after that (all post addresses in England).  I
haven't got a clue as to whether this will work or just... well not
work.  I haven't come up with a strategy for segmenting the data, but
that shouldn't be a problem at all.  This isn't actually much data, so
I don't expect the Data.fs file to more than 500 MB.

I'm quite confident that ZODB, ZCatalog and BTree will scale very
nicely for this.  I have a plan ;).

I'll let you know how it goes.  (And please, do poke at me if it takes
too long.)