The improvements to incremental indexing in the recent-release catalog has been more along the lines of reducing the amount of churn resulting in out-of-control ZODB size growth than improved speed. ----- Original Message ----- From: "Andy McKay" <andym@ActiveState.com> To: "Chris Withers" <chrisw@nipltd.com> Cc: "Erik Enge" <erik@thingamy.net>; "Michael R. Bernstein" <webmaven@lvcm.com>; <zope-dev@zope.org> Sent: Monday, April 09, 2001 1:59 PM Subject: Re: [Zope-dev] 27 million objects.
Any cataloguing and un-cataloguing of an object is expensive, c'mon you are changing all the indices, vocabulary and so on. You never notice it normally for 1 - 10 things, but run an import script of 10000 and catalog each object as it gets added (rather than all of them at the end) and you'll notice the difference. (This script was cataloguing 250,000 mail messages, one at a time. Big no-no) -- Andy McKay.
----- Original Message ----- From: "Chris Withers" <chrisw@nipltd.com> To: "Andy McKay" <andym@activestate.com> Cc: "Erik Enge" <erik@thingamy.net>; "Michael R. Bernstein" <webmaven@lvcm.com>; <zope-dev@zope.org> Sent: Monday, April 09, 2001 10:52 AM Subject: Re: [Zope-dev] 27 million objects.
Andy McKay wrote:
As I said this was a year ago... but still incremental cataloging is
very
expensive.
How come? I always thought this was one of Zope's strong points as opposed to, say, Lotus Notes' batch view buildign paradigm...
cheers,
Chris
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )