[Zope-dev] 27 million objects.

[Chris McDonough]

The improvements to incremental indexing in the recent-release catalog has
been more along the lines of reducing the amount of churn resulting in
out-of-control ZODB size growth than improved speed.


----- Original Message -----
From: "Andy McKay" <andym@ActiveState.com>
To: "Chris Withers" <chrisw@nipltd.com>
Cc: "Erik Enge" <erik@thingamy.net>; "Michael R. Bernstein"
<webmaven@lvcm.com>; <zope-dev@zope.org>
Sent: Monday, April 09, 2001 1:59 PM
Subject: Re: [Zope-dev] 27 million objects.


> Any cataloguing and un-cataloguing of an object is expensive, c'mon you
are
> changing all the indices, vocabulary and so on. You never notice it
normally
> for 1 - 10 things, but run an import script of 10000 and catalog each
object
> as it gets added (rather than all of them at the end) and you'll notice
the
> difference. (This script was cataloguing 250,000 mail messages, one at a
> time. Big no-no)
> --
>   Andy McKay.
>
>
> ----- Original Message -----
> From: "Chris Withers" <chrisw@nipltd.com>
> To: "Andy McKay" <andym@activestate.com>
> Cc: "Erik Enge" <erik@thingamy.net>; "Michael R. Bernstein"
> <webmaven@lvcm.com>; <zope-dev@zope.org>
> Sent: Monday, April 09, 2001 10:52 AM
> Subject: Re: [Zope-dev] 27 million objects.
>
>
> > Andy McKay wrote:
> > >
> > > As I said this was a year ago... but still incremental cataloging is
> very
> > > expensive.
> >
> > How come? I always thought this was one of Zope's strong points as
opposed
> to,
> > say, Lotus Notes' batch view buildign paradigm...
> >
> > cheers,
> >
> > Chris
> >
>
>
> _______________________________________________
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )
>