[Zope] Thousands of Objects - how do they manifest? (newbie)

Casey Duncan casey@zope.com
Wed, 8 Jan 2003 11:26:54 -0500


On Wednesday 08 January 2003 10:32 am, Toby Dickenson wrote:
> On Monday 06 January 2003 5:48 pm, Casey Duncan wrote:
>=20
> > That said, the current FileStorage (the default used with Zope) has a
> > memory resident index which grows linearly with the number of objects=
 in
> > your database. This will consume a lot of memory if you have millions=
 of
> > objects (some thing like 12-20 bytes per object). I am actually curre=
ntly
> > working on a solution to this though...=20
>=20
> Interesting. Anything public?

Not yet... it will be initially an alternate implementation of FileStorag=
e=20
that has an index that is not memory resident. The format of Data.fs woul=
d be=20
unchanged, but the index file is completely different.

I am planning to write an initial implementation soon to gauge the=20
memory/performance tradeoff and see if my idea is worthwhile in general ;=
^)

-Casey