[ZODB-Dev] Storage Benchmarks
Barry A. Warsaw
barry@zope.com
Mon, 17 Dec 2001 10:57:12 -0500
>>>>> "TD" == Toby Dickenson <tdickenson@geminidataloggers.com> writes:
TD> Im most familiar with BerkeleyStorage Full, where the memory
TD> usage issues come from using a python dictionary with one
TD> element per object in the database.... obviously not a
TD> scalable strategy.
The current Full.pack() implementation is geared toward
lock-friendliness while packing; i.e. other work can proceed while
packing is taking place. We could do pack more efficient memory-wise
if we didn't have this constraint, but then pack will make the
database inaccessible for a long time.
It's possible that the (although doubtful) that pack can be sped up
if we're successful in implementing the blob limitation workaround.
It's certainly worth revisiting.
-Barry