[ZODB-Dev] Re: ZODB Benchmarks

[Roché Compaan]

On Thu, 2008-02-07 at 20:26 +0100, Dieter Maurer wrote:
> Roché Compaan wrote at 2008-2-7 21:21 +0200:
> > ...
> >So if I asked you to build a data structure for the ZODB that can do
> >insertions at a rate comparable to Postgres on high volumes, do you
> >think that it can be done?
> 
> If you need a high write rate, the ZODB is probably not optimal.
> Ask yourself whether it is not better to put such high frequency write
> data directly into a relational database.
> 
> Whenever you have large amounts of highly structured data,
> a relational database is necessary more efficient than the ZODB.

I know it is not optimal for high write scenarios, but I'm asking if it
is possible to build a data structure for the ZODB that can do
insertions quickly.

There are use cases where having a container in the ZODB that can handle
large volumes and maintain a high insertion rate would be very
convenient. An example of such a use case would be a site with millions
of members where each member has their own folder containing different
content types. The rate at which new members register is very high as
well so the folder needs to handle insertions quickly. In this use case
you are not dealing with structured data. If members in a site with such
large volumes start to generate content, indexes in the ZODB become
problematic too because of the slow rate of insertion. And it this point
you start to stuff everything in relational database and the whole
experience becomes painful ...

-- 
Roché Compaan
Upfront Systems                   http://www.upfrontsystems.co.za