[ZODB-Dev] Re: design issue: job queue is concurrency bottleneck

[Steve Alexander]

> Perhaps you could create a layered structure of BTrees to lessen the
> chance of conflict. For example you could have a top-level btree whose
> keys are "time slices" each once containing all of the jobs scheduled
> during that slice. If the slices were fixed size then this could be an
> IOBTree perhaps.

Why not make a layered structure of only BTree Buckets.  If you make it 
so that you only ever add new buckets most of the time, then you won't 
get write conflicts.  A separate single thread can remove defunct 
buckets when there is no chance of them being used again.

--
Steve Alexander