[ZODB-Dev] Optimizing RelStorage Packing for large DBs

Shane Hathaway shane at hathawaymix.org
Mon Nov 18 17:29:04 CET 2013


On 11/15/2013 06:01 PM, Jens W. Klein wrote:
> The idea is simple:
>
> - iterate over all transactions starting with the lowest
>    transaction id (tid)
> - for each transaction load the object states connected with tid
> - for each state fetch its outgoing references and fill a table where
>    all incoming references of an object are stored as an array.
>    if an state has no references write it anyway to the table with empty
>    outgoing references

I would describe the RelStorage packing algorithm with the same words, 
but since you reimplemented the algorithm from scratch, you found a more 
optimal implementation for your database. Good work!

Shane



More information about the ZODB-Dev mailing list