[ZODB-Dev] RelStorage branch 1.4.0-fastimport

[Shane Hathaway]

On 01/07/2011 10:34 AM, Maurits van Rees wrote:
> Op 07-01-11 05:51, Shane Hathaway schreef:
>> I looked at that branch before, but I felt like the changes were
>> complicated enough to require a comparison with simpler solutions first.
>>     In particular, Postgres has an option to disable fsync.  Set it in
>> postgresql.conf.  Disabling fsync is not normally recommended, but for a
>> large import it's obviously a good idea.  Would you compare the speed of
>> --single-transaction with disabled fsync on vanilla RelStorage?
>
> In /etc/postgresql/8.4/main/postgresql.conf I switched these settings
> off and restarted postgres:
> fsync = off
> synchronous_commit = off
>
> The zodbconvert of the 150 MB CatalogData.fs went from 3.1 minutes to
> 2.8.  When using the --single-transaction option of the branch it went
> to 2.2 minutes.  So there is still a significant improvement here.

Ok, I'll study the branch again.  Maybe the changes aren't as deep as I 
remember.

Shane