On 01/07/2011 10:34 AM, Maurits van Rees wrote: > Op 07-01-11 05:51, Shane Hathaway schreef: >> I looked at that branch before, but I felt like the changes were >> complicated enough to require a comparison with simpler solutions first. >> In particular, Postgres has an option to disable fsync. Set it in >> postgresql.conf. Disabling fsync is not normally recommended, but for a >> large import it's obviously a good idea. Would you compare the speed of >> --single-transaction with disabled fsync on vanilla RelStorage? > > In /etc/postgresql/8.4/main/postgresql.conf I switched these settings > off and restarted postgres: > fsync = off > synchronous_commit = off > > The zodbconvert of the 150 MB CatalogData.fs went from 3.1 minutes to > 2.8. When using the --single-transaction option of the branch it went > to 2.2 minutes. So there is still a significant improvement here.
Ok, I'll study the branch again. Maybe the changes aren't as deep as I remember. Shane _______________________________________________ For more information about ZODB, see the ZODB Wiki: http://www.zope.org/Wikis/ZODB/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev