Ignore multiprocessing for the inserting.  You'll just get contention when 
accessing the database.  And I think you are already trying the right PRAGMAs.

I think you've done this already, but just in case ...

Insert rows in batches.  Experiment with the batch size: maybe a thousand 
INSERTs per batch, maybe a million.  Try all the orders in between.  So ...

DROP all INDEXes
BEGIN
   INSERT first thousand rows
END
BEGIN
   INSERT next thousand rows
END
...
CREATE all INDEXes

Try that and time it.  Then change 'thousand' to 'ten thousand', up to a 
million.  Curve the times and figure out where your sweet spot is.

Simon.
_______________________________________________
sqlite-users mailing list
[email protected]
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to