On Aug 19, 2014, at 11:11 PM, [email protected] 
<[email protected]> wrote:

> Is there something better I can do to improve this process?


PRAGMA journal_mode  = off;

http://www.sqlite.org/pragma.html#pragma_journal_mode


> Perhaps one transaction? Perhaps turn something off? It took about 1.5 hours 
> to run. I use the temp table because every CSV files has a header with the 
> column names. I have to drop the table each time because of the header issue.

Preprocess your files by dropping the first line beforehand, e.g.: 

sed -i ā€˜1d’

That will save half of your time already.

_______________________________________________
sqlite-users mailing list
[email protected]
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to