On Sat, Oct 22, 2011 at 4:18 PM, Pavel Ivanov <[email protected]> wrote: >> Using three tables (e.g. test.sh 111 112 113), the first command takes >> 13m3s, the second command takes 12m45s. I am wondering if there is any >> magic to make the second script finish in 5 minutes by executing the >> query in parallel ... > > Try to execute "pragma cache_size = 1000000" before executing select. > It should be executed in the same sqlite3 run to have any effect, so > your argument to sqlite3 should look like "pragma cache_size = > 1000000; SELECT COUNT(*) FROM table_$arg;". I think disk I/O kills > your performance. iostat could prove you that.
The performance is even worse with this option (13m55s). However, I notice that the disk activity monitor (I am running a mac) reports 700 KB/sec for all test scripts I ran, so it is very likely that your suspicion (i/o kills performance) is right. I am moving the data to a faster drive and will report back later. Thanks, Bo _______________________________________________ sqlite-users mailing list [email protected] http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
