Re: [sqlite] Commit frequency and performance

2009-02-04 Thread prirun
Yes, there are 3 indexes being created. For 2 indexes, the data is in order. For the 3rd index, the data is not in order. I can understand how that will cause extra seeking. It's a good point. I just ran another test after downloading the latest SQLite version, changed the page size to 4K on

Re: [sqlite] Commit frequency and performance

2009-02-04 Thread prirun
Thanks Roger. There is no other activity on this machine. I have run vmstat 5 during all of the different cases. For plain sequential files, Linux is able to almost completely overlap I/O with CPU, so the real time is close to user+sys time. With SQLite, there are often periods where the CPU