Re: [sqlite] Faster inserts in SQlite ...

2009-09-29 Thread Atul_Vaidya
Hi Nicolas, My application is windows based. I did set the pragma Page Size = 4096 as suggested by Alexey. but, it hardy made any difference to the speed. I am abandoning the multi-threading idea, as the other components used in my application aren't thread safe. Also, i was

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Nicolas Williams
On Mon, Sep 21, 2009 at 03:37:02PM -0400, Pavel Ivanov wrote: > > Have you any IO operations? As result you have dependence of page > > size. > > Though your performance most probably will not depend on these > operations because they will be executed at some random times by OS. > And they will

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Pavel Ivanov
> Have you any IO operations? As result you have dependence of page > size. Though your performance most probably will not depend on these operations because they will be executed at some random times by OS. And they will be collected to have multiple blocks in one operation anyway... I don't

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Alexey Pechnikov
Hello! On Monday 21 September 2009 23:11:57 Pavel Ivanov wrote: > > Most modern FS have the same block size. > > Though I don't think that in case of synchronous = OFF there's any > benefit of using pages of the exactly same size as block in file > system. Correct me if I'm wrong. Have you any

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Pavel Ivanov
> Most modern FS have the same block size. Though I don't think that in case of synchronous = OFF there's any benefit of using pages of the exactly same size as block in file system. Correct me if I'm wrong. Pavel On Mon, Sep 21, 2009 at 2:53 PM, Alexey Pechnikov

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Alexey Pechnikov
Hello! On Monday 21 September 2009 19:50:37 Pavel Ivanov wrote: > > You must set pragma page_size=4096; > > Can I ask why "must" and this number? Why not the maximum 32768? $ sudo tune2fs -l /dev/sdb1|grep 4096 Block size: 4096 Most modern FS have the same block size. Best

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Pavel Ivanov
> You must set pragma page_size=4096; Can I ask why "must" and this number? Why not the maximum 32768? Pavel On Mon, Sep 21, 2009 at 11:45 AM, Alexey Pechnikov wrote: > Hello! > > On Monday 21 September 2009 15:05:04 Atul_Vaidya wrote: >> 5. PRAGMA cache_size = 12000;

Re: [sqlite] Faster inserts in SQlite ...

2009-09-21 Thread Alexey Pechnikov
Hello! On Monday 21 September 2009 15:05:04 Atul_Vaidya wrote: > 5. PRAGMA cache_size = 12000; I use value 128 000 on servers. You must set pragma page_size=4096; If database is not empty is needed to vacuum it. > > i also avoid the update calls, and i do all the insertion in between Begin >