Re: [sqlite] Write performance question for 3.7.15

2013-01-01 Thread Dan Frankowski
Ah, interesting. However, yes, we need production-ready. Good luck with sqlite4 tho. On Tue, Jan 1, 2013 at 11:43 AM, Richard Hipp <d...@sqlite.org> wrote: > On Tue, Jan 1, 2013 at 12:33 PM, Dan Frankowski <dfran...@gmail.com> > wrote: > > > > > We are comparin

Re: [sqlite] Write performance question for 3.7.15

2013-01-01 Thread Dan Frankowski
I appreciate everyone's thoughts about this. Knowing larger batch sizes help is interesting. Unfortunately, we don't always control the batch size. We're using 1000 as an optimistic estimate, but we receive things and may just have to commit after awhile. Knowing that more OS file cache or a

Re: [sqlite] Write performance question for 3.7.15

2012-12-28 Thread Dan Frankowski
On Fri, Dec 28, 2012 at 3:34 PM, Dan Frankowski <dfran...@gmail.com> wrote: > I am running a benchmark of inserting 100 million (100M) items into a > table. I am seeing performance I don't understand. Graph: > http://imgur.com/hH1Jr. Can anyone explain: > > 1. Why does write

[sqlite] Fwd: Write performance question for 3.7.15

2012-12-28 Thread Dan Frankowski
I am running a benchmark of inserting 100 million (100M) items into a table. I am seeing performance I don't understand. Graph: http://imgur.com/hH1Jr. Can anyone explain: 1. Why does write speed (writes/second) slow down dramatically around 28M items? 2. Are there parameters (perhaps related to