Re: [sqlite] Inserts get slower and slower

2012-02-24 Thread Don V Nielsen
t;> >> Northrop Grumman Information Systems >> >> >> From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] >> on behalf of Don V Nielsen [donvniel...@gmail.com] >> Sent: Thursday, February 09, 2012 8:14 AM >>

Re: [sqlite] Inserts get slower and slower

2012-02-24 Thread Don V Nielsen
> on behalf of Don V Nielsen [donvniel...@gmail.com] > Sent: Thursday, February 09, 2012 8:14 AM > To: General Discussion of SQLite Database > Subject: EXT :Re: [sqlite] Inserts get slower and slower > > I've noticed a similar thing happening. The first 1/3rd loads qui

Re: [sqlite] Inserts get slower and slower

2012-02-09 Thread Black, Michael (IS)
rmation Systems From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] on behalf of Don V Nielsen [donvniel...@gmail.com] Sent: Thursday, February 09, 2012 8:14 AM To: General Discussion of SQLite Database Subject: EXT :Re: [sqlite] Inserts get slower and slower I'

Re: [sqlite] Inserts get slower and slower

2012-02-09 Thread Don V Nielsen
I've noticed a similar thing happening. The first 1/3rd loads quickly; the remain 2/3rds stagnates. It appears that there is some kind of bottleneck happening. I thought it was the SAN. My application begins a transaction, does all its inserts, and then commits. There could be millions in the

Re: [sqlite] Inserts get slower and slower

2012-02-08 Thread Steinar Midtskogen
Thanks to all for suggestions. > My guesses: > - Your unix_time values are not successive. In this case your first fast > results are due to advantages of memory caching. The following slowness is > the result of the internal fragmentation All unix_time values should be successive, but in the par

Re: [sqlite] Inserts get slower and slower

2012-02-08 Thread Max Vlasov
On Thu, Feb 9, 2012 at 2:08 AM, Steinar Midtskogen wrote: > > When I build my database from scratch using millions of inserts, one > table causes problems. Inserts get slower and slower. I have about > 830,000 inserts for that table. It gets to 300,000 pretty fast, but > then it gets slower and

Re: [sqlite] Inserts get slower and slower

2012-02-08 Thread Simon Slavin
On 8 Feb 2012, at 10:22pm, Oliver Peters wrote: > It's the Primary Key that you're using cause for every INSERT it is checked > if unix_time is already present in a record. > > So the question is if you really need unix_time as a PK If you're batching your INSERTs up into transactions, try doi

Re: [sqlite] Inserts get slower and slower

2012-02-08 Thread Oliver Peters
Am 08.02.2012 23:08, schrieb Steinar Midtskogen: Hello I'm having trouble with one table in my database. When I build my database from scratch using millions of inserts, one table causes problems. Inserts get slower and slower. I have about 830,000 inserts for that table. It gets to 300,000

[sqlite] Inserts get slower and slower

2012-02-08 Thread Steinar Midtskogen
Hello I'm having trouble with one table in my database. When I build my database from scratch using millions of inserts, one table causes problems. Inserts get slower and slower. I have about 830,000 inserts for that table. It gets to 300,000 pretty fast, but then it gets slower and slower, an