Re: [sqlite] Insert speed greatly decreasing over time

Hello! But why do you not compress big text strings? And index size can be reduced by using md5 hash of text key field. See the extensions http://mobigroup.ru/files/sqlite-ext/ http://mobigroup.ru/files/sqlite-ext/md5/ Best regards, Alexey Pechnikov. http://pechnikov.tel/

Re: [sqlite] Insert speed greatly decreasing over time

sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Alexey Pechnikov Sent: Wednesday, October 07, 2009 3:33 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Insert speed greatly decreasing over time Hello! Because update == delete + insert you must have fragmentation.

Re: [sqlite] Insert speed greatly decreasing over time

Hello! Because update == delete + insert you must have fragmentation. The degree of the fragmentation is proporsional to count of replaces. So you may have problems after inserting a lot of dublicates. Are you really need to insert or update? 1. I'm using few hundread MB databases like CREATE

Re: [sqlite] Insert speed greatly decreasing over time

Sent: Wednesday, October 07, 2009 2:23 PM To: pechni...@sandy.ru; General Discussion of SQLite Database Subject: Re: [sqlite] Insert speed greatly decreasing over time > Try this: > pragma cache_size=20; I believe changing pragma cache_size will not help, because size of the database d

Re: [sqlite] Insert speed greatly decreasing over time

> Try this: > pragma cache_size=20; I believe changing pragma cache_size will not help, because size of the database doesn't change, so cache hit ratio doesn't change too. And there's no disk i/o suggesting that it's not the bottleneck. Chris, did you try to attach to the process with some

Re: [sqlite] Insert speed greatly decreasing over time

Would dropping and re-creating an index help? On Wed, Oct 7, 2009 at 2:19 PM, Alexey Pechnikov wrote: > Hello! > > Try this: > pragma cache_size=20; > > Best regards, Alexey Pechnikov. > http://pechnikov.tel/ > ___ >

Re: [sqlite] Insert speed greatly decreasing over time

Hello! Try this: pragma cache_size=20; Best regards, Alexey Pechnikov. http://pechnikov.tel/ ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Insert speed greatly decreasing over time

We have an application that uses a single table database, that is quite simple. Here is the schema: CREATE TABLE t (k varchar(50) primary key not null, d text not null, e datetime) We receive data over the course of an hour that is in a different form and we need to put into the db. The order