Re: [sqlite] Locking/Concurrency

2012-05-05 Thread Igor Tandetnik
KUSHAL SHAH wrote: > I am starting simple where I have exe1 having 1 connection and exe2 having > another connection. > Now if both of them open the connections in mutex mode, will the read/write > requests be serialized. It seems you are saying No. I'm not sure what you

Re: [sqlite] Locking/Concurrency

2012-05-05 Thread KUSHAL SHAH
Thank you Igor for the prompt reply.   Apologies, I am a beginner and hence some more naïve questions:   I am starting simple where I have exe1 having 1 connection and exe2 having another connection. Now if both of them open the connections in mutex mode, will the read/write requests be

Re: [sqlite] progressbar

2012-05-05 Thread Patrik Nilsson
Thank you for your suggestion. I will consider it. Patrik On 05/05/2012 10:31 PM, Roger Binns wrote: > On 05/05/12 12:52, Patrik Nilsson wrote: >> I use Sqlite as a document-file. Saving is when user requests to or >> when program quits. > > Even less reason to couple the user interface to

Re: [sqlite] progressbar

2012-05-05 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/05/12 12:52, Patrik Nilsson wrote: > I use Sqlite as a document-file. Saving is when user requests to or > when program quits. Even less reason to couple the user interface to database operations. Are you really sure your users want to

Re: [sqlite] progressbar

2012-05-05 Thread Patrik Nilsson
On 05/05/2012 08:25 PM, Roger Binns wrote: > Something else you can consider is changing how your program works so that > the user interface isn't slaved to database operations. You can let the > UI queue up work to be done, and then have a background worker thread > actually do the work in the

Re: [sqlite] progressbar

2012-05-05 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/05/12 10:18, Patrik Nilsson wrote: > Is it possible to get the total number of virtual machine instructions > an operation is requiring? You know how many there are in the program via explain, but you will not know how many will be executed.

Re: [sqlite] progressbar

2012-05-05 Thread Patrik Nilsson
It will not relate to the number of bytes/pages to move. An example: If I "explain vacuum"... 0|Trace|0|0|0||00| 1|Vacuum|0|0|0||00| 2|Halt|0|0|0||00| I count these rows to two (excluding halt). When running a lengthy operation the best resolution I can get is 50 percent. Unfortunately, this

Re: [sqlite] progressbar

2012-05-05 Thread Simon Slavin
On 5 May 2012, at 6:18pm, Patrik Nilsson wrote: > Is it possible to get the total number of virtual machine instructions a > "begin... commit"-statement will need? I.e. progress of saving data to > the database. Using 'EXPLAIN ...' for each of your instructions, and

[sqlite] progressbar

2012-05-05 Thread Patrik Nilsson
Hi All, Is it possible to get the total number of virtual machine instructions an operation is requiring? When backing up you have "sqlite3_backup_remaining" to do this job. By invoking the callback to every N is equal to 1 and saving the first value you have a progressbar with percentage. I

Re: [sqlite] Increase concurrency by attaching database files

2012-05-05 Thread Simon Slavin
On 5 May 2012, at 12:22pm, Marcolippo Polpettino wrote: > I've read that sqlite locks the entire database file on updates. True. This is extremely fast: checking for a lock involves checking just one thing. Making a lock involves changing just one thing. Table-level

Re: [sqlite] Data race (file race) in pager

2012-05-05 Thread Paul Thomson
Excellent! I was hoping/assuming it would be something like this. In this case, there is one process and two threads, but this is almost certainly what is happening. Is this explained in a code comment somewhere? If not, would an sqlite committer be willing to add it? It is always nice when

[sqlite] Increase concurrency by attaching database files

2012-05-05 Thread Marcolippo Polpettino
Hello, I've read that sqlite locks the entire database file on updates. Our database is based on a very small number of tables that contain a huge amount of records (under WAL mode). Will we get improvements in performance if we create different database files (one for each table) and attach

Re: [sqlite] Multi-lingual support?

2012-05-05 Thread Simon Slavin
On 5 May 2012, at 3:49am, Dale E. Edmons wrote: > I've built an extensive database that has three copies of the Jewish Tanach > in it. When trying to get sqlite3 to handle Hebrew (utf8 for starters) it > seems to be trying to manipulate the text and it ends up backwards.

Re: [sqlite] is SQLite the right tool to analyze a 44GB file

2012-05-05 Thread Valentin Davydov
On Fri, May 04, 2012 at 11:23:42AM -0400, peter korinis wrote: > > After I get the data loaded and inspect for nulls in prospective index > attributes, can I add indices? Yes, of course. Moreover, it would be much faster to add indices at once at the end rather than create them beforehand and