Re: [sqlite] WAL file size

2010-12-02 Thread Dan Kennedy
In the current WAL format, the checksum for each frame is based on the contents of the frame, the salt-values in the wal header and the checksum of the previous frame. In this scheme is each frame checksum independent? i.e. each frame checksum is computed based only on the salt values in the WAL

Re: [sqlite] Android database corruption

2010-12-02 Thread Simon Slavin
On 3 Dec 2010, at 4:08am, jtdrexel wrote: > Some people say that the "dialer > storage" is related to sms and mms because the file size of the 'dialer > storage' file changes accordingly with the deletion and addition of > messages. Is the sms database and SQLite database? and is it located in

Re: [sqlite] Android database corruption

2010-12-02 Thread Simon Slavin
On 3 Dec 2010, at 4:08am, jtdrexel wrote: >> It works perfectly 99% of the time, but every now and again, we get >> database corruption appear randomly. We have not changed any pragmas, so >> synchronous is set to full and journal_mode delete. It does not correspond >> to any power failures, or

Re: [sqlite] Android database corruption

2010-12-02 Thread jtdrexel
Hello Cliff 2, I am not as profficient as you in android programming of SQLite but i am willing to help solve this problem. The reason why i am coming forward to help is because of comment # 451 on the following fourm: http://code.google.com/p/android/issues/detail?id=5669. There are a

Re: [sqlite] Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Gilles Ganault
At 22:38 02/12/2010, Mike Frysinger wrote: >that doesnt really make sense. just build sqlite in the dist and >look at how configure is run. If I got it right, the SQLite package that lives in the uClinux-dist uses the GNU build system

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite forBlackfin+uClinux?

2010-12-02 Thread Gilles Ganault
On Thu, 2 Dec 2010 15:17:28 -0500, Eric Smith wrote: >You can do it on the command line -- just try it. Sorry guys for being dense: After rereading the above, it clicked: The "-lpthread" option must be put on the line when linking the three object files to create the final

Re: [sqlite] Assertion failure in SQLite 3.7.3 (new vs. 3.6.23.1)

2010-12-02 Thread Sylvain Pointeau
Hi, I am on macosx sqlite 3.7.3 $ /usr/local/bin/sqlite3 test.db3 SQLite version 3.7.3 Enter ".help" for instructions Enter SQL statements terminated with a ";" sqlite> .read ./testSchema.sql sqlite> .read ./TestValues.sql sqlite> .read ./TestQuery.sql Otterbourne Golf Course|Jane Doe|Assumed

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite forBlackfin+uClinux?

2010-12-02 Thread Eric Smith
Gilles Ganault wrote: > Sorry about that :-/ Apparently, gcc will compile and link in one go. > Is a Makefile required to add the -lpthread switch, or can this be > done on the command line? You can do it on the command line -- just try it. make(1) (and its typical input, a set of

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite forBlackfin+uClinux?

2010-12-02 Thread Gilles Ganault
On Thu, 2 Dec 2010 13:50:30 -0600, "Black, Michael (IS)" wrote: >The -lpthread goes on the FINAL link you do with your OBJS. Sorry about that :-/ Apparently, gcc will compile and link in one go. Is a Makefile required to add the -lpthread switch, or can this be done on

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread Simon Slavin
On 2 Dec 2010, at 7:38pm, cricketfan wrote: > { > Select a from tbl1 where b='yyy' c ='xxx' limit i offset (i + 1) ; > Update tbl1 set e=1 where a = some value from the select; > i = i + 1 > } There doesn't appear to be any purpose to anything but the UPDATE command. Can you not

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite forBlackfin+uClinux?

2010-12-02 Thread Black, Michael (IS)
Wrong way again The -lpthread goes on the FINAL link you do with your OBJS. It told you "linking not done" becauce your "-c" is just compiling to the .o file and no libraries are needed for that. All -l library references are when you build the final executable. Michael D. Black

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread Pavel Ivanov
> Another question - What kind of impact does a limit clause have? The columns > being used in the where clause are indexed. My current design is bad, I am > forced to use limit to get one row at a time. Since I have an index the > impact should be minimal. Please let me know if I am wrong. You

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread cricketfan
I have 2 threads in my program can someone take a look at them and provide some comments Pseudo code for thread 1 (a is the primary key) Thread1() { insert into tbl1(a,b,c,d,e,f,g,h,i,j,k); } So my pseudo code is(b and c have an index, a is primary key) Thread2() { sleep(200); prepare;

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Gilles Ganault
On Thu, 2 Dec 2010 12:38:18 -0600, "Black, Michael (IS)" wrote: >If you need threadsafe just add -lpthread to your final link I get an error when using "-lpthread", which I guess makes sense, since I don't have the pthread library cross-compiled: = #

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Black, Michael (IS)
If you need threadsafe just add -lpthread to your final link As for .o and .q -- .o are "object" files which you would use to either link ALL of it into your application or build your .a or .so file. The .a and .so file allow your linker to only extract the routines it needs and not the whole

Re: [sqlite] Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Gilles Ganault
On Thu, 2 Dec 2010 08:06:13 -0600, "Black, Michael (IS)" wrote: >You're linking your two .o into the shared library instead of sqlite3.o > >src/$(LIBNAME): $(OBJS) >$(CC) $(CFLAGS) $(LIB_OPTION) $(DRIVER_LIBS) -o $@ sqlite3.o Thanks a bunch,

Re: [sqlite] Assertion failure in SQLite 3.7.3 (new vs. 3.6.23.1)

2010-12-02 Thread Philip Graham Willoughby
On 26 Nov 2010, at 10:28, Philip Graham Willoughby wrote: > On 25 Nov 2010, at 14:06, Dan Kennedy wrote: > >> On 11/25/2010 03:45 PM, Philip Graham Willoughby wrote: >>> Hi all, >>> >>> I'm noticing a new failure with SQLite 3.7.3 as compared to the previous >>> version I was using, 3.6.23.1.

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread Simon Slavin
On 2 Dec 2010, at 4:39pm, Pavel Ivanov wrote: > I didn't see in OP's email any information on whether he updates the > same rows or same table as he selects, so I'd say this statement is > too harsh in general case. While select is executing you shouldn't > update the same rows that were

Re: [sqlite] WAL file size

2010-12-02 Thread Yoni Londner
Hi, I meant to run the checkpoint in another thread (see my attached example program), but it can be even from another process. What happens when it crashes? well, the programmer have to decide how he handle checkpoints. he can use auto_checkpoint, he can stop auto_checkpoint and do checkpoint

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread Pavel Ivanov
> Makes no difference.  Doing an UPDATE inside your SELECT violates the rule no > matter how you structure your transaction.  A SELECT is a single operation > and you can't do anything else until it is finished. I didn't see in OP's email any information on whether he updates the same rows or

Re: [sqlite] WAL file size

2010-12-02 Thread Pavel Ivanov
You seem to use such term as "background checkpointing". What's that? Who runs this background process and what happens when it crashes (when all other readers/writers are still working)? Pavel On Thu, Dec 2, 2010 at 11:04 AM, Yoni Londner wrote: > Hi, > > I will start out

Re: [sqlite] Transactions while using prepare and step

2010-12-02 Thread Simon Slavin
On 2 Dec 2010, at 3:44pm, cricketfan wrote: > Hello I have a basic question and would be glad if someone can answer it. I > understand that if we have "BEGIN TRANSACTION" and "END TRANSACTION" then > the transaction(s) within that block would be committed, number of > transactions could be

Re: [sqlite] WAL file size

2010-12-02 Thread Yoni Londner
Hi, I will start out by stating that I am not deeply familiar with the sqlite & WAL file layout, but I will try anyway, from my current understanding: The general problem that needs to be solved is to allow SQLITE to be constantly used over time (with no 'idle' time where no sql operations

[sqlite] Transactions while using prepare and step

2010-12-02 Thread cricketfan
Hello I have a basic question and would be glad if someone can answer it. I understand that if we have "BEGIN TRANSACTION" and "END TRANSACTION" then the transaction(s) within that block would be committed, number of transactions could be 10,100,1000 or 1. . Otherwise, SQLITE by default

Re: [sqlite] Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Black, Michael (IS)
Let me do this again without this confanged EXTERNAL thing our email server puts on everything... You're linking your two .o into the shared library instead of sqlite3.o 1. 2. OBJS=src/luasql.o src/ls_$T.o 3. 4. 5. src/$(LIBNAME): $(OBJS) 6.

Re: [sqlite] EXTERNAL:Re: Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Black, Michael (IS)
You're linking your two .o into the shared library instead of sqlite3.o 1. 2. OBJS=src/luasql.o src/ls_$T.o 3. 4. 5. src/$(LIBNAME): $(OBJS) 6. $(CC) $(CFLAGS) $(LIB_OPTION) $(DRIVER_LIBS) -o $@ $(OBJS) 7.

Re: [sqlite] Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Gilles Ganault
At 17:47 01/12/2010, Mike Frysinger wrote: >why dont you consult the Blackfin uclinux-dist to see how it's doing it ? I did, but it's the same code as from www.sqlite.org so doesn't contain infos on what parameters to pass "configure" to compile for the Blackfin. After cd'ing to

Re: [sqlite] Cross-compiling SQLite for Blackfin+uClinux?

2010-12-02 Thread Gilles Ganault
On Wed, 1 Dec 2010 11:10:54 -0600, "Black, Michael (IS)" wrote: >I don't think you need to do the LDFLAGS thing... > >gcc -O2 -fpic -shared -Wl,-soname,sqlite3.so -o sqlite3.so sqlite3.c > >Works fine for me. Though I'm not using the Blackfin compiler... Thanks

Re: [sqlite] Database corrupted

2010-12-02 Thread Black, Michael (IS)
And your version is. Is your app a stand-alone you can share? If you 've discovered such a bug the community would be MUCH appreciative if you could share so it can be fixed (or at least identified to allay concerns we all may have over thread safety). Michael D. Black Senior

[sqlite] Database corrupted

2010-12-02 Thread Marco Era
Hello, I'm doing some tests to get the best out of the threading models for sqlite. All tests are done on a multicore processor, windows XP; sqlite is working in WAL mode. I've got a database image corrupted when using SQLITE_THREADSAFE=2 and two threads, each opening a private connection to