Re: [sqlite] WAL in SQLite

2010-06-04 Thread Darren Duncan
Richard Hipp wrote: > On Thu, Jun 3, 2010 at 11:15 PM, Darren Duncan wrote: >> Richard Hipp wrote: > Partition means that one part of the database cannot communicate with > another part. In the usual use of the CAP theorem, this means that the > database is spread across multiple machines and the

Re: [sqlite] WAL in SQLite

2010-06-04 Thread Richard Hipp
On Thu, Jun 3, 2010 at 11:15 PM, Darren Duncan wrote: > Richard Hipp wrote: > > On Sat, May 29, 2010 at 5:42 PM, Darren Duncan >wrote: > >> "3. Transactions that involve changes against multiple ATTACHed > >> databases are atomic for each individual database, but are not atomic > across all >

Re: [sqlite] WAL in SQLite

2010-06-03 Thread Darren Duncan
Richard Hipp wrote: > On Sat, May 29, 2010 at 5:42 PM, Darren Duncan wrote: >> "3. Transactions that involve changes against multiple ATTACHed >> databases are atomic for each individual database, but are not atomic across >> all >> databases as a set." >> >> I greatly hope that this limitatio

Re: [sqlite] WAL in SQLite

2010-06-03 Thread Richard Hipp
On Sat, May 29, 2010 at 5:42 PM, Darren Duncan wrote: > > 4. Quoth the raven: > > "3. Transactions that involve changes against multiple ATTACHed > databases > are atomic for each individual database, but are not atomic across all > databases > as a set." > > I greatly hope that this limitati

Re: [sqlite] WAL in SQLite

2010-05-30 Thread Florian Weimer
* Richard Hipp: > Good to know. Would moving to shm_open() help? I think it's difficult to clean up the shared memory segments when a database which had opened the database crashes. And access control would be very hard to get right, too. ___ sqlite-u

Re: [sqlite] WAL in SQLite

2010-05-29 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/29/2010 07:01 PM, Richard Hipp wrote: >> Good to know. Would moving to shm_open() help? The problem is that unless the networked filesystem provides exclusive locks that can be retained by one client only then there will always be race conditi

Re: [sqlite] WAL in SQLite

2010-05-29 Thread Richard Hipp
On Sat, May 29, 2010 at 9:19 PM, Roger Binns wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 05/29/2010 02:01 PM, Richard Hipp wrote: > > Does anybody know if mmap() works for network files? > > It does. However there is no way to ensure that everyone seeing the file > will have

Re: [sqlite] WAL in SQLite

2010-05-29 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/29/2010 02:01 PM, Richard Hipp wrote: > Does anybody know if mmap() works for network files? It does. However there is no way to ensure that everyone seeing the file will have a consistent view of it. This is especially the case when they are

Re: [sqlite] WAL in SQLite

2010-05-29 Thread Darren Duncan
Richard, thank you for responding to my questions about SQLite's WAL design. Richard Hipp wrote: > We've been working on an incremental checkpointing mechanism for about a > week. With incremental checkpointing, the checkpoint can be run more or > less continuously in a background thread or proce

Re: [sqlite] WAL in SQLite

2010-05-29 Thread Richard Hipp
On Sat, May 29, 2010 at 3:49 PM, Darren Duncan wrote: > > 2. Quoth the raven: > > "The wal-index greatly improves the performance of readers, but the use > of > shared memory means that all readers must exist on the same machine. This > is > why the write-ahead log implementation will not wo

[sqlite] WAL in SQLite

2010-05-29 Thread Darren Duncan
In regards to WAL (write-ahead-logging) support being added to SQLite for version 3.7.0, I have a few comments, questions, suggestions, etc. Most of them refer to parts of http://www.sqlite.org/draft/wal.html . 1. Congratulations on this move, which should greatly improve SQLite's utility re