[sqlite] Fwd: Re: [sx-users] Corruption storage

2016-05-13 Thread Török Edwin
Hi, We got a report of a 'pragma integrity_check' failure on the user mailing list for our application [1]. There was no data loss involved (just the index was corrupted), but I thought you might want to take a look. The database was written to by our application (SX 2.0) which uses SQLite 3.9

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Török Edwin
On 11/25/2015 06:19 PM, Richard Hipp wrote: >> >> The I/O path is more complicated than I originally thought though: >> FreeBSD server (running our app with SQLite) with UFS+SU -> Linux (Xen host) >> -> FreeBSD (ISCSI + ZFS) > > I don't know what this means. Is there a network filesystem involved

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Török Edwin
On 11/25/2015 05:37 PM, Richard Hipp wrote: > On 11/25/15, T?r?k Edwin wrote: >> Hi, >> >> A user of our application (CC-ed) reported a corruption in an SQLite DB on >> FreeBSD (see below). There was no mmap used in this case, just a WAL DB with >> PRAGMA SYNCHRONOUS=NORMAL. >> From my reading of

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Török Edwin
Hi, A user of our application (CC-ed) reported a corruption in an SQLite DB on FreeBSD (see below). There was no mmap used in this case, just a WAL DB with PRAGMA SYNCHRONOUS=NORMAL. >From my reading of the SQLite docs this should not result in a corrupt DB, >worst case some COMMITs could be lo

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Simon Slavin
On 25 Nov 2015, at 4:26pm, T?r?k Edwin wrote: > Those are lots of pieces where something can go wrong, I'm doing some tests > to see whether I can reproduce the problem on a more usual setup (just one > OS, one disk, and no hypervisors or network block devices). You betcha. I'm betting that

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Richard Hipp
On 11/25/15, T?r?k Edwin wrote: >> >> The WAL file contains 15 separate transactions. But every single one >> of those transactions says that the database is only 24 pages long. >> Furthermore, 12 of the 15 transactions (including the first two and >> the last one) only touch pages that are on th

[sqlite] Fwd: Re: [sx-users] Corruption storage

2015-11-25 Thread Richard Hipp
On 11/25/15, T?r?k Edwin wrote: > Hi, > > A user of our application (CC-ed) reported a corruption in an SQLite DB on > FreeBSD (see below). There was no mmap used in this case, just a WAL DB with > PRAGMA SYNCHRONOUS=NORMAL. > From my reading of the SQLite docs this should not result in a corrupt