Re: [sqlite] Disk I/O Error

2012-10-25 Thread Joe Mistachkin
Caio Honma wrote: > > I was trying to query from a huge table (150,000,000 lines+) using a left > join statement, using mode csv and using an output to file.. after several > minutes I got the Disk I/O error. I searched this maillist for some > possible answers (tried to check_integrity, but the

Re: [sqlite] disk I/O error

2011-11-22 Thread Dan Kennedy
On 11/22/2011 04:14 PM, Tal Tabakman wrote: Thanks for the reply, this thing is that I get this while doing a select operation, now, I know that I get a lot of results from this select, but I am not writing anything to my DB explicitly. what am I missing here ? Some SELECT need to write to

Re: [sqlite] disk I/O error

2011-11-22 Thread Tal Tabakman
Thanks for the reply, this thing is that I get this while doing a select operation, now, I know that I get a lot of results from this select, but I am not writing anything to my DB explicitly. what am I missing here ? On unix, you should usually only get SQLITE_IOERR_WRITE if write() returns -1

Re: [sqlite] disk I/O error

2011-11-21 Thread Richard Hipp
On unix, you should usually only get SQLITE_IOERR_WRITE if write() returns -1 for some reason other than ENOSPC - in other words, if the write failed for some reason other than the disk being full. On Mon, Nov 21, 2011 at 4:05 AM, Tal Tabakman wrote: > As a continuation

Re: [sqlite] disk I/O error

2011-11-20 Thread Filip Navara
On Sun, Nov 20, 2011 at 1:21 PM, Richard Hipp wrote: > On Sun, Nov 20, 2011 at 6:53 AM, Tal Tabakman wrote: > >> in a continuation to the below, it seems I get the following extended err >> code >> SQLITE_IOERR_WRITE >> what are the reasons for that one ?

Re: [sqlite] disk I/O error

2011-11-20 Thread Richard Hipp
On Sun, Nov 20, 2011 at 6:53 AM, Tal Tabakman wrote: > in a continuation to the below, it seems I get the following extended err > code > SQLITE_IOERR_WRITE > what are the reasons for that one ? is it a symptom of mem blow-up ? > cheers > Tal > > What operating system did

Re: [sqlite] disk I/O error

2011-11-17 Thread Richard Hipp
On Thu, Nov 17, 2011 at 3:04 PM, Tal Tabakman wrote: > Hi Guys, > in which cases can I get sqlite3 error "disk I/O error", is it only when > disk is full ? > any other reasons for getting this one ? > Lots of reasons. Use sqlite3_extended_errcode() to get a more detailed

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Richard Hipp
On Tue, Nov 1, 2011 at 3:09 PM, Kyle McKay wrote: > "If write() is interrupted by a signal after it successfully writes some > data, it shall return the number of bytes written." > > and it doesn't appear that SQLite currently permits that behavior either > with or without the

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Kyle McKay
On November 1, 2011 08:48:25 PDT, Richard Hipp wrote: On Tue, Nov 1, 2011 at 10:40 AM, Korey Calmettes wrote: When we are able to reproduce the problem again, I will run these checks. It's fairly random however consistent. I will e-mail the results to you later

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Dan Kennedy
: disk I/O error Also, the page size is 1024. Korey -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Richard Hipp Sent: October 31, 2011 2:32 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Disk I/O Error On M

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Richard Hipp
error code=522 > Page 478: unable to get the page. error code=522 > Page 479: unable to get the page. error code=522 > Error: disk I/O error > > Also, the page size is 1024. > > Korey > > -Original Message- > From: sqlite-users-boun...@sqlite.org > [mailto:sql

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Korey Calmettes
--Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Richard Hipp Sent: October 31, 2011 2:32 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Disk I/O Error On Mon, Oct 31, 2011 at 5:01 PM, Korey Calmettes <kcalmet...

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Richard Hipp
eral Discussion of SQLite Database > Subject: Re: [sqlite] Disk I/O Error > > On Mon, Oct 31, 2011 at 5:01 PM, Korey Calmettes > <kcalmet...@icontime.com>wrote: > > > Hello, > > > > We are having a random problem with our system that has be puzzled at > &

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Pavel Ivanov
On Mon, Oct 31, 2011 at 5:44 PM, Richard Hipp wrote: > On Mon, Oct 31, 2011 at 5:40 PM, Pavel Ivanov wrote: > >> > Error code 522 is SQLITE_IOERR_SHORT_READ.  It is generated here: >> > >> >     http://www.sqlite.org/src/artifact/07acbb3e074e?ln=3012 >> > >>

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Stephan Beal
On Mon, Oct 31, 2011 at 10:44 PM, Richard Hipp wrote: > If an interrupt occurs that stops the read before it can complete, then the > read should be tried again. > http://www.sqlite.org/src/artifact/07acbb3e074e?ln=2968 This topic came up before a few months ago and someone

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Korey Calmettes
Of Richard Hipp Sent: October 31, 2011 2:32 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Disk I/O Error On Mon, Oct 31, 2011 at 5:01 PM, Korey Calmettes <kcalmet...@icontime.com>wrote: > Hello, > > We are having a random problem with our system that

Re: [sqlite] Disk I/O Error

2011-10-31 Thread Richard Hipp
On Mon, Oct 31, 2011 at 5:40 PM, Pavel Ivanov wrote: > > Error code 522 is SQLITE_IOERR_SHORT_READ. It is generated here: > > > > http://www.sqlite.org/src/artifact/07acbb3e074e?ln=3012 > > > > SQLite was trying to read N bytes and got back M byes where M>0 and M > Could

Re: [sqlite] Disk I/O Error

2011-10-31 Thread Pavel Ivanov
> Error code 522 is SQLITE_IOERR_SHORT_READ.  It is generated here: > >     http://www.sqlite.org/src/artifact/07acbb3e074e?ln=3012 > > SQLite was trying to read N bytes and got back M byes where M>0 and M wrote: > On Mon, Oct 31, 2011 at 5:01 PM, Korey Calmettes > wrote:

Re: [sqlite] Disk I/O Error

2011-10-31 Thread Richard Hipp
On Mon, Oct 31, 2011 at 5:01 PM, Korey Calmettes wrote: > Hello, > > We are having a random problem with our system that has be puzzled at > this point. > > First a little background. We have an embedded system running an ARM > processor and JFFS file system. We are

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy > Are you using synchronous=NORMAL or synchronous=FULL? When opening the database, in sqlite3PagerSetSafetyLevel(), I get: level:3, noSync:0, fullSync:1, sync_flags:2 > What does

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Dan Kennedy
On 09/20/2011 08:58 PM, Berthier, Emmanuel wrote: From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Can you post the hex of the first 28 bytes of the journal file? 000 d5d9 f905 a120 d763 0400 a15c eae6 010 6300

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Simon Slavin
On 20 Sep 2011, at 3:52pm, Berthier, Emmanuel wrote: > From: sqlite-users-boun...@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin >> Sorry to say that this subject is one where the longer you spend looking at >> it the more annoying it gets. > > You are not

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin > Sorry to say that this subject is one where the longer you spend looking at > it the more annoying it gets. You are not annoying me at all! ;-) > You either have storage devices which

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Simon Slavin
On 20 Sep 2011, at 3:30pm, Berthier, Emmanuel wrote: > I've downloaded eMMC spec from www.jedec.org and it's very interesting: Another thing you need to check for is out-of-order writes. Sometimes the device will accept four 'write' commands, but obey commands 1 and 4 first, then 2, then 3,

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin > > That's the usual scenario with spinning media. I'm less familiar with the > > internal workings of flash memory controllers. But people tell me that they > > fail in similar ways. > >

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
> From: sqlite-users-boun...@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy > > Can you post the hex of the first 28 bytes of the journal > file? 000 d5d9 f905 a120 d763 0400 a15c eae6 010 6300 0002 0004 020

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Simon Slavin
On 20 Sep 2011, at 2:07pm, Richard Hipp wrote: > That's the usual scenario with spinning media. I'm less familiar with the > internal workings of flash memory controllers. But people tell me that they > fail in similar ways. Yes yes and yes. With normal settings set, SSD storage controllers

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Dan Kennedy
On 09/20/2011 03:43 PM, Berthier, Emmanuel wrote: Hi, I'm using Sqlite 3.6.22 Froyo Branch on Android 2.3.4 distribution on a handset with eMMC storage memory. In case of power-cut (battery removal or kernel panic), we encounter some rare but critical errors during database rollback sequence:

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Richard Hipp
On Tue, Sep 20, 2011 at 8:46 AM, Berthier, Emmanuel < emmanuel.berth...@intel.com> wrote: > > I managed the FS mount option and this partition is mount write-back mode > with barrier=1. > That's the critical point: referring the documentation, this configuration > should be safe enough. > How can

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
-Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin > Can I ask where a power failure or a crash is involved in your finding at all > ? > Or is the corruption found when programs have only ever run as designed with

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Simon Slavin
On 20 Sep 2011, at 1:46pm, Berthier, Emmanuel wrote: > From: sqlite-users-boun...@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Stephan Beal > >> ...barrier=1 and do not disable the write cache so most Linux distributions >> are vulnerable to this problem. Note that this

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Stephan Beal > seek() allows one to seek past the end of the file, so the problem is not > with seek (unless sqlite3's VFS interface castrates it), but probably a > follow-up read() after the seek. It is

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Stephan Beal
On Tue, Sep 20, 2011 at 2:30 PM, Berthier, Emmanuel < emmanuel.berth...@intel.com> wrote: > This is a real Sqlite error, in http://www.sqlite.org/c3ref/c_abort.html, > there is: >#define SQLITE_IOERR 10 /* Some kind of disk I/O error > occurred */ > This error occurs when a

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Berthier, Emmanuel
k around it. Other database engines have also run into this same problem." Emmanuel. -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Simon Slavin Sent: Tuesday, September 20, 2011 2:08 PM To: General Discussion of SQLite

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Simon Slavin
On 20 Sep 2011, at 9:43am, Berthier, Emmanuel wrote: > I'm using Sqlite 3.6.22 Froyo Branch on Android 2.3.4 distribution on a > handset with eMMC storage memory. > In case of power-cut (battery removal or kernel panic), we encounter some > rare but critical errors during database rollback

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Nathan Biggs
thanks. On 2/8/2011 3:24 PM, Teg wrote: > > Hello Nathan, > > It could be hardware but, my experience with my users is that anything > weird like this is virus scanner of firewall related. You can suggest > that they try telling the V scanner to ignore the folder your data > resides in and see if

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Teg
Hello Nathan, It could be hardware but, my experience with my users is that anything weird like this is virus scanner of firewall related. You can suggest that they try telling the V scanner to ignore the folder your data resides in and see if it makes a difference. That's my normal suggestion to

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Nathan Biggs
That was exactly my thought. But since it is at a customer's site, I have to prove that its their virus scanner that is causing the problems. On 2/8/2011 1:17 PM, Jim Morris wrote: > > Could a backup or virus scanning software be locking the database? > > On 2/8/2011 10:12 AM, Nathan Biggs

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Simon Slavin
On 8 Feb 2011, at 6:12pm, Nathan Biggs wrote: > I haven't tried that, but if we stop the application then restart it, > everything works again. That is until we get another Disk I/O error > which happens the next day. > I'm wondering if the virus scanner is blocking the database write. Just

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Jim Morris
Could a backup or virus scanning software be locking the database? On 2/8/2011 10:12 AM, Nathan Biggs wrote: > I haven't tried that, but if we stop the application then restart it, > everything works again. That is until we get another Disk I/O error > which happens the next day. > I'm wondering

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Teg
Hello Nathan, I'd install "Procmon" set it to filter just on the problem file (and journal files) and let the software run. When you get an error, you should see the details listed in procmon". C Tuesday, February 8, 2011, 1:12:48 PM, you wrote: NB> I haven't tried that, but if we stop the

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Nathan Biggs
I haven't tried that, but if we stop the application then restart it, everything works again. That is until we get another Disk I/O error which happens the next day. I'm wondering if the virus scanner is blocking the database write. On 2/8/2011 1:03 PM, Simon Slavin wrote: > > On 8 Feb 2011,

Re: [sqlite] Disk I/O Error

2011-02-08 Thread Simon Slavin
On 8 Feb 2011, at 5:59pm, Nathan Biggs wrote: > Once a day, not at the same time, we are getting a disk I/O error from > our application using SQLite. If you try to duplicate the database file do you get any kind of error then ? If not, use the command-line tool to run an integrity check:

Re: [sqlite] Disk I/O error on AIX

2009-08-04 Thread Ken
Roger, Thats too funny. I guess I forgot posting this last year. Ken --- On Mon, 8/3/09, Roger Binns <rog...@rogerbinns.com> wrote: > From: Roger Binns <rog...@rogerbinns.com> > Subject: Re: [sqlite] Disk I/O error on AIX > To: "General Discussion of SQLite Database

Re: [sqlite] Disk I/O error on AIX

2009-08-04 Thread Ken
Thanks Dan! I'll check this in the morning. Ken --- On Tue, 8/4/09, Dan Kennedy <danielk1...@gmail.com> wrote: > From: Dan Kennedy <danielk1...@gmail.com> > Subject: Re: [sqlite] Disk I/O error on AIX > To: "General Discussion of SQLite Database" <sqlite

Re: [sqlite] Disk I/O error on AIX

2009-08-03 Thread Dan Kennedy
On Aug 4, 2009, at 5:11 AM, Ken wrote: > > Hi, > > I'm getting a Disk I/O error when committing a transaction on an AIX > system. > The file system is JFS. > > > The extended result code is 1290. Which i believe means that the > extended code is a SQLITE_IOERR_DIR_FSYNC error. > > Any ideas

Re: [sqlite] Disk I/O error on AIX

2009-08-03 Thread Roger Binns
Ken wrote: > I'm getting a Disk I/O error when committing a transaction on an AIX system. > The file system is JFS. > The extended result code is 1290. Which i believe means that the extended > code is a SQLITE_IOERR_DIR_FSYNC error. > > Any ideas why this is happening or how to track it down?

Re: [sqlite] Disk I/O error on AIX

2009-08-03 Thread Simon Slavin
On 3 Aug 2009, at 11:11pm, Ken wrote: > I'm getting a Disk I/O error when committing a transaction on an AIX > system. > The file system is JFS. Check all the obvious things: Is there free space on drive ? If you replace that transaction by a very simple INSERT, or by a DELETE, do you get

Re: [sqlite] disk I/O error...?

2009-04-11 Thread Alberto Simões
Hello. On Sat, Apr 11, 2009 at 3:04 PM, Jim Wilcoxson wrote: > You'll get this if you have a database with an active journal > (incomplete transactions) and you don't have write access to the > database.  In other words, the database needs a rollback from some > prior

Re: [sqlite] disk I/O error...?

2009-04-11 Thread Jim Wilcoxson
You'll get this if you have a database with an active journal (incomplete transactions) and you don't have write access to the database. In other words, the database needs a rollback from some prior operations done under a different userid, but now you don't have write access to do the rollback.

Re: [sqlite] disk I/O error

2007-06-06 Thread John Stanton
Arun Bhalla wrote: Hello, This message may be off-topic in that I don't think the following issue corresponds to a bug with SQLite, but it's something I've discovered while using SQLite. Perhaps someone on the list has had a similar experience or could make a suggestion. A Linux 2.6/x86_64

Re: [sqlite] disk I/O error

2007-06-06 Thread Joe Wilson
> A Linux 2.6/x86_64 system reports a "disk I/O error" (SQLITE_IOERR) > while generating a specific report from a SQLite database (SQLite > 3.3.6). The database and temporary files are accessed through an NFS > mount. After running the program again with SQLite tracing enabled > (plus a bit more

Re: [sqlite] disk I/O error writing files mounted via samba

2006-12-19 Thread Guy Hindell
Guy Hindell wrote: Guy Hindell wrote: [EMAIL PROTECTED] wrote: Guy Hindell <[EMAIL PROTECTED]> wrote: I would like to use sqlite (v3.3.8) on a linux box (fedora core 5) to read/write a database file in a directory which is actually on a windows share mounted via samba/cifs. I can open the

Re: [sqlite] disk I/O error writing files mounted via samba

2006-12-19 Thread Guy Hindell
Guy Hindell wrote: [EMAIL PROTECTED] wrote: Guy Hindell <[EMAIL PROTECTED]> wrote: I would like to use sqlite (v3.3.8) on a linux box (fedora core 5) to read/write a database file in a directory which is actually on a windows share mounted via samba/cifs. I can open the file, and read from

Re: [sqlite] disk I/O error writing files mounted via samba

2006-12-18 Thread Guy Hindell
[EMAIL PROTECTED] wrote: Guy Hindell <[EMAIL PROTECTED]> wrote: I would like to use sqlite (v3.3.8) on a linux box (fedora core 5) to read/write a database file in a directory which is actually on a windows share mounted via samba/cifs. I can open the file, and read from it, but writing

Re: [sqlite] disk I/O error writing files mounted via samba

2006-12-14 Thread Nikki Locke
Guy Hindell wrote: > I would like to use sqlite (v3.3.8) on a linux box (fedora core 5) to > read/write a database file in a directory which is actually on a windows > share mounted via samba/cifs. I can open the file, and read from it, but > writing produces "disk I/O error" messages

Re: [sqlite] disk I/O error writing files mounted via samba

2006-12-14 Thread drh
Guy Hindell <[EMAIL PROTECTED]> wrote: > I would like to use sqlite (v3.3.8) on a linux box (fedora core 5) to > read/write a database file in a directory which is actually on a windows > share mounted via samba/cifs. I can open the file, and read from it, but > writing produces "disk I/O

Re: [sqlite] Disk I/o Error : SQLITE_IOERR while performing Select/Delete on database

2006-05-10 Thread deepali rajale
Thanks for your reply. We use powerpc Linux on the embedded platform (CPU Model number : MPC885 ). I have downloaded the source code for sqlite version 3.3.4 and compiled it for powerpc linux gnu. Thanks Deepali On 5/10/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: "deepali rajale" <[EMAIL

Re: [sqlite] Disk I/o Error : SQLITE_IOERR while performing Select/Delete on database

2006-05-10 Thread drh
"deepali rajale" <[EMAIL PROTECTED]> wrote: > > I am getting SQLITE_IOERR error while trying to perform select or > delete operation on a record when Database has more than 3000 records. > The table is likely to grow to 1 records. > > Can someone give any pointers to the solution. > An