Re: [sqlite] disk image malformed

2012-12-06 Thread sqdev sqdev
The several cases of corrupted databases i mentioned all resulted from a newly created database. I do not reuse repaired databases with my application. The corrupted databases came from different computers and different users. 2012/12/6 Simon Slavin > > On 6 Dec 2012, at

Re: [sqlite] Incorrect library folder name in SQLite WinRT VSIX package

2012-12-06 Thread Joe Mistachkin
lm314v21-v2-...@fd6.so-net.ne.jp wrote: > > Release version of import library files (.lib) are deployed in the following > folder: > C:\Program Files (x86)\Microsoft SDKs\Windows\v8.0\ExtensionSDKs\SQLite.WinRT > \3.7.14.1\DesignTime\Retail\XXX > * XXX is ARM/x64/x86 > > On the other hand, the

[sqlite] Incorrect library folder name in SQLite WinRT VSIX package

2012-12-06 Thread lm314v21-v2-wol
Hi, In extension SDK's VSIX package of SQLite for WinRT (sqlite-winrt-3071401.vsix), there is discrepancy between name of folder which stores import library files (.lib) and default library folder path setting. Release version of import library files (.lib) are deployed in the following

Re: [sqlite] Tracing latencies

2012-12-06 Thread Keith Chew
Hi Richard On Fri, Dec 7, 2012 at 2:08 AM, Richard Hipp wrote: > If that does cure your latencies, it also adds another problem, in that it > does nothing to prevent two or more processes, or even two threads within > the same process, from trying to use the database at the same

Re: [sqlite] disk image malformed (Durga D)

2012-12-06 Thread Klaas V
If you made a backup in one of following ways yes: 1. SQLite's Internal command .backup  2. cp (or copy) command of your operating system's command line. > On Thu, Dec 6, 2012  Durga D wrote: Is there anyway to recover? > On Thu, Dec 6, 2012 at 10:23

Re: [sqlite] AsyncIO fails with current 3.7.15 trunk

2012-12-06 Thread Joe Mistachkin
Ralf Junker wrote: > > I know that AsyncIO is now superseded by WAL [1], but according to > Richard it should still work for existing applications [2]. > > However, I experience the opposite. > Could you please try the changes in: http://www.sqlite.org/src/info/c507ca4a8e and then

Re: [sqlite] Copying a DB file that is being in use

2012-12-06 Thread Yongil Jang
How about to use sqlite backup apis? These are designed to copy database file without locking on source file. AFAIK, it restart backup progress when source file is changed. 2012. 12. 7. 오전 4:30에 "romtek" 님이 작성: > Hi, > > A recent discussion of a reader/writer problematic

[sqlite] AsyncIO fails with current 3.7.15 trunk

2012-12-06 Thread Ralf Junker
I know that AsyncIO is now superseded by WAL [1], but according to Richard it should still work for existing applications [2]. However, I experience the opposite. The small C application below runs well when linked against SQLite 3.7.14. With SQLite 3.7.15, it mysteriously fails. I see two types

Re: [sqlite] SOLVED: Custom collation method works for comparison, not for ORDER BY

2012-12-06 Thread Niall O'Reilly
On 06/12/12 14:32, Niall O'Reilly wrote: > On 6 Dec 2012, at 14:14, Igor Tandetnik wrote: > > > Your code assumes, in several places, that strings passed to collation > > function are NUL-terminated. They don't have to be - that's why lengths are > > also passed. I think this may be causing the

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 7:57pm, dd wrote: > It's checking with OK, BUSY, 101 and some other errors. But not disk io, > image malformed errors. How to handle these errors in run time? these > databases have critical information about customers. We cannot stop > application. Any

Re: [sqlite] disk image malformed

2012-12-06 Thread dd
Databases integrity fine when application starts. These critical errors are introduced in run time. I cannot take backup of these databases also. space(memory) problem. On Fri, Dec 7, 2012 at 1:27 AM, dd wrote: > It's checking with OK, BUSY, 101 and some other errors. But

Re: [sqlite] disk image malformed

2012-12-06 Thread dd
It's checking with OK, BUSY, 101 and some other errors. But not disk io, image malformed errors. How to handle these errors in run time? these databases have critical information about customers. We cannot stop application. Any inputs? On Fri, Dec 7, 2012 at 1:20 AM, Simon Slavin

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 7:47pm, dd wrote: > No. I replaced with fresh database. I want to prevent these errors in our > customers place for future purpose. Run the integrity check every so often and see if the problem occurs again. Make sure that your program checks the

Re: [sqlite] disk image malformed

2012-12-06 Thread dd
No. I replaced with fresh database. I want to prevent these errors in our customers place for future purpose. On Fri, Dec 7, 2012 at 1:09 AM, Simon Slavin wrote: > > On 6 Dec 2012, at 7:30pm, dd wrote: > > > My multithreaded application do all

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 7:30pm, dd wrote: > My multithreaded application do all read/write operations. For each query, > it opens database connection and execute query then close connection. This > application executes plenty of records within a second. In this scenario, >

Re: [sqlite] disk image malformed

2012-12-06 Thread dd
I understand your points Simon. Let me explain scenario where I got this disk io error then my database got corrupted. My multithreaded application do all read/write operations. For each query, it opens database connection and execute query then close connection. This application executes plenty

[sqlite] Copying a DB file that is being in use

2012-12-06 Thread romtek
Hi, A recent discussion of a reader/writer problematic situation has prompted me to ask the following question. While the database file is being written to, the data isn't ready to be used by readers, so that DB is locked. What happens if I initiate copying of this file (e.g., to back it up)? Is

Re: [sqlite] disk image malformed

2012-12-06 Thread dd
No Robert. It's on same machine -- multiple threads within process, TRUNCATE mode. On Fri, Dec 7, 2012 at 12:38 AM, Robert Myers wrote: > One thing I haven't seen anyone ask yet - are you putting this on a > network drive? > On 12/6/2012 10:52 AM, Durga D wrote: > > Hi, >

Re: [sqlite] disk image malformed

2012-12-06 Thread Robert Myers
One thing I haven't seen anyone ask yet - are you putting this on a network drive? On 12/6/2012 10:52 AM, Durga D wrote: > Hi, > > Is it possible to corrupt a single table among 10 tables in a database? > > Is it possible to corrupt some records among millions of records in a > table? > > Best

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 6:51pm, Durga D wrote: > Does disk io error is related to hardware issue? i mean, fsync() dint get > success on unix. so, this error may be thrown by sqlite. Is it? Disk IO is sometimes caused by a hardware issue, but it can be caused by trusting data

Re: [sqlite] disk image malformed

2012-12-06 Thread Durga D
Does disk io error is related to hardware issue? i mean, fsync() dint get success on unix. so, this error may be thrown by sqlite. Is it? On Fri, Dec 7, 2012 at 12:00 AM, Simon Slavin wrote: > > On 6 Dec 2012, at 6:13pm, Durga D wrote: > > > I

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 6:49pm, sqdev sqdev wrote: > Please have a look at the post I mentioned: > I ran "PRAGMA integrity_check" in the shell tool (SQLite CLI) and got > errors, but still, they don't tell me what caused the corruption. I did read it. The shell tool can't tell

Re: [sqlite] disk image malformed

2012-12-06 Thread sqdev sqdev
Please have a look at the post I mentioned: I ran "PRAGMA integrity_check" in the shell tool (SQLite CLI) and got errors, but still, they don't tell me what caused the corruption. 2012/12/6 Simon Slavin > > On 6 Dec 2012, at 6:38pm, sqdev sqdev

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 6:38pm, sqdev sqdev wrote: > Maybe this post might be of interest here: > http://sqlite.1065341.n5.nabble.com/malformed-database-schema-td65610.html > > I had several corrupted databases the last few days. Unfortunately, I > haven't found out the cause

Re: [sqlite] disk image malformed

2012-12-06 Thread sqdev sqdev
Maybe this post might be of interest here: http://sqlite.1065341.n5.nabble.com/malformed-database-schema-td65610.html I had several corrupted databases the last few days. Unfortunately, I haven't found out the cause yet. 2012/12/6 Durga D > I will run integrity check. >

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 6:13pm, Durga D wrote: > I suspect, linking among pages will be broken in sqlite database when disk > io error thrown by sqlite. Is it? This is one form of database corruption. But there are others. Sometimes it's just a few strange characters inside

Re: [sqlite] disk image malformed

2012-12-06 Thread Durga D
I will run integrity check. >>I would like to know, why sqlite throws disk io error while inserting records... I suspect, linking among pages will be broken in sqlite database when disk io error thrown by sqlite. Is it? On Thu, Dec 6, 2012 at 11:30 PM, Simon Slavin

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 5:23pm, Durga D wrote: > Is it (corruption) related error code 10? (disk io) > > I would like to know, why sqlite throws disk io error while inserting > records... It doesn't matter. Run an in integrity check:

Re: [sqlite] disk image malformed

2012-12-06 Thread Black, Michael (IS)
Can you try doing table copies using select with offset and limit? See where limit crashes the system and then offset past it perhaps? Just a guess on my part as one possibility. Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop

Re: [sqlite] disk image malformed

2012-12-06 Thread Durga D
Is it (corruption) related error code 10? (disk io) I would like to know, why sqlite throws disk io error while inserting records... On Thu, Dec 6, 2012 at 10:43 PM, Simon Slavin wrote: > > On 6 Dec 2012, at 5:04pm, Durga D wrote: > > > i mean in

Re: [sqlite] to find table exists or not

2012-12-06 Thread kyan
On Thu, Dec 6, 2012 at 6:49 PM, Staffan Tylen wrote: > SELECT CASE WHEN EXISTS (...) END > > On Thu, Dec 6, 2012 at 5:47 PM, Durga D wrote: > >> I have situation in which I want to read particular record if table exists. >> Based on that record

Re: [sqlite] disk image malformed

2012-12-06 Thread Simon Slavin
On 6 Dec 2012, at 5:04pm, Durga D wrote: > i mean in second case. some records corrupted but not all. How to recover > this? There's no fixed answer. It depends on which parts of the file are corrupt, and what they had written to them. If you used the shell tool on the

Re: [sqlite] disk image malformed

2012-12-06 Thread Durga D
i mean in second case. some records corrupted but not all. How to recover this? On Thu, Dec 6, 2012 at 10:27 PM, Durga D wrote: > Is there anyway to recover? > > > On Thu, Dec 6, 2012 at 10:23 PM, Richard Hipp wrote: > >> On Thu, Dec 6, 2012 at 11:52 AM,

Re: [sqlite] disk image malformed

2012-12-06 Thread Durga D
Is there anyway to recover? On Thu, Dec 6, 2012 at 10:23 PM, Richard Hipp wrote: > On Thu, Dec 6, 2012 at 11:52 AM, Durga D wrote: > > > Hi, > > > > Is it possible to corrupt a single table among 10 tables in a database? > > > > Is it possible to

Re: [sqlite] disk image malformed

2012-12-06 Thread Richard Hipp
On Thu, Dec 6, 2012 at 11:52 AM, Durga D wrote: > Hi, > > Is it possible to corrupt a single table among 10 tables in a database? > > Is it possible to corrupt some records among millions of records in a > table? > Yes. Yes. > > Best Regards, >

Re: [sqlite] to find table exists or not

2012-12-06 Thread Igor Tandetnik
On 12/6/2012 11:47 AM, Durga D wrote:> I have situation in which I want to read particular record if table exists. Based on that record information, I have to execute some logic on other tables of the same database. If record doesn't exist I need to create new table. Prepare a statement to

[sqlite] disk image malformed

2012-12-06 Thread Durga D
Hi, Is it possible to corrupt a single table among 10 tables in a database? Is it possible to corrupt some records among millions of records in a table? Best Regards, ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] to find table exists or not

2012-12-06 Thread Staffan Tylen
SELECT CASE WHEN EXISTS (...) END Staffan On Thu, Dec 6, 2012 at 5:47 PM, Durga D wrote: > I have situation in which I want to read particular record if table exists. > Based on that record information, I have to execute some logic on other > tables of the same

Re: [sqlite] to find table exists or not

2012-12-06 Thread Durga D
I have situation in which I want to read particular record if table exists. Based on that record information, I have to execute some logic on other tables of the same database. If record doesn't exist I need to create new table. thanks for sharing your ideas. On Thu, Dec 6, 2012 at 5:26 PM,

Re: [sqlite] Custom collation method works for comparison, not for ORDER BY

2012-12-06 Thread Niall O'Reilly
On 6 Dec 2012, at 14:14, Igor Tandetnik wrote: > Your code assumes, in several places, that strings passed to collation > function are NUL-terminated. They don't have to be - that's why lengths are > also passed. I think this may be causing the problem you are seeing: when the > string comes

Re: [sqlite] Custom collation method works for comparison, not for ORDER BY

2012-12-06 Thread Igor Tandetnik
Niall O'Reilly wrote: > This and my Makefile follow below, as I understand attachments > are not supported on this list. Your code assumes, in several places, that strings passed to collation function are NUL-terminated. They don't have to be - that's why lengths are also

Re: [sqlite] Tracing latencies

2012-12-06 Thread Richard Hipp
On Thu, Dec 6, 2012 at 12:14 AM, Keith Chew wrote: > On Thu, Dec 6, 2012 at 3:52 PM, Keith Chew wrote: > > I am guess it may have something to do with the locking of the files. > > sqlite could be getting blocked by the filesystem when trying to > >

[sqlite] malloc failures on ubuntu

2012-12-06 Thread brijesh_philips
Hi, I am having below failures when i run SQLite on ubuntu. What could be the reason and how to get rid of it ? altermalloc-1.transient.19... Expected: [1 1] Got: [0 {}] attachmalloc-1.transient.19... Expected: [1 1] Got: [0 {}] attachmalloc-1.transient.63... Expected: [1 1] Got:

Re: [sqlite] Test failures on Ubuntu

2012-12-06 Thread brijesh_philips
Hi, Really appretiate if some one can point out how can i debug the failures Thanks -- View this message in context: http://sqlite.1065341.n5.nabble.com/Test-failures-on-Ubuntu-tp65874p65933.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] count infact passed rows of OFFSET select

2012-12-06 Thread Dave McKee
If you get no rows returned, you could query SELECT COUNT(*) FROM table1; (If you get rows returned, you know that the number skipped is the size of your offset.) On Thu, Dec 6, 2012 at 11:44 AM, Steffen Mangold < steffen.mang...@balticsd.de> wrote: > Hi, > > I want to know if there is a

Re: [sqlite] Custom collation method works for comparison, not for ORDER BY

2012-12-06 Thread Niall O'Reilly
On 6 Dec 2012, at 05:21, Dan Kennedy wrote: > It still seems likely that the collation returns the wrong result > some circumstances. Posting the code for it is probably the right > thing to do. Thanks for the encouragement! I've used conditionally compiled sections so that the

Re: [sqlite] to find table exists or not

2012-12-06 Thread Dave McKee
I can see situations in which you might want to create a new table with a name that wasn't already taken: at which point simple knowledge would let you reconsider your choice of table name without affecting the db in any way, success or fail. On Thu, Dec 6, 2012 at 10:57 AM, Hick Gunter

[sqlite] count infact passed rows of OFFSET select

2012-12-06 Thread Steffen Mangold
Hi, I want to know if there is a possibility to count the infact passed row if I make an OFFSET SELECT. For example: table1 --- Row1 Row2 Row3 Row4 Row5 Select * from table1 Order by rowID DESC Lilit 2 Offset 10; Here the Result is null, but I want to detect that I passed 5 existing

Re: [sqlite] to find table exists or not

2012-12-06 Thread Hick Gunter
Both applications can be done without external logic using CREATE TABLE IF NOT EXISTS ... (detect that the table is missing AND create it) and (if required) INSERT OR IGNORE INTO ... (set missing options to default while keeping pre-set values) -Ursprüngliche Nachricht- Von:

Re: [sqlite] to find table exists or not

2012-12-06 Thread Stephen Chrzanowski
I can think of two reasons why you wouldn't want to blindly delete the table, but verify that it exists. - First run of the program that creates the database from square one. If the table exists, skip over the create routine and continue. I routinely do this for creating an Options database