Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Hick Gunter
I think this may help me significantly, as none of the application SELECTs use native tables (only the schema metadata analyzer/checker uses native tables) but quite a few virtual tables (which cannot be ANALYZED). -Ursprüngliche Nachricht- Von: Richard Hipp [mailto:d...@sqlite.org]

Re: [sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Michael Foss
You are right that new data is usually more than a single INSERT. I will try out your suggestion of opening and closing the database file outside of each transaction. I am also going to look into WAL journalling mode since I am only writing data to the disk in the mode that my embedded system

Re: [sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Michael Foss
Thank you, Dr. Hipp--that did the trick! ~Mike Foss ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 10:58 AM, Bert Huijben wrote: > We anticipate that the wc_id column will be used more in future versions > and > I had hoped that the assumption that a better index match (matching more > usable columns) would always be preferable over one that uses

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Stefan Keller
Dear Keith > I think your definition is a little off. (...) Nice thoughts about the general term of a system - but unfortunately not state-of-the-art. If you don't trust in G* pls. read the first chapters of any university course or well-known or books about Database Systems, like the book

Re: [sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Stephan Beal
On Mon, Sep 2, 2013 at 10:52 PM, Richard Hipp wrote: > sqlite3_open() and sqlite3_open_v2() defer the actual opening of the > database file until you do something with the database. This is to give > you the opportunity to issue PRAGMA statements that might influence the >

Re: [sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 9:47pm, Michael Foss wrote: > I am using SQLite on an embedded system that the user will power off at any > time (i.e. there is never a clean shut down). The system contains sensors > and uses a C program with the SQLite library. The sensor data is saved

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 9:54pm, Kees Nuyt wrote: > I would reverse 2) and 3), otherwise ANALYZE has nothing to analyze. Of course. I thought it right and wrote it wrong. Thanks for the correction. Simon. ___ sqlite-users mailing list

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Darren Duncan
On 2013.09.02 6:06 AM, Simon Slavin wrote: The 'R' stands for 'relational' -- the sort of things SQLite implements with FOREIGN KEYS. A user model was assumed as part of Ted Codd's description of a 'proper' DBMS but he didn't require it, he only said that if you had a user model, the DBMS

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Kees Nuyt
On Mon, 2 Sep 2013 17:32:31 +0100, Simon Slavin wrote: > >On 2 Sep 2013, at 3:58pm, Bert Huijben wrote: > >> We anticipate that the wc_id column will be used more in future versions and >> I had hoped that the assumption that a better index match

Re: [sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 4:47 PM, Michael Foss wrote: > Hello, > > I am using SQLite on an embedded system that the user will power off at any > time (i.e. there is never a clean shut down). The system contains sensors > and uses a C program with the SQLite library. The sensor

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
> To me (as a university teacher :->), here exists no single common > definition what a (R)DBMS is! That comes close: > A database management system (DBMS) is software that controls the > storage, organization, and retrieval of data. A DBMS provides > various functions like data security, data

[sqlite] What am I missing when recovering a hot journal?

2013-09-02 Thread Michael Foss
Hello, I am using SQLite on an embedded system that the user will power off at any time (i.e. there is never a clean shut down). The system contains sensors and uses a C program with the SQLite library. The sensor data is saved to an in-memory database every second. Every 10 seconds, the program

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/09/13 08:58, C M wrote: > If you think APSW would provide more details about just what went > wrong other than "SQLite logic error or missing database" (which, I > feel, doesn't tell me much at all), then I could potentially try it. I'm in the

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread E.Pasma
Op 2 sep 2013, om 17:58 heeft C M het volgende geschreven: ... Is setting up APSW and making the transition from pysqlite2's wrapper fairly straightforward, or would I have to re-do all the database queries? (Even so, I do them all in one utilities library, so perhaps it would be not too

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Stefan Keller
I understand now. To me (as a university teacher :->), here exists no single common definition what a (R)DBMS is! That comes close: A database management system (DBMS) is software that controls the storage, organization, and retrieval of data. A DBMS provides various functions like data

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 3:58pm, Bert Huijben wrote: > We anticipate that the wc_id column will be used more in future versions and > I had hoped that the assumption that a better index match (matching more > usable columns) would always be preferable over one that uses less

Re: [sqlite] VACUUM and large indices: best practice?

2013-09-02 Thread Dennis Jenkins
On Fri, Aug 30, 2013 at 3:52 PM, Simon Slavin wrote: > Great question. If all you are doing is writing (never any UPDATE or > DELETE FROM or DROP) then VACUUM won't save any space in your database > file. It would defragment your database and might thereby increase speed

Re: [sqlite] Strange assert when running with authorizer

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 12:02 PM, Hick Gunter wrote: > The following select causes an assertion to fail in 3.7.4 when an > authorizer callback has been registered: > > asql> create temp table test(x text); > asql> select 1 as is_named from test where is_named=1; >

[sqlite] Strange assert when running with authorizer

2013-09-02 Thread Hick Gunter
The following select causes an assertion to fail in 3.7.4 when an authorizer callback has been registered: asql> create temp table test(x text); asql> select 1 as is_named from test where is_named=1; sqlite3AuthRead: Assertion `pExpr->op==152 || pExpr->op==60' failed. Of course the statement is

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread C M
On Sun, Sep 1, 2013 at 6:12 PM, Richard Hipp wrote: > Does Python have an interface to the error and warning log mechanism of > SQLite? (http://www.sqlite.org/errlog.html) Can you turn that on? It > will probably give more details about what it happening. > Looks like, no,

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread C M
On Sun, Sep 1, 2013 at 7:51 PM, Roger Binns wrote: > > He needs to give the exception traceback which will show what is happening > at the time. > > A common mistake with newish Python programmers is to catch all > exceptions, and then keep going which also hides the

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread C M
On Mon, Sep 2, 2013 at 2:33 AM, Markus Schaber wrote: > Hi, C M, > > > Just to be safe: Can you roule out any antivirus or other security > software locking the files temporarily? > Good idea, but I don't think that is what is happening in my case. I actually have a way

Re: [sqlite] Query problems

2013-09-02 Thread Joseph L. Casale
> Plus, of course, index will only ever be used for operations where you have > overridden the default collating sequence for the operation, for example by > specifying collate nocase in the join expression, or adding the collate > nocase to > the order by or group by. I assume this explains why

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread C M
On Sun, Sep 1, 2013 at 6:53 PM, Simon Slavin wrote: > > On 1 Sep 2013, at 10:34pm, C M wrote: > > > Do you know how I can do that with Python? For example, I tried this: > > > > status = cursor.execute("some SQL statement here") > > print "The status

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 10:58 AM, Bert Huijben wrote: > We anticipate that the wc_id column will be used more in future versions > and > I had hoped that the assumption that a better index match (matching more > usable columns) would always be preferable over one that uses

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 10:58 AM, Bert Huijben wrote: > We can't really assume our > users to run a specific version of Sqlite (as most unix distributions > compile sqlite themselves for products like ours)... > Yes you can: statically link. Add "sqlite3.c" and

Re: [sqlite] to encrypt sqlite db

2013-09-02 Thread Yuriy Kaminskiy
Etienne wrote: > - Original message - > From: Paolo Bolzoni > To: General Discussion of SQLite Database > Subject: Re: [sqlite] to encrypt sqlite db > Date: Sun, 1 Sep 2013 18:24:13 +0200 >> On Sun, Sep 1, 2013 at 6:10 PM, Etienne

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Bert Huijben
> -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of Richard Hipp > Sent: maandag 2 september 2013 16:11 > To: General Discussion of SQLite Database > Subject: Re: [sqlite] Inefficient covering index used for Subversion

Re: [sqlite] Query problems

2013-09-02 Thread Keith Medcalf
Plus, of course, index will only ever be used for operations where you have overridden the default collating sequence for the operation, for example by specifying collate nocase in the join expression, or adding the collate nocase to the order by or group by. > -Original Message- >

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
I have seem filing systems run by Administrative Assistants which are RDBMS systems. First they look up title of what you are looking for in the rolodex. This provides them with the particular cabinet, drawer, and file number where the data is stored. R = Relational D = Data B = Base M =

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
And that is the problem with universities ... :) > -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of itli...@schrievkrom.de > Sent: Monday, 2 September, 2013 06:18 > To: General Discussion of SQLite Database > Subject: Re:

Re: [sqlite] to encrypt sqlite db

2013-09-02 Thread Yuriy Kaminskiy
Ulrich Telle wrote: > Am 31.08.2013 22:01, schrieb Etienne: On Sat, 31 Aug 2013 17:17:23 +0200 Etienne wrote: > > On the other hand removing patterns definitely cannot hurt. > > Precisely. > > The very first

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
"Embeded SQL Engine" is to DBMS as Rose is to Flowering Plants ... > -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of kimtiago > Sent: Sunday, 1 September, 2013 06:37 > To: sqlite-users@sqlite.org > Subject: Re: [sqlite]

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
dBase uses ISAM as its access method for data just like everything else. There are modernized variants of dBase/Clipper. Most of the modernization efforts had been to tack on a gooey and gratuitous windows misfeatures just for the sake of checkbox compliance. Fortunately most of those

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Keith Medcalf
My index card box (you know, them old fashioned rolodex things used by old farts) is a DBMS. There is nothing magical about the term DBMS. It means Data Base Management System. So, you have to ask: 1. Does it deal with data? 2. Does it manage that data? 3. Is it a system? If the answers

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Richard Hipp
On Mon, Sep 2, 2013 at 9:42 AM, Bert Huijben wrote: > > My question is more like: Should I see this as a light regression that most > likely will be resolved in a future version, or as a buggy assumption in > our > code that I should work around? It should be possible via

Re: [sqlite] Inefficient covering index used for Subversion with SQLite 3.8.0

2013-09-02 Thread Bert Huijben
> -Original Message- > From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users- > boun...@sqlite.org] On Behalf Of Richard Hipp > Sent: vrijdag 30 augustus 2013 21:41 > To: General Discussion of SQLite Database > Subject: Re: [sqlite] Inefficient covering index used for Subversion

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Clemens Ladisch
Simon Slavin wrote: > On 2 Sep 2013, at 1:17pm, itli...@schrievkrom.de wrote: >> At university I learned, that a RDBMS also have these management >> functionality like "user access", "user roles", "user password", >> access restrictions ... and all that stuff. > > Whoever told you that was wrong.

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 1:17pm, itli...@schrievkrom.de wrote: > At university I learned, that a RDBMS also have these management > functionality like "user access", "user roles", "user password", access > restrictions ... and all that stuff. Whoever told you that was wrong. The user model is not

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 1:07pm, Richard Hipp wrote: > On Sun, Sep 1, 2013 at 8:37 AM, kimtiago wrote: > >> Now let me explain why i have this doubt. I did a exam and I miss this >> question, > > In a classroom setting, SQLite is whatever your instructor says it

Re: [sqlite] Query problems

2013-09-02 Thread Simon Slavin
On 2 Sep 2013, at 8:25am, Eduardo Morras wrote: > Or create the index with collate > > CREATE INDEX idx_collated_column ON myTable ( column COLLATE NOCASE ) The problem with doing it in the index is that it's hard to predict when SQLite will use a particular index. Better

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Hick Gunter
So by the simple act of implementing and registering an authorizer callback we have transformed an SQL Engine into an RDBMS. Neat ;) -Ursprüngliche Nachricht- Von: itli...@schrievkrom.de [mailto:itli...@schrievkrom.de] Gesendet: Montag, 02. September 2013 14:18 An: General Discussion of

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread itli...@schrievkrom.de
At university I learned, that a RDBMS also have these management functionality like "user access", "user roles", "user password", access restrictions ... and all that stuff. In my view, SQLite is a SQL engine .. that's it, but actually who cares about that ? Marten

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Richard Hipp
On Sun, Sep 1, 2013 at 8:37 AM, kimtiago wrote: > > Now let me explain why i have this doubt. I did a exam and I miss this > question, > In a classroom setting, SQLite is whatever your instructor says it is. So you should let this issue go. Just remember that what you

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread kimtiago
Hi people, I`m really sorry if you think i`m a noob. Maybe I am. I`m brazilian and my english its not very good. I googled SQLite and i read a lot of information before post in this forum. I`m writing by nabble yes. Now please tell me. Is this a forum only for experts? I just asked a

Re: [sqlite] Query problems

2013-09-02 Thread Eduardo Morras
On Mon, 2 Sep 2013 02:12:05 +0100 Simon Slavin wrote: > > On 2 Sep 2013, at 2:03am, Joseph L. Casale wrote: > > > I am using LIKE as the columns are indexed NOCASE and I need the > > comparison case insensitive. > > Have you tried using '=' ?

Re: [sqlite] to encrypt sqlite db

2013-09-02 Thread Clemens Ladisch
Ulrich Telle wrote: > Am 02.09.2013 06:11, schrieb Etienne: >> wxSQLite3 does implement AES in ECB mode > > Wrong. CBC mode is used. Inside one page. If we ignored the actual block size, and viewed the entire database as a stream to be encrypted by a cipher with a block size identical with the

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Nataraj S Narayan
Gee... I started out in late 80's as a Dbase III+ coder. Then it was the defacto DBMS on the PC. Wonder if it still relevant in any serious application in these days. regards Nataraj On Mon, Sep 2, 2013 at 11:58 AM, Darren Duncan wrote: > I don't think that being ACID

Re: [sqlite] help needed for major SQLite problem

2013-09-02 Thread Markus Schaber
Hi, C M, Im Auftrag von C M > On Sun, Sep 1, 2013 at 4:28 PM, jose isaias cabrera > wrote: > > "C M" wrote... > > Keeping it simple: > >> > >> I have a Python application that uses SQLite, and I randomly get this > >> error: > >> > >> "SQL logic error or missing database"

Re: [sqlite] Is SQLite a DBMS?

2013-09-02 Thread Darren Duncan
I don't think that being ACID and SQL compliant is the definition of a DBMS, far from it. While it is true that typically anything which is ACID and SQL compliant is a DBMS, lots of things can be a DBMS without being either ACID or SQL compliant. See dBASE for example. -- Darren Duncan On

Re: [sqlite] curious: Why no "shared library" or DLL?

2013-09-02 Thread Markus Schaber
Hi, Im Auftrag von Tiago Rodrigues [...] > It's not that "everyone in Windows programming expects everything to be a > DLL"; this is an overgeneralisation. After all, Java isn't exactly Windows- > only code and we're not dealing with Win32, but with IBM zOS. > However, think a bit on the problem

Re: [sqlite] VACUUM and large indices: best practice?

2013-09-02 Thread Markus Schaber
Hi, Im Auftrag von uncle.f > Hello all, > > I have a process that runs 24/7 and permanently inserts data into an SQLite > database: > > 1) Create new database at midnight, keep it open for writing for the next > 24 hours > 2) There are no deletions and not even reads during the database