Re: [sqlite] Speeding up index creation

2011-09-02 Thread Dan Kennedy
b-tree is larger than the cache, as you are always inserting into the right-most leaf node. No need to go searching through the file-system/disk for pages while building the b-tree. Dan. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Speeding up index creation

2011-09-02 Thread Dan Kennedy
ecords in main memory in vdbesort.c. (user: dan, tags: merge-sort) CPU Time: user 118.451559 sys 132.117247 [71075673c6] Leaf: If all data being sorted fits in memory, avoid writing any data out to temporary files in vdbesort.c. (user: dan, tags: merge-sort) CPU Time: user 116.813549 sys 132.710051

Re: [sqlite] Strange performance problem

2011-09-05 Thread Dan Kennedy
On 09/05/2011 10:47 PM, Rado Rado wrote: I'm running simple prepared SELECT statement in loop ( about 3000 times ). It is something like "SELECT value FROM t WHERE t_id=? AND name=?". For most calls the row does not exist, step() returns SQLITE_DONE so I call reset after that(). The loop takes

Re: [sqlite] Strange performance problem

2011-09-05 Thread Dan Kennedy
On 09/06/2011 12:04 AM, Stephan Beal wrote: On Mon, Sep 5, 2011 at 6:59 PM, Dan Kennedy<danielk1...@gmail.com> wrote: You could get the same effect by wrapping your loop in a BEGIN/COMMIT block. Out of curiosity: would a BEGIN/ROLLBACK be equivalent for this case (where only S

Re: [sqlite] OMIT_VIRTUALTABLE

2011-09-14 Thread Dan Kennedy
On 09/14/2011 03:38 PM, Baruch Burstein wrote: When using OMIT_VIRTUALTABLE, I get a warning at line 11688 (3.7.7.1 amalgamation) that sqlite3GetVTable is used but never defined. If I add #ifndef SQLITE_OMIT_VIRTUALTABLE #endif around it, I get an error at line 81609, because this function is

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Dan Kennedy
nb=4 so journal size should be = 512+4x1024=4608 B but is currently 3608 B). Can you post the hex of the first 28 bytes of the journal file? If you move the journal file out of the way, does the integrity-check succeed? Dan. ___ sqlite-users mail

Re: [sqlite] Disk I/O Error on Ext3/write-back/barrier FS.

2011-09-20 Thread Dan Kennedy
On 09/20/2011 08:58 PM, Berthier, Emmanuel wrote: From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Dan Kennedy Can you post the hex of the first 28 bytes of the journal file? 000 d5d9 f905 a120 d763 0400 a15c eae6 010 6300

Re: [sqlite] SQLITE issues - IPAD development

2011-09-21 Thread Dan Kennedy
On 09/22/2011 01:30 AM, ecky wrote: Howdy I have a SQLITE database I created using the firefox plugin (SQLITE manager). I'm using that database in my IPAD app and I can read and write to it. However... I'm trying to debug some issue with my app so I copy the database file off my IPAD back

Re: [sqlite] Permissions issue with SQLite

2011-09-22 Thread Dan Kennedy
On 09/22/2011 09:20 PM, Stephan Beal wrote: On Thu, Sep 22, 2011 at 4:16 PM, Magnus Thor Torfason< zulutime@gmail.com> wrote: SQLite version 3.3.6 Just to preempt the inevitable request to try it on a current version: this is reproducible on 3.7.2 (Ubuntu 10.10). For new versions,

Re: [sqlite] Permissions issue with SQLite

2011-09-22 Thread Dan Kennedy
On 09/23/2011 03:09 AM, Magnus Thor Torfason wrote: On 9/22/2011 10:25, Dan Kennedy wrote: For new versions, new db files are created with the permissions specified by compilation option SQLITE_DEFAULT_FILE_PERMISSIONS. Subject to umask of course. http://www.sqlite.org/compile.html

Re: [sqlite] LEFT JOIN optimization

2011-09-23 Thread Dan Kennedy
On 09/23/2011 04:01 AM, Mira Suk wrote: EXPLAIN QUERY PLAN SELECT DISTINCT ItemsME.Points FROM (ItemsME_Properties LEFT JOIN ItemsME ON ItemsME_Properties.IDR = ItemsME.IDR) WHERE ItemsME.IDR IN (SELECT IDR FROM cProds WHERE Prod = 106) selectidorderfromdetail 000SCAN

Re: [sqlite] WAL checkpointing

2011-09-29 Thread Dan Kennedy
On 09/29/2011 03:17 PM, Jaco Breitenbach wrote: Dear all, In the WAL documentation (http://www.sqlite.org/wal.html) it is hinted that the checkpoint operation, which is normally in the same thread if execution as the database commit, could be moved to a separate thread or process. If I were to

Re: [sqlite] WAL checkpointing

2011-09-29 Thread Dan Kennedy
On 09/29/2011 05:20 PM, Mikael wrote: 2011/9/29 Simon Slavin<slav...@bigfraud.org> On 29 Sep 2011, at 10:38am, Dan Kennedy wrote: On 09/29/2011 03:17 PM, Jaco Breitenbach wrote: In the WAL documentation (http://www.sqlite.org/wal.html) it is hinted that the checkpoint operation,

Re: [sqlite] Crashes in sqlite3RunParser

2011-10-01 Thread Dan Kennedy
nd and see what it turns up. Dan. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Meaning of sqlite3_wal_checkpoint_v2 parameters

2011-10-07 Thread Dan Kennedy
sn't corrupt, and the proper response is to just retry. 5) Is this considered to be a bug, or is it the result of some temporary hardware issue? 6) Is this aggravated by the use of WAL, or totally unrelated? Sounds like questionable information to me. We know of no such bugs at p

Re: [sqlite] Wrong default locking style on NFS server not supporting locking via fcntl()

2011-10-11 Thread Dan Kennedy
On 10/10/2011 08:37 PM, Tobias Mueller wrote: Hello, I'm trying to compile SQLite on a GNU/Linux system for use in an NFS environment. The NFS server doesn't support locks via fcntl(), i.e.: access("/homedir//.mozilla/firefox/51jxlyk4.default/places.sqlite", F_OK) = 0

Re: [sqlite] FTS4: OFFSET Performance

2011-10-12 Thread Dan Kennedy
creating the FTS4 table? If not, it might be a big help in this case. http://www.sqlite.org/fts3.html#fts4order Dan. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] FTS4: OFFSET Performance

2011-10-12 Thread Dan Kennedy
On 10/12/2011 09:39 PM, Fabian wrote: 2011/10/12 Dan Kennedy<danielk1...@gmail.com> Can we see the output of EXPLAIN for this query? Without selecting table2.data2: 0 0 0 SEARCH TABLE table1 USING INDEX data1idx (data1=?) (~3 rows) Including selecting table2.data2: 0 0 0

Re: [sqlite] Malformed database error when using FTS3/4

2011-10-13 Thread Dan Kennedy
: http://www.sqlite.org/src/info/7e24645be2 Bug report: http://www.sqlite.org/src/info/9fd058691b You are correct in that the bug only occurs when the FTS table contains exactly one row. Bug was introduced in version 3.7.7. Dan. ___ sqlite-users

Re: [sqlite] Can DBI supply a more specific foreign key mismatch error?

2011-10-13 Thread Dan Kennedy
On 10/14/2011 01:29 AM, fe...@crowfix.com wrote: I'm working on a project which generates tables from a config file, and it seems to be happy on a Mac OSX running 3.4.0, but Linux running 3.7.8 complains about an insert with the unhelpful message (foreign key mismatch) It means there is

Re: [sqlite] Slow JOIN on ROWID

2011-10-14 Thread Dan Kennedy
not help with the ORDER BY. If SQLite cannot use an index to for an ORDER BY in a SELECT query and has to do an external sort, the EXPLAIN QUERY PLAN output will have something like this in it: 0|0|0|USE TEMP B-TREE FOR ORDER BY Dan. ___ sqlite-users

Re: [sqlite] Slow JOIN on ROWID

2011-10-14 Thread Dan Kennedy
On 10/14/2011 09:34 PM, Fabian wrote: 2011/10/14 Dan Kennedy<danielk1...@gmail.com> If SQLite cannot use an index to for an ORDER BY in a SELECT query and has to do an external sort, the EXPLAIN QUERY PLAN output will have something like this in it: 0|0|0|USE TEMP B-TREE FOR

Re: [sqlite] Slow JOIN on ROWID

2011-10-14 Thread Dan Kennedy
On 10/14/2011 10:13 PM, Fabian wrote: 2011/10/14 Dan Kennedy<danielk1...@gmail.com> Good question. Can you enter the following commands into the shell tool and post the complete output (no "QUERY PLAN" this time): .version .schema .explain EXPLAIN SELECT * FROM tabl

Re: [sqlite] Slow JOIN on ROWID

2011-10-14 Thread Dan Kennedy
On 10/14/2011 11:23 PM, Simon Slavin wrote: On 14 Oct 2011, at 5:12pm, Fabian wrote: Is this the expected output? If so, ANALYZE was to blame. The query containing 'ORDER BY rowid DESC' is still slower than the one which doesn't specify any order, but the results are closer to eachother now.

Re: [sqlite] Changing the data type of an existing table

2011-10-16 Thread Dan Kennedy
On 10/16/2011 02:37 PM, Frank Missel wrote: When I first learned about SQLite I never like the relaxed handling of data where column data types from the schema are not enforced strictly on the actual data in the tables. This felt instinctively wrong as it is very contrary to other databases and

Re: [sqlite] sqlite3 query really slow with version > 3.7.5

2011-10-17 Thread Dan Kennedy
On 10/17/2011 11:05 AM, Owen Kaluza wrote: Hi, After upgrading my OS I noticed a huge delay loading my application, I narrowed it down to my system libsqlite3 being upgraded from 3.7.4 to 3.7.7 I did some quick testing with different versions and it seems the change comes about between 3.7.5

Re: [sqlite] Very slow processing of some SELECT statements

2011-10-17 Thread Dan Kennedy
On 10/17/2011 04:33 PM, Nick Gammon wrote: Hello, Running under Windows XP, using sqlite3.exe version: 3.7.8 2011-09-19 14:49:19 3e0da808d2f5b4d12046e05980ca04578f581177 ... Trying under Mac OS/X (Lion) does not appear to exhibit this problem. No problem with that version on Linux either.

Re: [sqlite] Very slow processing of some SELECT statements

2011-10-17 Thread Dan Kennedy
On 10/18/2011 03:17 AM, Nick Gammon wrote: On 17/10/2011, at 9:55 PM, Dan Kennedy wrote: Did you download the binary from the website or build it yourself? If the latter, which compiler are you using? And what level of optimization is enabled? I initially observed the problem with version

Re: [sqlite] Problem with FTS4 - Floating point error.

2011-10-18 Thread Dan Kennedy
nTC) Line 52634 + 0x2a bytesC Does anybody know what's going on here? Can you send me the database by email? Not via the list, as it will strip the attachment. Dan Kennedy. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:

Re: [sqlite] How is the amalgamation produced?

2011-10-24 Thread Dan Kennedy
On 10/24/2011 08:32 PM, Baruch Burstein wrote: I found what seem to be two options for producing an amalgamation: 1. "./configure" and "make sqlite3.c" (something like that, it is not in front of me at the moment, but I have done this and know it works) 2. There is a Tcl script in the tool

Re: [sqlite] EXT :Re: Concurrent readonly access to a large database.

2011-10-24 Thread Dan Kennedy
were using on the SSD drive when you obtained this result? Thanks, Dan. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Problem with FTS4 - Floating point error.

2011-10-25 Thread Dan Kennedy
On 10/25/2011 12:49 PM, Mohd Radzi Ibrahim wrote: On 18-Oct-2011, at 6:52 PM, Dan Kennedy wrote: On 10/18/2011 05:02 PM, Mohd Radzi Ibrahim wrote: Hi, This is my table schema: CREATE VIRTUAL TABLE LocationFTS using FTS4 ( name text, address text, email text

Re: [sqlite] Virtual Tables and tcl / apsw

2011-10-25 Thread Dan Kennedy
On 10/25/2011 02:31 PM, sqlite-us...@h-rd.org wrote: Hi, I have some questions on virtual tables and tcl compared to perl and python/apsw. As I understand you can build your own virtual table implementation with apsw (and also with perl). Is this also possible with tclsqlite? Any pointers

Re: [sqlite] Virtual Tables and tcl / apsw

2011-10-25 Thread Dan Kennedy
On 10/25/2011 04:28 PM, Alexey Pechnikov wrote: 2011/10/25 Dan Kennedy<danielk1...@gmail.com>: Not possible. The Tcl interface has no bindings for either the virtual table or VFS interfaces. But why? Is there any technical/ideological problems? None that are insurmountable, I would

Re: [sqlite] Error messages from user-defined functions calling sqlite3_result_error() requires sqlite3_finalize?

2011-10-27 Thread Dan Kennedy
On 10/27/2011 07:12 AM, Peter Aronson wrote: This may be a known thing, but I can't find anything on it on-line. I finally figured out a solution by examining the code to shell.c. OK, I have a user-defined function in an extension that calls sqlite3_result_error() when an out-of-bounds

Re: [sqlite] [Regression?] FTS function crashes since 3.7.7

2011-10-29 Thread Dan Kennedy
://www.sqlite.org/src/info/3565fcf898 Please follow up if you try this fix and you still get the crash. Dan. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Disk I/O Error

2011-11-01 Thread Dan Kennedy
On 11/02/2011 12:37 AM, Korey Calmettes wrote: I don't think the file is truncated. What is the size of the file on disk? Interesting stuff here when I run pragma integrity_check: /data # sqlite3 test.db "pragma integrity_check;" *** in database main *** Page 480: unable to get the page.

Re: [sqlite] does sqlite3_reset have a performance impact onqueries?

2011-11-02 Thread Dan Kennedy
On 11/02/2011 08:13 PM, Black, Michael (IS) wrote: Maybe my memory is fading but this is the first time I've heard anybody say the wrapping a BEBIN around a SELECT was needed. I'd swear it was always said it wasn't ever needed. From the docs http://www.sqlite.org/lang_transaction.html

Re: [sqlite] Progress callback and nested queries

2011-11-02 Thread Dan Kennedy
ar or like that. I'm assuming that querying the same database using the same handle during a "progress" callback would be a *bad* idea. Am I mistaken? The docs here say you're not supposed to (last paragraph): http://www.sqlite.org/c3ref/progre

Re: [sqlite] SQLITE_FCNTL_CHUNK_SIZE + wal files

2011-11-10 Thread Dan Kennedy
On 11/11/2011 01:01 AM, George Pee wrote: Is there a way to make the wal files honor the chunk size specified by sqlite3_file_control and SQLITE_FCNTL_CHUNK_SIZE ? Not currently. ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] Release 3.7.8 CREATE INDEX slower

2011-11-17 Thread Dan Kennedy
this is happening though. Are your rows in sorted order? i.e. if you do: SELECT FROM ORDER BY rowid; Do the values come out in sorted order? Or, are you able to share the database? Either by uploading it or emailing it to me? Dan

Re: [sqlite] Proper way to change temp directory

2011-11-20 Thread Dan Kennedy
On 11/20/2011 04:00 PM, Yang Zhang wrote: Out of curiosity, what's the proper way to change the temp directory (say, to avoid "Error: database or disk full" errors on vacuum, which I ran into)? temp_store_directory has been working for me but it's deprecated and may be elided from builds. Is

Re: [sqlite] SQLite: Database or disk full

2011-11-21 Thread Dan Kennedy
need to retry writes following. Dan. Simon Slavin-3 wrote: On 21 Nov 2011, at 11:09pm, gavyas wrote: I am able to run the code successfully when I dont use parallel runs. It gives error when I am running the code parallely. Ahha. That's a more useful diagnostic. If you haven

Re: [sqlite] disk I/O error

2011-11-22 Thread Dan Kennedy
On 11/22/2011 04:14 PM, Tal Tabakman wrote: Thanks for the reply, this thing is that I get this while doing a select operation, now, I know that I get a lot of results from this select, but I am not writing anything to my DB explicitly. what am I missing here ? Some SELECT need to write to

Re: [sqlite] Transactions for SELECT

2011-11-22 Thread Dan Kennedy
On 11/22/2011 04:34 PM, Baruch Burstein wrote: Do transactions speed up SELECT statements? They can a bit. If you put 10 SELECT statements in a transaction SQLite only has to lock and unlock the database file once. If you run them outside of a transaction the db is locked and unlocked 10

Re: [sqlite] Transactions for SELECT

2011-11-22 Thread Dan Kennedy
, of any type, in an explicit transaction. On Tue, Nov 22, 2011 at 11:41 AM, Dan Kennedy<danielk1...@gmail.com> wrote: On 11/22/2011 04:34 PM, Baruch Burstein wrote: Do transactions speed up SELECT statements? They can a bit. If you put 10 SELECT statements in a transaction SQLite on

Re: [sqlite] Convert data to binary

2011-11-25 Thread Dan Kennedy
On 11/26/2011 05:02 AM, Nico Williams wrote: You can CAST TEXT to BLOB, and you can use x'' for literal BLOBs. You can. The result of which is a blob that corresponds to either the utf-8 or utf-16 (big or little endian) encoding of the text, depending on the encoding used by the database file.

Re: [sqlite] mandatory locks versus advisory locks

2011-11-30 Thread Dan Kennedy
On 11/30/2011 06:55 AM, Andy Spencer wrote: I have seen documentation that SQLite uses POSIX advisory locks to implement locking on Unix. I have an issue in that attempts to operate on a sqlite database on a Linux file system that has setgid bit (set group ID on execution) set on the database

Re: [sqlite] Unexplained minor regression (bug) 3.7.8 up

2011-12-06 Thread Dan Kennedy
On 12/06/2011 03:28 PM, Max Vlasov wrote: Hi, Noticed a strange regression after 3.7.7 (in 3.7.8 and inherited in 3.7.9) I have a Russian morphology database and different queries working with it. I narrowed it to the following case and populated with a couple of English words (just to make

Re: [sqlite] Cache design using sqlite3...

2011-12-06 Thread Dan Kennedy
On 12/07/2011 01:35 AM, Alejandro Martínez wrote: I'm trying to use sqlite3 as a cache layer for queries on other database. Actually, replace an existing layer cache which is very adhoc and propietary (and that sucks), and i'd like to replace it with something peer reviewed / open source, etc

Re: [sqlite] Cache design using sqlite3...

2011-12-06 Thread Dan Kennedy
On 12/07/2011 12:25 PM, Dan Kennedy wrote: On 12/07/2011 01:35 AM, Alejandro Martínez wrote: I'm trying to use sqlite3 as a cache layer for queries on other database. Actually, replace an existing layer cache which is very adhoc and propietary (and that sucks), and i'd like to replace

Re: [sqlite] Error: disk I/O error while creating an index

2011-12-09 Thread Dan Kennedy
On 12/09/2011 04:02 PM, Tal Tabakman wrote: Hi Guys, I have an SQLITE database of 1.5 million rows in a single table each raw looks like: 149|25|439198507|-1|0|1|44954|24|17|31|9|9|-1|-1| now, from the sqlite command line interface I am creating an on a sincle integer column CREATE

Re: [sqlite] Error: disk I/O error while creating an index

2011-12-09 Thread Dan Kennedy
On 12/10/2011 06:01 AM, Tal Tabakman wrote: Hi, thanks for the reply. so, I don't have TMPDIR defined in my env. what is the behaviour of sqlite in such cases ? is there a default ? By default it will try /var/tmp, then /usr/tmp, then /tmp. SQLite creates temporary files there that it uses

Re: [sqlite] Fts */or. Inconsistencies

2011-12-12 Thread Dan Kennedy
On 12/13/2011 02:29 AM, Ephraim Stevens wrote: I'm using a custom tokenizer in each scenario (yes it works and the proof is enclosed). In the first dataset, the data was tokenized such that any alphanumeric character qualifies as part of a token. In the second dataset, the data was tokenized

Re: [sqlite] Collation with concatenation

2011-12-15 Thread Dan Kennedy
On 12/15/2011 11:59 PM, Jeff Matthews wrote: This is in the documentation: CREATE TABLE t1( x INTEGER PRIMARY KEY, a, /* collating sequence BINARY */ b COLLATE BINARY, /* collating sequence BINARY */ c COLLATE RTRIM, /* collating sequence RTRIM */

Re: [sqlite] what is the unit of SQLITE_STATUS_MEMORY_USED?

2011-12-16 Thread Dan Kennedy
On 12/17/2011 06:16 AM, smallboat wrote: Hi, I am using sqlite_status = sqlite3_status(SQLITE_STATUS_MEMORY_USED,,, resetFlag); to get the memory used by sqlite. What is the memory unit for pCurrent (the max sqlite memory used)? Is it in bytes, bit or something else? Bytes.

Re: [sqlite] library routine called out of sequence

2011-12-23 Thread Dan Kennedy
On 12/23/2011 09:06 PM, Sreekumar TP wrote: Hi, yes, I know. I have a multithreaded app. One db conection.I will try to reproduce the problem with a simple app. However, the difference between the working and non working case is that in the working case statements are prepared each time. In

[sqlite] Contentless FTS4 Tables

2015-05-23 Thread Dan Kennedy
gt; MATCH 'framework') ORDER BY ID;" > Gives me 9 results back - should be only 1 - > > What I am missing here? Are you able to make the database file available for download somewhere? Thanks, Dan.

[sqlite] Replace an open database

2015-05-28 Thread Dan Kennedy
of IO (and CPU) required should depend on the size of the new db only, not the existing db size. And it won't matter if the existing db is corrupt or not - as the backup API never actually examines the contents of the existing database. Dan > > 2) Implement my own VFS, such that old read

[sqlite] Replace an open database

2015-05-29 Thread Dan Kennedy
gt;> the size of the new db only, not the existing db size. And it won't >> matter if the existing db is corrupt or not - as the backup API never >> actually examines the contents of the existing database. >> >> Dan > Interesting idea. Could this also a solution to my problem des

[sqlite] Replace an open database

2015-05-29 Thread Dan Kennedy
On 05/29/2015 02:35 PM, Dominique Devienne wrote: > On Fri, May 29, 2015 at 8:48 AM, Dan Kennedy wrote: > >> On 05/29/2015 12:59 PM, Zaumseil Ren? wrote: >> >>> On 05/27/2015 11:59 PM, Wade, William wrote: >>> >>>> But instead of using a regular

[sqlite] Replace an open database

2015-05-29 Thread Dan Kennedy
On 05/29/2015 03:27 PM, Zaumseil Ren? wrote: >> On Fri, May 29, 2015 at 8:48 AM, Dan Kennedy <[hidden >> email]<http://sqlite.1065341.n5.nabble.com/user/SendEmail.jtp?type=node=82464=0>> >> wrote: >> >>> On 05/29/2015 12:59 PM, Zaumseil Ren? wrote: &

[sqlite] FTS5 explicitly set delimiter

2015-11-01 Thread Dan Kennedy
s://www.sqlite.org/fts5.html#section_4_3_1 Dan.

[sqlite] FTS5 explicitly set delimiter

2015-11-02 Thread Dan Kennedy
haracters such > as tokenchars '!@#$%' and so on. I think you'll have to do the above, yes. Dan.

[sqlite] FTS5 External Content Table - REPLACE - SQL logic error or missing database

2015-11-06 Thread Dan Kennedy
download the SQLite trunk, either via fossil or via a link like: http://www.sqlite.org/src/tarball/SQLite-trunk.tgz?uuid=trunk Then run [./configure && make amalgamation-tarball] to build an autoconf package. Regards, Dan. > > ___

[sqlite] FTS5 rank configuration option

2015-11-06 Thread Dan Kennedy
ent database connections seem to use the standard default > ranking. Is this by design? Thanks for reporting this. Might be fixed here: http://sqlite.org/src/info/33e6606f5e497e81 Dan. > ___ > sqlite-users mailing list > sqlite-users at mailin

[sqlite] Database corruption using zipvfs on android 64 bits (x86_64)

2015-11-07 Thread Dan Kennedy
ill be worth running such a script under valgrind to search for uninitialized variable problems etc. I can't see any bugfixes in the changelog since 3.8.8 to do with corrupt databases, but it might be worth upgrading to the latest zipvfs and sqlite to check if the problem is still present anyway. Regards, Dan.

[sqlite] Another unexpected source of SQLITE_BUSY_SNAPSHOT

2015-11-11 Thread Dan Kennedy
On 11/11/2015 01:19 AM, Florian Weimer wrote: > * Dan Kennedy: > >> On 10/18/2015 10:27 PM, Florian Weimer wrote: >>> My first surprise was SQLITE_BUSY_SNAPSHOT from BEGIN IMMEDIATE (see >>> ?SQLITE_BUSY_SNAPSHOT from BEGIN IMMEDIATE?). I have found another >&g

[sqlite] Delta Compression in RBU

2015-11-13 Thread Dan Kennedy
creation and application code checked in to the sqlite source project are public domain. The original authors of the code re-licensed it. Dan.

[sqlite] SQLITE vs. OSX mmap == inevitable catalog corruption?

2015-11-18 Thread Dan Kennedy
yesterday, SQLite uses a read-only mapping in mmap mode. The db file is written using plain old write(), just as in non-mmap mode: http://sqlite.org/src/info/67c5d3c646c8198c It would be interesting to know if this clears the problem in your environment. Dan.

[sqlite] FTS5 prefix index documentation may be incorrect

2015-11-25 Thread Dan Kennedy
/src/info/11eb8e877e2ba859 Dan. > > Examples: > > sqlite> CREATE VIRTUAL TABLE ft USING fts5(a, b, prefix='2 3'); > Error: malformed prefix=... directive > sqlite> CREATE VIRTUAL TABLE ft USING fts5(a, b, prefix=2, prefix=3); > Error: multiple prefix=... directives > >

[sqlite] sqlite3_errmsg and wide char

2015-11-27 Thread Dan Kennedy
On 11/27/2015 12:13 PM, Igor Korot wrote: > Hi, > Is there any way to have "sqlite3_errmsg" function return a wide char string? > Or do a conversion in a portable way? Will sqlite3_errmsg16() work for you? https://www.sqlite.org/c3ref/errcode.html Dan.

[sqlite] SQLite slows by a factor of 1000 after foreign key violation

2015-10-02 Thread Dan Kennedy
disk for every seek, not just finding the data in the OS cache)? Thanks, Dan.

[sqlite] (no subject)

2015-10-03 Thread Dan Kennedy
nkeys.html#fk_indexes If you're unsure, open your database using the command line tool and dump the schema using the ".schema" command. Post that here and someone should be able to tell you if you're missing an index or not. Dan.

[sqlite] incorrect R-tree documentation

2015-10-03 Thread Dan Kennedy
his is not actually true: > >> create virtual table t using rtree(id, x1, x2); >> insert into t values(null, null, null); >> insert into t values('xxx', 'xxx', x'1234'); >> select * from t; > 1|0.0|0.0 > 0|0.0|0.0 Thanks for pointing this out. Docs now updated here: http://sqlite.org/docsrc/info/56eab0136ce41732 Dan.

[sqlite] sqlite-users Digest, Vol 94, Issue 4

2015-10-06 Thread Dan Kennedy
gt; REFERENCES "relation_employee" ("id") > ON DELETE CASCADE, >CONSTRAINT "value_fk" > FOREIGN KEY ("value") > REFERENCES "relation_project" ("name") > DEFERRABLE INITIALLY DEFERRED); > CREATE INDEX "relation_employee_projects_object_id_i" >ON "relation_employee_projects" ("object_id"); I think you need indexes on the child key columns that don't already have them. i.e. CREATE INDEX relation_employee_projects_value_i ON relation_employee_projects_value(value); CREATE INDEX relation_employee_employer_i ON relation_employee(employer); Dan.

[sqlite] Problem with sqlite3_db_filename

2015-10-08 Thread Dan Kennedy
(Windows 7) via a std_call dll as I am working > in VBA here. > > Any suggestions what could be the problem? > > I am running 3.8.11.1 > The program below works here. I'm seeing full paths for databases "main" and "aux", and a zero-len

[sqlite] compiling sqlite3 with FTS5 support

2015-10-09 Thread Dan Kennedy
in the overview section, the text says: > The expression to the right of the MATCH operator must be the nameof the FTS5 > table. The expression on the left must be a text value specifyingthe term to > search for.I think the right and left's are backwards. Thanks for these. Now fixed. Dan.

[sqlite] fts5aux?

2015-10-16 Thread Dan Kennedy
re FTS index for every query. To create the table: CREATE VIRTUAL TABLE vvv USING fts5vocab(, ); where may be either "row" or "column". Code is here: http://www.sqlite.org/src/artifact/85ebf2e93089c Dan.

[sqlite] some thing wrong under android.

2015-10-16 Thread Dan Kennedy
ug this error, and find the rules are: > 1).when i delete that statement, it work nice: > "create unique index if not exists fragment_index on fragment(user_id asc, > type asc);" > > > 2).when i delete these statements, it work nice too. > "b

[sqlite] Compilation fails under Linux (Ubuntu) when FTS5 is enabled

2015-10-17 Thread Dan Kennedy
lm" to the command line. Was this using one of the configure scripts? Or a hand-made makefile? Dan. > > Any ideas? > Thanks. > ___ > sqlite-users mailing list > sqlite-users at mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Compilation fails under Linux (Ubuntu) when FTS5 is enabled

2015-10-18 Thread Dan Kennedy
_ENABLE_FTS5 to command > line. > > (Adding the -lm switch did not help.) That's quite surprising. Please post the full command line and the resulting output. Thanks, Dan. > > -Original Message- From: Dan Kennedy > Sent: Saturday, October 17, 2015 4:35 PM > To: sqlite

[sqlite] Another unexpected source of SQLITE_BUSY_SNAPSHOT

2015-10-19 Thread Dan Kennedy
the prepare() call actually needed to read the database), but if you do: sqlite3_prepare(SELECT); sqlite3_prepare(UPDATE); BEGIN; sqlite3_step(); then I don't think you can get an SQLITE_BUSY_SNAPSHOT error. Dan.

[sqlite] FTS5 External Content Table - REPLACE - SQL logic error or missing database

2015-10-28 Thread Dan Kennedy
or external content tables. Fts5 is now updated on trunk so that OR REPLACE is ignored for contentless and external content tables: http://sqlite.org/src/info/a85c2a4758c27e8d So this sort of thing should work again. Dan.

[sqlite] SQLite3 trunk error with old database with fts3/4

2015-09-04 Thread Dan Kennedy
see error below: > > free(): corrupted unsorted chunks: 0x7fa3a01073a0 Is this error on the trunk or with the old version? If it's on the trunk, is the error reproducible using the sqlite3 shell tool? If not, what does valgrind have to say about the app? Thanks, Dan.

[sqlite] SQLite3 trunk error with old database with fts3/4

2015-09-04 Thread Dan Kennedy
sqlite3_finalize (pStmt=0x7fffe408ac88) > at sqlite3.c:70500 It's tricky to interpret this. It seems likely that the pDef pointer in the last frame might be incorrect - or that might just be an artifact of optimization. Thanks, Dan.

[sqlite] SQLite3 trunk error with old database with fts3/4

2015-09-04 Thread Dan Kennedy
tter is not to leak statement handle pointers. The sqlite3_next_stmt() API should really only be used to help track down leaks, not to do cleanup. Dan. > >> Fri Sep 04 2015 4:18:01 pm CEST CEST from "Domingo Alvarez Duarte" >> Subject: Re: [sql

[sqlite] SQLite3 trunk error with old database with fts3/4

2015-09-04 Thread Dan Kennedy
eased on a long running process > to certify that everything is fine. The trouble with sqlite3_close_v2() is that after you call it you can't safely pass the db handle to sqlite3_next_stmt() - the data structure may have already been freed. Dan. > > Thanks a lot for your help ! > > &

[sqlite] Potential bug: Database on gvfs mount cannot be committed to

2015-09-06 Thread Dan Kennedy
t; >https://www.sqlite.org/faq.html#q5 > > Or if you want to be pedantic, it is gvfs and networked filesystems > that have the bug. The other problem is that it's 2.8.17. I think the most recent bugfix on the 2.* line was in 2007. 2.8.17 was the last release, and that was in December 2005. Dan.

[sqlite] FTS: Escaping MATCH expressions

2015-09-09 Thread Dan Kennedy
is no way to escape embedded double quotes. In FTS5 you can enclose tokens in double quotes and escape embeded quote characters in the usual SQL way (by doubling them). i.e. ... MATCH '"TEST.*"' Or for {TEST"*}: ... MATCH '"TEST""*"' Dan. >

[sqlite] SQLITE_READONLY_ROLLBACK due to expected race?

2015-09-11 Thread Dan Kennedy
nect, stop it here using the debugger: http://www.sqlite.org/src/artifact/4784012f80b21?ln=4875 delete the journal file and then let the process continue, you do indeed get an SQLITE_READONLY_ROLLBACK error. Dan. > > Thanks! > Matthew > > ___

[sqlite] How stable is FTS5 considered?

2015-09-14 Thread Dan Kennedy
I is described here: http://sqlite.org/draft/fts5.html#section_7_1 For example code, see the built-in tokenizers: http://www.sqlite.org/src/artifact/f380f46f341af9c9 Dan.

[sqlite] FTS5 documentation typo

2015-09-14 Thread Dan Kennedy
eword or string literal. See the 4th paragraph here: https://www.sqlite.org/fts5.html#section_4 Dan.

[sqlite] FTS5 stopwords

2015-09-14 Thread Dan Kennedy
o? The example matchinfo() code contains code to determine the longest common subsequence here: http://www.sqlite.org/src/artifact/e96be827aa8f5?ln=259-281 Feedback from anyone who actually tries to use this API much appreciated. Dan. > > I come from using an engine called Sphinx S

[sqlite] FTS5 stopwords

2015-09-14 Thread Dan Kennedy
o the built-in porter tokenizer perhaps. If we had code for a stop-words implementation that seemed like it would work for everybody and any licensing issues could be worked out then there's no reason something like that couldn't be made part of FTS5. Dan.

[sqlite] FTS5 returns "corrupt" plus trailing zero

2015-09-29 Thread Dan Kennedy
src/artifact/4fdbc0a321e3a1d7?ln=5364 > > should be corrected to > > sqlite3Fts5BufferSet(, , 7, (const u8*)"corrupt"); > > so that the number of characters passed matches the length of "corrupt". Finally noticed this. Thanks. http://www.sqlite.org/src/info/3a9f076250d9559d Dan.

[sqlite] FTS5 problem ? more than 3,000 queries !

2016-04-04 Thread Dan Kennedy
nd obtaining this requires a separate query on the %_sz table for each row. So if the MATCH expression matches 3000 rows, FTS5 makes 3000 SQL queries to obtain the size data. Dan. > > Cheers ! > > > > CREATE TABLE "items" ( > 'id' integer PRIMARY KEY, >

[sqlite] FTS5 query that to match all rows.

2016-04-14 Thread Dan Kennedy
On 04/13/2016 11:24 PM, John Found wrote: > What FTS5 query should I use in order to match all rows in the table? > Can you use "SELECT * FROM fts_table;"? Dan.

[sqlite] Is it possible that dropping a big table takes very long

2016-04-18 Thread Dan Kennedy
> ) > ); > Are there any other tables in the db with foreign keys that refer to the table being dropped? If so, try with foreign keys disabled: PRAGMA foreign_keys = 0; Dan.

[sqlite] Field FOREIGN KEY when it is a pointer

2016-04-21 Thread Dan Kennedy
to check that only valid values are inserted into the table though (and the corresponding trigger for updates, and for updates and deletes on the referenced table). Dan. > ? > > -- > Cecil Westerhof > ___ > sqlite-users mailing list > sqlite-users at mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

<    1   2   3   4   5   6   7   8   9   10   >