Re: [sqlite] [EXTERNAL] Lazy virtual table creation

2018-03-22 Thread Philippe Riand
Thanks for your responses. Actually, it is up to my code to find out if the table exists or not. But you also raised a good point, as it can disappear, so what I’m looking for is more something like: “this statement uses this set set of tables [x,y,z…], please prepare your environment

[sqlite] Lazy virtual table creation

2018-03-17 Thread Philippe Riand
We are using virtual tables to provide an SQL access to our data set and this works very well. But we have potentially "a lot” of virtual tables, with some even yet unknown when we start the DB. We’d like to create them lazily, on first access. Is there a hook we can use so when an SQL

[sqlite] Multithreaded SQLite

2016-03-09 Thread Philippe Riand
Yes, I?m using prepare(), step and finalize(). The 2 threads should actually have no interaction between them, but isolated. I mean the 2 threads should be able to do very different things (read data, write data?), within separated transactions.

[sqlite] Multithreaded SQLite

2016-03-09 Thread Philippe Riand
On the OS standpoint, we are using multiple ones: Android, iOS and desktop (Windows, OSX and Linux). So we need to figure a solution that works with all these OSes. when I used the WAL mode, I got a schema locked, while in DELETE mode i got database locked. >>>If WAL is supported, then you can

[sqlite] Multithreaded SQLite

2016-03-09 Thread Philippe Riand
I?m a bit lost with the multi-threaded concurrent access errors I?m getting, and looking for an advise on the best solution. Basically, I have a desktop/mobile app (single user) that embeds a tiny local http server. The UI is done through an embedded browser, calling the server for pages and

[sqlite] Performance issue with CTE

2015-10-05 Thread Philippe Riand
Just to let you know, the solution using SELECT * FROM (query with offset/limit) works perfectly well. Thanks a lot for the suggestion!

[sqlite] Performance issue with CTE

2015-10-02 Thread Philippe Riand
I think the doc is right. I overcame the problem by using a construct like: SELECT field1, field2? WHERE PKEY IN (SELECT PKEY ? WHERE OFFSET n LIMIT m) That executes a sub query. But your solution looks actually better, as it is: SELECT * FROM (SELECT field1, field2? WHERE OFFSET n LIMIT m)

[sqlite] Performance issue with CTE

2015-10-02 Thread Philippe Riand
Thanks. I know about the technique your mentioned, but the point is not about the use of offset or not. The same issue will happen but using a key. See my other reply above.

[sqlite] Performance issue with CTE

2015-09-30 Thread Philippe Riand
I have a table with 500,000+ records. The table has a date column, that I?m using to sort my queries (the columns has an index). Simple queries on the table work very well, using ORDER BY, LIMIT & OFFSET. I?m actually extracting ?pages? of rows that I?m displaying in a web page. Great!. Now,

Re: [sqlite] Whish List for 2015

2015-01-02 Thread Philippe Riand
We’ll probably look at providing a set of functions for handling JSON in SQLite, similarly to what POSTGRESQL is doing. But, to make it efficient, we need to index the JSON content. I suggested earlier this year to get expression based indexes, so one can index the result of a function like

[sqlite] strchrnul compilation error

2014-10-22 Thread Philippe Riand
Related to this issue, http://www.sqlite.org/src/info/0fac2c045f47c7735af4eb68ced81d8b43622a1f, sqlite 3.8.7 fails to compile on Android by default, plus there is a suspicious warning. The compiled code is the amalgamation: jni/sqlite/sqlite3.c: In function 'sqlite3VXPrintf':

[sqlite] Index on expressions

2014-10-22 Thread Philippe Riand
Hello, If there any plan to get this in? (see: http://sqlite.org:8080/cgi-bin/mailman/private/sqlite-users/2014-September/055065.html ) Note that this seems implemented by several databases now, and this is a bit different from virtual columns, which is what the previous discussion ended with.

[sqlite] Index on expressions

2014-09-03 Thread Philippe Riand
Is there a way to create indexes based on expressions instead of simple columns (see: http://www.postgresql.org/docs/8.1/static/indexes-expressional.html)? The idea is to have some custom functions that extract data from a JSON column and allow a fast query based on an index. This is the strategy

[sqlite] SQLite & Android: unable to open database file - error 14

2014-02-10 Thread Philippe Riand
I posted the question on StackOverflow: http://stackoverflow.com/questions/21661814/sqlite-android-unable-to-open-database-file-error-14 Any help would be greatly appreciated! I saw that a similar issue has been reported many times. In my case, I'm directly using the "C" API invoked using my own