Re: [sqlite] Creating a 'SQL text' Backup of a SQlite database with the mere sqlite.dll tool (and a Python 3)

2014-06-01 Thread big stone
Hi Domingo, You were right ! There is indeed an iterdump function in sqlite3 module, that I didn't notice. Many thanks, I just needed to : - wrap it around "PRAGMA foreign_keys = OFF;" and "PRAGMA foreign_keys = ON;" - then understand the "transaction" strange default settings of SQlite3. For p

Re: [sqlite] Creating a 'SQL text' Backup of a SQlite database with the mere sqlite.dll tool (and a Python 3)

2014-06-01 Thread big stone
Hi Roger, No doubt that ASPW is much much better than SQLite3 standard library module. Unfortunately, many People won't install ASPW because : - Python "out of the box" SQLite experience has been complex for them (newcomers in Python), - no small utility was there to keep their SQLite interest an

Re: [sqlite] Creating a 'SQL text' Backup of a SQlite database with the mere sqlite.dll tool (and a Python 3)

2014-06-16 Thread big stone
Hi Roger, Why is APSW not findable on the Pypi infrastructure ? It should be the place where a newcomer would look for it. I just published my work as "sqlite_bro" (pip install sqlite_bro), and it doesn't seem to be too complex. (just one full day lost to figure it out, in my case) Regards

Re: [sqlite] detect database/table/field use

2014-06-27 Thread big stone
Hi Roger, I notice some of your examples are written in Python2-only syntax. Would it be possible to make their syntax more Python2/3 compatible, at least for the print function ? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8

Re: [sqlite] Autocommit in "with" query: bug or feature?

2014-07-06 Thread big stone
Hi Jean-Luc, All your problem is that you must use conn.isolation_level = None With conn.isolation_level = "" , the default of sqlite3, nothing related with transaction will work. Just try with : * this program : https://github.com/stonebig/sqlite_bro/blob/master/sqlite_bro.py (or pip install sq

Re: [sqlite] Autocommit in "with" query: bug or feature?

2014-07-06 Thread big stone
Hi again, To answer the question in the title : - yes, the "autocommit" bug is buggy with "with", http://bugs.python.org/issue21718 - it is also buggy with comments at the beginning of the 'select'. The "autocommit" feature was a false good idea, but as sqlite3 arrived like that in the standard

Re: [sqlite] Autocommit in "with" query: bug or feature?

2014-07-07 Thread big stone
Curiousity question : Why are you basing your SQLfast next book on Python 2.7.6 rather than Python 3.3 (or 3.4) ? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite version 3.8.6 coming soon

2014-08-06 Thread big stone
Hello Sqlite team, My specific need relies on a rather complex combination of "in", and with the new beta I go from 50 seconds down to 10 seconds. (a 5x improvement) ==> Is that sort of gain possible with the recent "in" omtimisation, or shall look deeper if result is still right ? Regards,

Re: [sqlite] In-memory DB slower than disk-based?

2014-08-06 Thread big stone
Hi, I too noticed disappointing improvements by going ":memory:". But, it seems also very dependent of the compilation options and the version of SQLite you use. sometimes, gain is roughly 0% sometimes, gain can be 40%. ==> You may try with a more recent version of SQLite than 3.7.15.2. https:

Re: [sqlite] SQLite version 3.8.6 coming soon

2014-08-06 Thread big stone
ok, output comparison Size is different : - before28 488 559 - now with beta 28 711 111 ==> delta = 222 552 ... which is my number of ouput lines The change in Newline Output policy (from CR to CR+LF) did generate a suspens. WinMerge says output is identical otherwise. So my 5x im

Re: [sqlite] SQLite version 3.8.6 coming soon

2014-08-08 Thread big stone
hi Jose, The SQL request with a "in()" that is improved by 5x in the latest beta is of form : select * from a , b where a.field1 in (b.column1, b.column2, b.column3, b.column4, 'fixed value') ___ sqlite-users mailing list sqlite-users@sqlite.org http

Re: [sqlite] SQLite 3.8.6 beta

2014-08-09 Thread big stone
hello, Maybe i did a wrong manipulation. Using latest beta dll on windows / python3.3, I get this strange error : import sqlite3 as sqlite File "C:\Users\famille\Documents\winpython\WinPython-32bit-3.3.5.0\python-3.3.5\lib\sqlite3\__init__.py", line 23, in from sqlite3.dbapi2 import *

Re: [sqlite] SQLite 3.8.6 beta

2014-08-09 Thread big stone
complementary information : - compiling manually sqlite.dll , I have no issue, - so the problem, if problem, is the official Sqlite.dll downloadble from sqlite.org. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailm

Re: [sqlite] Window functions?

2014-08-25 Thread big stone
Hi, For one of the few wishing it : - I can understand when Richard writes it's very complex to implement "in full", as I can imagine tricky requests with it, - but would a basic subset, like the one described here in March '14 ( http://sqlite.org:8080/cgi-bin/mailman/private/sqlite-users/2014-M

Re: [sqlite] Window functions?

2014-08-25 Thread big stone
Hi Stephan, "lite," is not a mathematic definition, and is increasing over time. (at least 5% per year in Sqlite code size, by 30% in smartphone capabilities ) ==> What was "heavy" in 2003 will become "lite" one day. ___ sqlite-users mailing list sqlite

[sqlite] Curiosity question for an apparent change in Sqlite/timeline pattern

2014-08-26 Thread big stone
Hello, It seems to me that, all of a sudden, a LOT of micro-wins and bigger wins are raining on the Sqlite/timeline (since about august 1rst, the "in ()" improvement) Is it an effect of a new Compiling/Testing environnement ? of summer vaccation ? of partner's help ? (maybe I'm wrong and all is

Re: [sqlite] Curiosity question for an apparent change in Sqlite/timeline pattern

2014-08-27 Thread big stone
Thank you Richard for this informative answer, I was quite impressed by the recent "in ()" improvement, so it probably created a reality distortion field on my perception. Regards, ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org

[sqlite] papercut wish list : a PRAGMA encoding='UTF-8-SIG'

2014-09-03 Thread big stone
Hello, As a windows user, I would like that sqlite.exe would support the encoding 'UTF-8-SIG' for files. 'UTF-8-SIG' = normal 'UTF-8' file, but starting by a Byte-Order-Mark. (see http://en.wikipedia.org/wiki/Byte_order_mark#UTF-8) For windows user, it would be a truly appreciated improvement.

Re: [sqlite] papercut wish list : a PRAGMA encoding='UTF-8-SIG'

2014-09-03 Thread big stone
... unless I'm fooled by the sqlite.exe dos output and it's working already as I hope. (Oups) ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] 50% faster than 3.7.17

2014-09-22 Thread big stone
Hi, This 3.8.7alpha release seems to bring about 5% win from 3.8.6 , on my particular SQL test case. Question : "PRAGMA threads=2" didn't bring any speed-up on my "2 true" cores machine. Did I miss a compilation option ? ___ sqlite-users mailing list

Re: [sqlite] 50% faster than 3.7.17

2014-09-22 Thread big stone
ok, Nearly all the time is spent in a big 'CTE' select. So maybe this sort of ugly CTE query is not threadable. with f0_k as (SELECT f.rowid as nof2, f.*, p.Dn, p.g1, p.g2, p.w, p.other FROM F0 AS f, Pt AS p WHERE f.Io =p.Io) ,F0_mcalc as (SELECT f.*, p.*, (case when Priority=999 then Cg e

Re: [sqlite] Stored Procedures

2014-10-09 Thread big stone
Hi, Here is an example of stored procedure made in Python for SQLite. https://pypi.python.org/pypi/sqlite_bro/0.8.7.4 I Hope it will help you figure out quickly if SQLite is ok enough for your use-case. Sheers, ___ sqlite-users mailing list sqlite-us

[sqlite] Whish List for 2015

2014-12-21 Thread big stone
Hi all, To prepare for end of 2014 greetings moment, here is my whish list for 2015: - a minimal subset of analytic functions [1], that I hope may help end-user/students popularity [2] - better information on what is coming ahead, for example: . I see the 'sessions' tree moving along main tree

[sqlite] equivalent for JOIN LATERAL

2015-02-08 Thread Big Stone
Hello, I fall over this presentation of LATERAL, from postgresql guys. (look at pages 1 to 16) Does it exist in SQLITE ? If not, would it be possible too much effort ? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin

Re: [sqlite] equivalent for JOIN LATERAL

2015-02-08 Thread Big Stone
If not, would it be possible "without" too much effort ? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] equivalent for JOIN LATERAL

2015-02-08 Thread Big Stone
oups ! Thank you Roger, I had forgot to post the link. I got it via a tweet of Wes McKinney, one of the DataScience leader in the Python World. https://twitter.com/wesmckinn/status/564526251591733248 ___ sqlite-users mailing list sqlite-users@sqlite.org

[sqlite] whish list for 2016

2015-12-20 Thread Big Stone
Hi All, To prepare for 2016 greetings moment, here is my personnal whish list for sqlite: - analytic functions (would fit the split/apply/combine data-science landscape), - "generate_series" extension included in default sqlite.exe and sqlite.dll for windows. Best whishes for 2016!

[sqlite] sqlite 3.8.11.0 will be in next Windows release of Python3.4 / 3.5

2015-07-31 Thread Big Stone
Hi all, Just a link to this commit: http://bugs.python.org/msg247538 Regards,

<    1   2