Re: [sqlite] New word to replace "serverless"

2020-01-28 Thread Jan Danielsson
ess Also take into consideration, to quote Warren Young: ``Keep using the term. We were here first.'' -- Kind Regards, Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sql

Re: [sqlite] Regarding the whole C89/C90 language compliance debacle ...

2019-11-23 Thread Jan Nijtmans
quot; or "long long" dependant on Tcl version or platform. So, the warning is harmless, understandable, and easy to fix. Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] Bug: Infite loop on SELECT with .explain on

2019-10-26 Thread Jan Schlien
0x080eb033 in ?? () #12 0x080eccc9 in ?? () #13 0x080ed698 in ?? () #14 0x080f5e8f in ?? () #15 0x0804f03a in ?? () #16 0xf7d92637 in __libc_start_main () from /lib/i386-linux-gnu/libc.so.6 #17 0x0804f139 in ?? () Regards, -Jan ___ sqlite-users mailing list sqli

Re: [sqlite] Segfault when using FILTER (WHERE) referencing aliases from a subquery

2019-10-10 Thread Jan Nijtmans
Op do 10 okt. 2019 om 15:15 schreef Jan Nijtmans: > > Op do 10 okt. 2019 om 15:06 schreef Jose Isaias Cabrera: > > > Simon Charette, on Tuesday, October 8, 2019 08:00 PM, wrote... > > > > > > > > While trying to enable support for FILTER (WHERE) on SQ

Re: [sqlite] Segfault when using FILTER (WHERE) referencing aliases from a subquery

2019-10-10 Thread Jan Nijtmans
to reopen on a persistent database. sqlite> CREATE TABLE item (id int, price int); sqlite> INSERT INTO item (id, price) VALUES (1, 1); sqlite> SELECT COUNT(id) FILTER (WHERE double_price > 42) FROM (SELECT id, (price * 2) as double_price FROM item); Segmentation fault (c

Re: [sqlite] Bug report: Data race in pcache1.c

2019-02-25 Thread Jan Krčál
Hi Richard, thanks a million for your check-in! It indeed fixed our issues with TSan! Best regards, Jan On Wed, Jan 9, 2019 at 3:55 PM Richard Hipp wrote: > Check-in https://www.sqlite.org/src/info/383437be276719ac will perhaps > silence the harmless false-positives reported by TSAN.

[sqlite] Bug report: Data race in pcache1.c

2019-01-09 Thread Jan Krčál
ou please look into this or should I provide a patch? Best regards, Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Regarding CoC

2018-10-24 Thread Jan Danielsson
a lot of people aren't reading the first part of the document. And again, English is a good choice to reach as many as possible. -- Kind Regards, Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Prebuilt Windows x86 binary missing symbols per sqlite3.def

2017-06-04 Thread Jan Nijtmans
h-for-Windows-x86-and-x64-dll-td93694.html> Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Win 10 Anniv. Ed. lifts the MAX_PATH 260 limitation

2017-03-30 Thread Jan Nijtmans
rested, just let me know, I'm happy to provide this patch to the SQLite developers, or anyone else interested. Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mail

[sqlite] reset after failed step

2017-03-17 Thread Jan Danielsson
state is reset implicitly by sqlite3_step()? -- Kind regards, Jan Danielsson ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] bounded id

2017-03-15 Thread Jan Danielsson
is responsible for assigning other other identifiers; it would be nice not to break that abstraction if possible. -- Kind regards, Jan Danielsson ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman

Re: [sqlite] SQLITE_ENABLE_UPDATE_DELETE_LIMIT (Was: Patch Etiquette)

2017-02-08 Thread Jan Nijtmans
. Thank you for your idea! Regards, Jan nijtmans Index: src/parse.y == --- src/parse.y +++ src/parse.y @@ -748,10 +748,11 @@ %ifndef SQLITE_ENABLE_UPDATE_DELETE_LIMIT cmd ::= with(C) DELETE FROM fullname(X) indexed_opt(I) where_opt(W

Re: [sqlite] Patch Etiquette

2017-02-06 Thread Jan Nijtmans
ll thread here: <http://sqlite.1065341.n5.nabble.com/ENABLE-UPDATE-DELETE-LIMIT-td90381.html> Feel free to try this patch (see my message Jul 12, 2016; 11:14am in this thread) Regards, Jan Nijtmans ___ sqlite-users mailing li

Re: [sqlite] sqlite3.def mismatch for Windows x86 and x64 dll

2017-02-05 Thread Jan Nijtmans
ected to be used from applications, so whether those are exported or not doesn't really matter. Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] can't open db when path length extends 512 characters (on linux)

2017-01-31 Thread Jan Nijtmans
6. So I don't think the risk is really big. Upgrading to 1024 (or even 4096) should be no problem. See also: <https://www.sqlite.org/pragma.html#pragma_page_size> Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.s

[sqlite] tclsqlite 64-bit bug [Was: extension to run bash]

2017-01-12 Thread Jan Nijtmans
4-bit. Any chance for this to be in the next SQLite release? Thanks! Jan Nijtmans === $ fossil diff Index: src/tclsqlite.c == --- src/tclsqlite.c +++ src/tclsqlite.c @@ -2534,11 +2534,11 @@ for(

Re: [sqlite] BUG: crash in fts5MultiIterNext()

2016-11-13 Thread Jan Berkel
> > Got a crash in the FTS5 code which only happens on a specific search > > query (int the form of: "ab cd" OR "ab cd" *) > > The crash occurs In fts5MultiIterNext(), on the following line: > > > > pSeg->xNext(p, pSeg, ); > > > > Debugger shows that pSeg is set, but xNext is null. > > > >

[sqlite] BUG: crash in fts5MultiIterNext()

2016-11-12 Thread Jan Berkel
s which match the query. This is with 3.15.1. Jan [excerpt from stack trace] * frame #1: 0x0001110c4e6d sqlite3`fts5MultiIterNext(p=0x608000303cc0, pIter=0x7fa892722500, bFrom=1, iFrom=43) + 157 at sqlite3.c:189370 frame #2: 0x0001110cb07a sqlite3`

Re: [sqlite] Merging FTS indexes

2016-11-12 Thread Jan Berkel
the merging step available. I'll do the separate queries implementation first and see how it performs (the queries could be run in parallel, so it shouldn't be too bad). Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sql

[sqlite] Merging FTS indexes

2016-11-08 Thread Jan Berkel
expect to be reasonably fast. On the downside it would certainly require some custom code to perform the merge operation. Before diving into the implementation I'd like to sanity check this idea here first, maybe somebody has had similar problem. Thanks, Jan

Re: [sqlite] FTS4/5 ranking function differences

2016-08-11 Thread Jan Berkel
rase, int iTerm) But actually I think for now I might be able to do this sort of ranking without knowing the exact query term, just by simply scoring results based on their length. – Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.or

Re: [sqlite] FTS4/5 ranking function differences

2016-08-11 Thread Jan Berkel
tion I have is how to access the user query expression from within the ranking function. Don't think this is exposed anywhere. (Looking at the source I noticed Fts5Expr *, but it is private). The best option would then be to pass it through to the ranking func

[sqlite] FTS4/5 ranking function differences

2016-08-09 Thread Jan Berkel
e previous FTS4 example. What would be the best way to pass the data to the function, in order to achieve similar results? As far as I can tell the function does not have access to the "outer" data. Thanks, Jan ___ sqlite-users maili

Re: [sqlite] The upcoming "pi" release of SQLite

2016-07-23 Thread Jan Berkel
described by Dan works but it's very awkward for the build setup, I'd rather have all the SQLite code in one file instead of having to generate and compile the FTS5 extension separately. – Jan ___ sqlite-users mailing list sqlite-users

Re: [sqlite] ENABLE_UPDATE_DELETE_LIMIT

2016-07-12 Thread Jan Nijtmans
unk. Regards, Jan Nijtmans Index: src/parse.y == --- src/parse.y +++ src/parse.y @@ -735,54 +735,56 @@ limit_opt(A) ::= LIMIT expr(X) COMMA expr(Y). {A.pOffset = X.pExpr; A.pLimit = Y.pE

Re: [sqlite] ENABLE_UPDATE_DELETE_LIMIT

2016-07-12 Thread Jan Nijtmans
this, I'm happy to provide that. Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] BUG: FTS5 query containing OR + order by rank

2016-05-29 Thread Jan Berkel
image is malformed sqlite> PRAGMA integrity_check; integrity_check --- ok Jan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] BUG: FTS5 query containing OR + order by rank

2016-05-28 Thread Jan Berkel
te> select rowid from foo where foo match 'test' order by rank; rowid 1 sqlite> select rowid from foo where foo match 'test OR foo' order by rank; Error: database disk image is malformed         Jan ___ sqlite-users mailing list sqlite-users@mailin

Re: [sqlite] Problem loading sqlite3.dll on Windows XP

2016-05-25 Thread Jan Nijtmans
shows no problem with > sqlite3.dll. > > Do you know if there are any issues regarding Windows XP? You could try this build, done with mingw-w64 (32-bit): https://sourceforge.net/projects/cyqlite/files/3.13/sqlite-dll-win32-x86-313.zip Microsoft's latest compilers have known issu

[sqlite] sqlite3_auto_extension + custom FTS5 tokenizer

2016-05-12 Thread Jan Berkel
r sqlite3AutoLoadExtensions() after all built-in extensions have been loaded? ? ?Jan ? ? ?

[sqlite] sqlite3_auto_extension + custom FTS5 tokenizer

2016-05-11 Thread Jan Berkel
*after* sqlite3AutoLoadExtensions(db). Therefore registering the tokenizer is not possible at this stage, since the fts5() function is not defined yet. Is there another way? I can?t use dynamic extensions so need to use sqlite3_auto_extension or something similar. thanks, ? ?Jan

[sqlite] Use of DELETE LIMIT OFFSET with ENABLE_UPDATE_DELETE_LIMIT

2015-12-21 Thread Jan Nijtmans
rces) run fine when this patch is applied. Could I add this to the 2016 wish-list?;-) Regards, Jan Nijtmans === --- src/parse.y +++ src/parse.y @@ -740,54 +740,56 @@ limit_opt(A) ::= LIMIT expr(X) COM

[sqlite] PRAGMA journal_mode and PRAGMA version compatibility

2015-11-23 Thread Jan Asselman
code 0 (== SLITE_OK). Preparing any pragma statement for a sqlite file created with v3.9.2 returns result code 0 (== SLITE_OK). Question: - Did the compatibility break for some of the PRAGMA statements between v3.8.6 and v3.9.2? Any help or information would be greatly appreciated. Thanks in advance, Jan Asselman

[sqlite] shell tool is no longer dynamically linked

2015-11-13 Thread Jan Nijtmans
igurable, that indeed would be best. Then it even doesn't matter to me what the default is. My guess is the more distributions (e.g. Fedora, Ubuntu ) will make (or have already made) the same modification, since it's much easier to apply a patch than change a distribution policy ;-) R

[sqlite] SQLite build dependency on tclsh

2015-10-27 Thread Jan Staněk
in these early stages. Would it be possible to bring back the awk-based build scripts? Best regards, Jan - -- Jan Stanek - Red Hat Associate Developer Engineer - Databases Team -BEGIN PGP SIGNATURE- Version: GnuPG v2 iEYEARECAAYFAlYvJKEACgkQXbaA6cD3QD0oegCdGaBI87ukVuc4K3KZMsxJm3gw

[sqlite] Version 3.9.0 source_id mismatch

2015-10-16 Thread Jan Nijtmans
likely, the dll was compiled by cherry-picking [01d3ee7bbe4feeb8] (containing a dll symbol fix) to the 3.9.0 version. Most likely, this merge was committed to a local fossil repository (which created the alternative source_id), but never pushed back to the official repository. That's the best answer I can give. Regards, Jan Nijtmans

[sqlite] Form-Feed (0x0C) is not a space character in JSON

2015-10-16 Thread Jan Nijtmans
feed or New line %x0D; Carriage return ) Suggested patch below. Regards, Jan Nijtmans $ fossil diff Index: ext/misc/json1.c == --- ext/misc/json1.c +++ ext/misc/json1.c @@ -50,11

[sqlite] [sqlite-announce] SQLite version 3.9.0

2015-10-14 Thread Jan Nijtmans
h it doesn't actually create a problem, as far as I can tell. Sorry for not noticing this before. Regards, Jan Nijtmans

[sqlite] Proposed new version numbering scheme for SQLite - Feedback requested

2015-10-09 Thread Jan Nijtmans
te 9x releases, at will. e.g.: 3.9.0 - okt 2015 3.9.1 - nov 2015 (performance improvement/bugfix only) 3.9.90 - dec 2015 (well-tested, new feature 1 added + bugfixes) 3.9.2 - jan 2016 (bugfixes only, without feature 1) 3.9.91 - feb 2016 (well-tested, new

[sqlite] json1.c: isalnum(), isspace(), and isdigit() usage

2015-09-17 Thread Jan Nijtmans
.sqlite.org/src/artifact/541004e47235cefc?ln=829 > Shouldn't json1.c avoid them for the same reasons? Simpler is: cast the argument to (unsigned char), that has the same effect (but is more efficient). Proposed patch below. Thanks! Regards,

[sqlite] Function lower on index expressions not allowed ?

2015-09-10 Thread Jan Nijtmans
te.org/c3ref/c_deterministic.html) Just wondering, why doesn't ICU mark "upper" and "lower" as SQLITE_DETERMINISTIC ? <http://www.sqlite.org/src/artifact/b2732aef0b076e42?ln=461-469+482-483> Regards, Jan Nijtmans

[sqlite] SQLite3 to 64-bit DLL

2015-08-27 Thread Jan Nijtmans
: Suitable for any gcc version (mingw/mingw-64/msys/msys-2) The dll is suitable for any 64-bit windows environment. Regards, Jan Nijtmans

[sqlite] SQLite crash

2015-08-11 Thread Jan Nijtmans
sqlite starts win32 threads, which don't work well in a cygwin environment. On cygwin you should configure posix threads. I have a fix for that, it's included in the cygwin SQLite package. With that you can use multiple threads as you wish. Regards, Jan Nijtmans

[sqlite] SQLite crash

2015-08-08 Thread Jan Nijtmans
ackage? In other words, is this a regression or a longstanding problem? Regards, Jan Nijtmans

[sqlite] Numerics bigger than 32-bit and sqlite as 64-bit TCL extension

2015-08-04 Thread Jan Nijtmans
SELECT * FROM test; } 2147483647 2147483649 2147483649 % @Andreas: could this be a compiler issue? Regards, Jan Nijtmans

[sqlite] System.Data.SQLite 1.0.97 on Win10

2015-07-24 Thread Jan Leimbach
b; connection.Open(); SQLiteCommand command = new SQLiteCommand(connection); command.CommandText = "UPDATE daten SET einrichtungs_kz = 'WL10022093' WHERE einrichtungs_kz LIKE '%20II%'"; command.ExecuteNonQuery(); connection.Close(); Can someone give me a hint? Thanks! Jan

[sqlite] SEGV in dbPrepareAndBind() in tclsqlite.c

2015-06-01 Thread Jan Nijtmans
the outcome, feel free to report this to the Itcl folks (which is not me ) Regards, Jan Nijtmans

[sqlite] Issue: Inconsistency of sqlite3_dbstat_register declaration

2015-05-11 Thread Jan Nijtmans
2015-05-11 16:33 GMT+02:00 Roger Binns : > On 05/11/2015 01:34 AM, Jan Nijtmans wrote: >> 2) If sqlite is not compiled with -DSQLITE_ENABLE_DBSTAT_VTAB=1, >> or the function is renamed (as it should) it wouldn't even work. > > That was my scenario. I just -DSQLITE_ENABLE_DBS

[sqlite] Bug: Cannot compile the new sqlite-src-3081001: preprocessor and testuite errors

2015-05-11 Thread Jan Nijtmans
2015-05-11 10:01 GMT+02:00 Jan Stan?k : > 2) When I "fix" the previous error, I'm getting assertion failure > during the test suite run. ... > shell1-5.0...testfixture: > /builddir/build/BUILD/tcl8.6.3/generic/tclIO.c:5815: DoReadChars: > Assertion `!((

[sqlite] Issue: Inconsistency of sqlite3_dbstat_register declaration

2015-05-11 Thread Jan Nijtmans
n't even work. The latter part is already fixed in the TEA version of SQLite. Suggested patch: <http://cyqlite.sourceforge.net/cgi-bin/sqlite/fdiff?v1=f2e740c1cc90060f=39dc9592b8f99cf9=1> Regards, Jan Nijtmans

[sqlite] Bug: Cannot compile the new sqlite-src-3081001: preprocessor and testuite errors

2015-05-11 Thread Jan Staněk
wing error: shell1-5.0...testfixture: /builddir/build/BUILD/tcl8.6.3/generic/tclIO.c:5815: DoReadChars: Assertion `!((statePtr)->flags & ((1<<9))) || ((statePtr)->flags & ((1<<10))) || Tcl_InputBuffered((Tcl_Cha nnel)chanPtr) == 0' failed. The testsuite error does not occur in t

[sqlite] Version 3.8.9 is in testing

2015-04-02 Thread Jan Nijtmans
lease log: <http://www.sqlite.org/src/info/6fc4e79a2350295a> Regards, Jan Nijtmans

[sqlite] full table scan ignores PK sort order?

2015-03-03 Thread Jan Asselman
something that suits the shape of your data better. -Urspr?ngliche Nachricht----- Von: Jan Asselman [mailto:jan.asselman at iba-benelux.com] Gesendet: Dienstag, 03. M?rz 2015 11:27 An: General Discussion of SQLite Database Betreff: Re: [sqlite] full table scan ignores PK sort order? Thank you! I t

[sqlite] full table scan ignores PK sort order?

2015-03-03 Thread Jan Asselman
Thanks for the detailed explanation. I understand that I should not make assumptions about SQL engine internals for typical database usage. I now also understand that by not using the ORDER BY clause, SQLite might one day decide to execute query plans that disrupt the order that I induce from

[sqlite] full table scan ignores PK sort order?

2015-03-03 Thread Jan Asselman
ehalf Of Igor Tandetnik Sent: maandag 2 maart 2015 22:52 To: sqlite-users at sqlite.org Subject: Re: [sqlite] full table scan ignores PK sort order? On 3/2/2015 4:48 AM, Jan Asselman wrote: > But when I step over the rows they are not returned in primary key sort > order. Why is this? Because y

[sqlite] full table scan ignores PK sort order?

2015-03-02 Thread Jan Asselman
perform a full table scan and store the result in a temporary table which is then sorted. I'd like to avoid the memory consumption produced by this query plan... Any help or information would be appreciated! Thanks in advance! Jan Asselman iba AG: Supervisory Board: Horst Anhaus, chairman; Ma

Re: [sqlite] Performance increase between 3.7 and 3.8

2015-02-03 Thread Jan Slodicka
Eduardo Morras-2 wrote > A ~8000MB db with app example data. More than 1000 query-corp created as > part of test driven development of the app. We have precalculated the > correct results in tables and its number of rows. No write, only read > queries and don't use other improvements like partial

Re: [sqlite] Performance increase between 3.7 and 3.8

2015-02-03 Thread Jan Slodicka
Eduardo Morras-2 wrote > I use a big test db to assure new versions of sqlite works properly. With > 3.7.15.2 it takes 43 minutes, with 3.8.8.2 on same hardware 27 minutes, > it's 16/0.43 = 37% less or 27/0.43 = 63% improve. Thanks, Eduardo. Could I ask you for a rough characterization of the

Re: [sqlite] Performance increase between 3.7 and 3.8

2015-02-03 Thread Jan Slodicka
Richard Hipp-3 wrote > From the description, your tests sound like you are pushing a bunch of > separate SQL statements into SQLite. In other words, the compute time > is likely dominated by the time need to parse the SQL and prepare > plans. Yes > Have you rerun the tests using prepared

[sqlite] Performance increase between 3.7 and 3.8

2015-02-02 Thread Jan Slodicka
I know the reports about huge performance increase achieved within the last year. (Compliments for that.) However, those numbers ignore processor architecture and I/O. My question is a different one. What speed difference do you perceive in real-world applications? I know that there can't be any

Re: [sqlite] sqlite3 fails due to too long path (MAX_PATHNAME)

2015-02-02 Thread Jan Nijtmans
.net/cgi-bin/sqlite/tarball/cyqlite.tar.gz?uuid=trunk Hopefully, one day you will find this change (or something equivalent) in the official SQLite. Jan Nijtmans ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mail

Re: [sqlite] Huge WAL log

2015-01-23 Thread Jan Slodicka
Thanks for the documentation update. >From my point of view I would invite more details related to the term "large transaction". Specifically the role of indexes is important. (They are often overlooked, added by an admin after the development is over etc.) > Defenses against this failure mode

Re: [sqlite] Compiling error on Cygwin on Windows 8.1: 3.8.7.4 and 3.8.8

2015-01-23 Thread Jan Nijtmans
that's indeed another possible 'solution' ;-) Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Huge WAL log

2015-01-21 Thread Jan Slodicka
Here is my final report. The problem was definitely in indexes. Simply the larger is the index table as compared to the page cache size, the faster growths the WAL log. My solution (all these measures were important): - Drop the index before the bulk insert, create it at the end. - Intermediate

Re: [sqlite] Compiling error on Cygwin on Windows 8.1: 3.8.7.4 and 3.8.8

2015-01-19 Thread Jan Nijtmans
here: <http://cyqlite.sourceforge.net/cgi-bin/sqlite/raw/generic/sqlite3.c?name=83a26f4777390dbcfcc58ba146354002ca2de0c8> An official cygwin build of SQLite 3.8.8 will be available soon. Regards, Jan Nijtmans ___ sqlite-users mailing lis

Re: [sqlite] Huge WAL log

2015-01-19 Thread Jan Slodicka
I'll add the results from the latest test that was running for the last 2 hours: This time I did not use intermediate commits. Instead, I dropped the table indexes before the bulk insert started and re-created them at the end. The results after a few tables (most of them small, a few contained

Re: [sqlite] Huge WAL log

2015-01-19 Thread Jan Slodicka
Dan Kennedy-4 wrote > Is it correct that you have a single transaction inserting lots of data > into a table with multiple indexes on it? Something like 1GB? Depends on. It is the best option from the application point of view. Other solutions introduce additional risks. Apparently, the answer

Re: [sqlite] Huge WAL log

2015-01-16 Thread Jan Slodicka
Simon Slavin-3 wrote >> Thanks to your post I discovered multiple-row inserts so that I now >> understand what you asked. > > Just a note that multiple-row inserts were added to SQLite relatively > recently (2012-03-20 (3.7.11)) and, because SQLite does only > database-level locking, its overhead

Re: [sqlite] Huge WAL log

2015-01-16 Thread Jan Slodicka
RSmith wrote >> >> The code schema is as follows: >> >> foreach table >> { >> BEGIN >> INSERT INTO table VALUES() >> INSERT INTO table VALUES() >> ... >> COMMIT >> } >> >> Large column values are supplied as parameters, the rest (vast majority) >> is >> passed

Re: [sqlite] Huge WAL log

2015-01-16 Thread Jan Slodicka
Paul Sanderson wrote > Unlike a rollback journal a WAL file can have multiple copies of the same > page. > > So from yor main loop, expanding the following code may help us > understand. > > "insert all downloaded rows" > > If your inserted records is 5million separate insertions then each >

Re: [sqlite] Huge WAL log

2015-01-16 Thread Jan Slodicka
Paul Sanderson wrote > So from yor main loop, expanding the following code may help us > understand. > > "insert all downloaded rows" The code schema is as follows: foreach table { BEGIN INSERT INTO table VALUES() INSERT INTO table VALUES() ... COMMIT } Large

Re: [sqlite] Huge WAL log

2015-01-16 Thread Jan Slodicka
Simon Slavin-3 wrote > However, other information in your message suggests that you have a > resource leak of some type somewhere. Especially, it should not take 12 > minutes to insert 3.5M rows into a simple table with an index or two > unless really long strings or blobs are involved. > >

Re: [sqlite] Huge WAL log

2015-01-15 Thread Jan Slodicka
I'll add the results from additional tests. First of all, I forced a commit after each 100,000 records inserted into a single table. (A complication for us.) Some numbers for a table with a single index and 3,423,000 inserted records: Intermediate commits took subsequently 764 msec, 2164 msec,

Re: [sqlite] Huge WAL log

2015-01-15 Thread Jan Slodicka
Simon Slavin-3 wrote >> - WAL log size 7.490 GB > > Please repeat your tests but as the first command after opening your > database file issue > > PRAGMA journal_size_limit = 100 > > With this change the WAL file may still grow to 7 GB while that particular > transaction is being executed

Re: [sqlite] Huge WAL log

2015-01-15 Thread Jan Slodicka
Richard Hipp-3 wrote > What is your page size? 1024 Richard Hipp-3 wrote > Your original post said you inserted two rows for each transaction. > How big are those two rows? Sorry for misleading information. Here is a more formal algorithm: foreach table { BEGIN insert all downloaded

Re: [sqlite] Huge WAL log

2015-01-14 Thread Jan Slodicka
Richard Hipp-3 wrote >> No other active readers or writers. > > Are you sure? Writers for sure. As far readers are concerned, the things are too complex to make an absolute statement. (I shall check once more.) However, I can add a few observations I made: WAL file size was about 70 MB (as

[sqlite] Huge WAL log

2015-01-14 Thread Jan Slodicka
I understand that the WAL log uses less efficient storage rules than the real database, but this case was a real surprise for me. Here is the brief description. We start from an empty database, create a few tables (each having a few indexes), then begin a transaction, do a couple of inserts into

Re: [sqlite] Bugreport - slowdown in sqlite after the ANALYZE statement

2014-12-10 Thread Jan Staněk
Thank you very much for the explanation and tips, they are appreciated. Dne 9.12.2014 v 14:30 Richard Hipp napsal(a): > Answered by adding a comment at > https://bugzilla.redhat.com/show_bug.cgi?id=1161844 > > On Tue, Dec 9, 2014 at 6:06 AM, Jan Staněk <jsta...@redhat.com> wrot

[sqlite] Bugreport - slowdown in sqlite after the ANALYZE statement

2014-12-09 Thread Jan Staněk
on and possibly isolated the bug. Details are at https://bugzilla.redhat.com/show_bug.cgi?id=1161844 . Thanks for your work, - -- Jan Stanek - Red Hat Associate Developer Engineer - Databases Team -BEGIN PGP SIGNATURE- Version: GnuPG v2 iEYEARECAAYFAlSG16wACgkQXbaA6cD3QD38pwCcDiofiIh5jo+E8P5B

Re: [sqlite] default ignore-glob for sqlite

2014-11-21 Thread Jan Nijtmans
2014-11-21 1:23 GMT+01:00 E. Timothy Uy: > Jan, I added to your list > > .target_source > lemon.obj > libsqlite3.lib > mkkeywordhash.obj > sqlite3.def > sqlite3.dll > sqlite3.exp > sqlite3.lib Thanks! I added them too. My preferred win32/64 compilation environme

Re: [sqlite] default ignore-glob for sqlite

2014-11-06 Thread Jan Nijtmans
2014-11-06 1:14 GMT+01:00 E. Timothy Uy <t...@loqu8.com>: > Hi, I noticed that the ignore-glob for sqlite is empty. Is it just because > fossil does not transfer this information? What should I be using? I'm using the "ignore-glob" versioned setting below. Regards,

[sqlite] sqlite3_value_type dereferencing NULL pointer

2014-10-02 Thread Jan Staněk
://retrace.fedoraproject.org/faf/reports/445794/ [2] https://bugzilla.redhat.com/attachment.cgi?id=942560 -- Jan Stanek - Red Hat Associate Developer Engineer - Databases Team ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi

Re: [sqlite] sqlite3_step and SQLITE_LOCKED/BUSY

2014-09-05 Thread Jan Slodicka
Thanks, Simon, perhaps I did not formulate may question clearly enough. The class of course works as you wrote, the only problem relates to the error handling. If you are interested, the C# wrapper (original code) is here

[sqlite] sqlite3_step and SQLITE_LOCKED/BUSY

2014-09-04 Thread Jan Slodicka
I don't have any real problem this time, just wondered if our C# wrapper is programmed correctly/efficiently. Suppose we prepared a statement using sqlite3_prepare_v2(). Could please anybody explain how to treat above mentioned error codes returned by sqlite3_step()? Our C# wrapper (inspired by

Re: [sqlite] Integrity check

2014-09-02 Thread Jan Slodicka
Thanks, Simon. Simon Slavin-3 wrote > If possible, you should try to do your synchronisation when your app is > frontmost only. However, I understand that this may not be appropriate > for your app. Exactly, under normal circumstances the synchronization of our app is the topmost priority,

Re: [sqlite] HELP sqlite3 used in vxworks has someproblem?

2014-09-01 Thread Jan Nijtmans
IR 2949130 0x2d000a S_nfsDrv_NO_SUCH_FILE_OR_DIR 7602186 0x74000a S_cdromFsLib_NO_SUCH_FILE_OR_DIRECTORY The list is not so long, if it helps then it is doable to just add them all. But feedback on behavior on different file systems is crucial, I wouldn't just add all of them blindl

Re: [sqlite] Win32 .def exports != documented APIs ?

2014-08-30 Thread Jan Nijtmans
2014-08-29 16:22 GMT+02:00 Jan Nijtmans <jan.nijtm...@gmail.com>: > I doubt the usefulness > of sqlite3_win32_is_nt(), because on current supported > systems this function should return 1 anyway. On > Windows RT it returns - surprisingly - 0 (which is > already fixed on tru

Re: [sqlite] Win32 .def exports != documented APIs ?

2014-08-29 Thread Jan Nijtmans
tion that might be interesting on some embedded environments (read: Windows CE) is sqlite3_win32_set_directory(). The other four are not portable anyway, I don't see any practical use for them. Regards, Jan Nijtmans ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Integrity check

2014-08-28 Thread Jan Slodicka
Thanks, Simon. Simon Slavin-3 wrote > Your solution seems to do it by exchanging data accessed using the SQLite > API so you shouldn't have that sort of problem. Yes, only standard SQLite API is used. > I assume that you aren't using any PRAGMAs which speed up SQLite at the > expense of

Re: [sqlite] Integrity check

2014-08-28 Thread Jan Slodicka
Richard Hipp-3 wrote > Have you reviewed the list of corruption causes at > http://www.sqlite.org/howtocorrupt.html and eliminated them all as > possibilities? Multiple times, but I did it again. In general I can exclude only a few points... 1.0 File overwrite by a rogue thread or process

Re: [sqlite] Integrity check

2014-08-28 Thread Jan Slodicka
Thanks, may I ask about PRAGMA synchronous=Normal? The worst-case scenario I can imagine is that the app is killed by the OS when a checkpoint operation is in process... -- View this message in context: http://sqlite.1065341.n5.nabble.com/Integrity-check-tp77519p77558.html Sent from the

Re: [sqlite] Integrity check

2014-08-28 Thread Jan Slodicka
Simon Slavin-3 wrote > On 27 Aug 2014, at 4:21pm, Jan Slodicka > jano@ > wrote: > >> - There is one potentionally risky operation that our app performs: The >> data >> exchange with a remote WebService. This can take long (10+ min). Users >> often &

Re: [sqlite] Integrity check

2014-08-28 Thread Jan Slodicka
Thank you for the answer. > Your custom collation function would be my prime suspect here. Yes, it was. Some time ago we really corrected a bug in the collation, which resulted in decreased number of user reports. Even later we switched to the ICU library, which - I suppose - should be

[sqlite] Integrity check

2014-08-27 Thread Jan Slodicka
A while ago I reported about DB corruption issues that we occasionally receive from our users. They always have the same pattern: - A few rowid's missing from a few indexes, and - A few "wrong # of

Re: [sqlite] Crash in sqlite3_mutex_try [Was: SQLite 3.8.6 beta]

2014-08-23 Thread Jan Nijtmans
2014-08-22 9:14 GMT+02:00 Jan Nijtmans <jan.nijtm...@gmail.com>: > It looks like this is on its way to being corrected: > > > However, I don't think this will work on Win95/98/NT Fixed here: <http://www.sqlite.org/src/info/9fe0f0754c> Thanks! No more remar

Re: [sqlite] Crash in sqlite3_mutex_try [Was: SQLite 3.8.6 beta]

2014-08-22 Thread Jan Nijtmans
2014-08-15 12:50 GMT+02:00 Jan Nijtmans <jan.nijtm...@gmail.com>: > Looking at the function sqlite3_win32_is_nt() > It should simply return 1 on any > currently supported platform. Looking closely, > it returns 0 on Windows RT, but who cares > (leaving the "why&q

Re: [sqlite] Crash in sqlite3_mutex_try [Was: SQLite 3.8.6 beta]

2014-08-15 Thread Jan Nijtmans
2014-08-12 10:35 GMT+02:00 Jan Nijtmans <jan.nijtm...@gmail.com>: > > $ i686-w64-mingw32-gcc -c -DSQLITE_WIN32_NO_ANSI sqlite3.c > sqlite3.c: In function ‘sqlite3_win32_is_nt’: > sqlite3.c:33312:10: error: ‘sInfo’ undeclared (first use in this function) > >

Re: [sqlite] HELP sqlite3 used in vxworks has someproblem?

2014-08-14 Thread Jan Nijtmans
TYLE=1 needed for? (User "chw", whoever that is, should be able to answer that question, since he/she committed this Makefile.vxworks) <http://www.sqlite.org/src/artifact/034289efa9?ln=68> Regards, Jan Nijtmans ___ sqlite-users mail

Re: [sqlite] HELP sqlite3 used in vxworks has someproblem?

2014-08-12 Thread Jan Nijtmans
as a guideline for > implementing our own changes. > At least that's what the famous Lawyer Lawrence Rosen believes. For another opinion, see: <http://cr.yp.to/publicdomain.html> Unfortunately, I'm not a lawyer :-( Regards, Jan Nijtmans __

  1   2   3   4   >