Re: [sqlite] Trigger Performance

2018-06-11 Thread Keith Medcalf
Yes. Looking up the trigger and preparing the VDBE code appears to the additional time spent. --- The fact that there's a Highway to Hell but only a Stairway to Heaven says a lot about anticipated traffic volume. >-Original Message- >From: sqlite-users [mailto:sqlite-users-

Re: [sqlite] Trigger Performance

2018-06-11 Thread David Burgess
Trying again/ Specifically, preparation of the constant "trigger part" of the statement is the overhead? Correct? On Tue, Jun 12, 2018 at 9:47 AM, David Burgess wrote: > Specifically, preparation of the "trigger part" of the statement is > the overhead? Correct? > > > On Mon, Jun 11, 2018 at

Re: [sqlite] Trigger Performance

2018-06-11 Thread David Burgess
Specifically, preparation of the "trigger part" of the statement is the overhead? Correct? On Mon, Jun 11, 2018 at 5:16 PM, Keith Medcalf wrote: > > Okay, the difference is the "lots of inserts" -vs- the "one insert". > > When I do the same thing (dump the contents of the table to a file and

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Richard Rousselot
If FTS5 is enabled by default in the amalgamation, the documentation needs to be updated. https://sqlite.org/fts5.html Section 2.1 On Mon, Jun 11, 2018 at 9:57 AM Richard Hipp wrote: > On 6/11/18, Lonnie Abelbeck wrote: > > > >> On Jun 11, 2018, at 7:23 AM, Richard Hipp wrote: > >> > >> On

Re: [sqlite] Performance of writing blobs

2018-06-11 Thread Dominique Devienne
On Mon, Jun 11, 2018 at 4:27 PM Clemens Ladisch wrote: > Dominique Devienne wrote: > > My assumption > > was that after the zeroblob(N), there was enough room in the main DBs > > pages, such that the subsequent blob open+write+close did not need to > > generate any "page churn" (i.e. journal

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Richard Hipp
On 6/11/18, Lonnie Abelbeck wrote: > >> On Jun 11, 2018, at 7:23 AM, Richard Hipp wrote: >> >> On 6/11/18, Lonnie Abelbeck wrote: >>> >>> What changed for 3.23.1 -> 3.24.0 to cause such a large increase in >>> library >>> file size? >>> >> >> See Dan's follow-up. Beginning with 3.24.0, the

Re: [sqlite] Performance of writing blobs

2018-06-11 Thread Clemens Ladisch
Dominique Devienne wrote: > My assumption > was that after the zeroblob(N), there was enough room in the main DBs > pages, such that the subsequent blob open+write+close did not need to > generate any "page churn" (i.e. journal activity) and could write directly > to the pages created on initial

[sqlite] Performance of writing blobs

2018-06-11 Thread Dominique Devienne
I'm surprised about the commit time of SQLite, when writing blobs is involved. Can anybody shed light on this subject? Below's a description of what I do, with the results. I've exporting data into SQLite, spread in several tables. I process only about 240,000 rows, and write around 1GB in 20,000

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Richard Hipp
On 6/11/18, Richard Hipp wrote: > On 6/11/18, Lonnie Abelbeck wrote: >> >> What changed for 3.23.1 -> 3.24.0 to cause such a large increase in >> library >> file size? >> > > See Dan's follow-up. Beginning with 3.24.0, the FTS5 and JSON1 > extensions are enabled by default. Checking further, I

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Richard Hipp
On 6/11/18, Lonnie Abelbeck wrote: > > What changed for 3.23.1 -> 3.24.0 to cause such a large increase in library > file size? > See Dan's follow-up. Beginning with 3.24.0, the FTS5 and JSON1 extensions are enabled by default. Manually edit the Makefile generated by ./configure to turn off

Re: [sqlite] Checking for errors in sqlite3_column_*

2018-06-11 Thread Simon Slavin
On 11 Jun 2018, at 8:29am, Christopher Head wrote: > It seemed potentially odd that many other > threads got replies but this didn’t. Your question was so good nobody had an answer to it. I hope you see that DRH has now posted a reply, even if that reply doesn't include a solution. Simon.

Re: [sqlite] Query on SQLite - VxWorks

2018-06-11 Thread Simon Slavin
On 9 Jun 2018, at 6:36pm, Guna Sekar wrote: > Is SQLite supports outfile query and dumps all data into specified file > format ? I don't understand your question, but you might want to use the command-line shell program to dump a database to a text file -- either as SQL commands or a CSV

Re: [sqlite] Insert with an '

2018-06-11 Thread John McKown
Very good point. I think that everyone should do it that way. It is a bit more work, but is vastly superior. On Mon, Jun 11, 2018, 03:23 Olivier Mascia wrote: > > Le 11 juin 2018 à 10:07, Peter Nacken a écrit : > > > > I try to insert email addresses into a table and get an error with >

Re: [sqlite] Insert with an '

2018-06-11 Thread Richard Damon
On 6/11/18 4:23 AM, Olivier Mascia wrote: >> Le 11 juin 2018 à 10:07, Peter Nacken a écrit : >> >> I try to insert email addresses into a table and get an error with addresses >> they have a single quotation mark ( na'm...@domain.ltd ). >> Sorry I forgot I‘m using C# > (Assuming: "create table

Re: [sqlite] Insert with an '

2018-06-11 Thread Peter Nacken
Dear all, Thanks for your help. It works ! Peter > Am 11.06.2018 um 11:14 schrieb Tim Streater : > >> On 11 Jun 2018, at 09:07, Peter Nacken wrote: >> >> I try to insert email addresses into a table and get an error with addresses >> they have a single quotation mark ( na'm...@domain.ltd ).

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Dan Kennedy
On 06/11/2018 05:35 AM, Lonnie Abelbeck wrote: Hi, Our project did a SQLite version bump from 3.23.1 to 3.24.0 (identical build options), the /usr/lib/libsqlite3.so.0.8.6 lib increased by 20% ! For version 3.24.0, the fts5 and json1 extensions are enabled by default in the

Re: [sqlite] Checking for errors in sqlite3_column_*

2018-06-11 Thread Richard Hipp
On 6/11/18, Christopher Head wrote: > Hello! I noticed that there was some discussion about mailing list > messages getting sent to spam boxes. So, not that I expect an immediate > answer, but just in case people didn’t see this message for that > reason, here it is again. It seemed potentially

Re: [sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Richard Hipp
On 6/10/18, Lonnie Abelbeck wrote: > > Our project did a SQLite version bump from 3.23.1 to 3.24.0 (identical build > options), the /usr/lib/libsqlite3.so.0.8.6 lib increased by 20% ! > > 3.24.0 > -rwxr-xr-x1 root root814112 Jun 10 15:31 > /usr/lib/libsqlite3.so.0.8.6 (uses libm)

[sqlite] Trigger performance

2018-06-11 Thread David Burgess
I have a table where I insert 284,000 rows time taken 3.39 seconds. I add the following trigger CREATE TRIGGER x_trigger BEFORE INSERT ON x WHEN 0 = 1 BEGIN SELECT RAISE ( ABORT, 'raise' ); END; time taken 4.49 seconds. ___

Re: [sqlite] Checking for errors in sqlite3_column_*

2018-06-11 Thread Christopher Head
Hello! I noticed that there was some discussion about mailing list messages getting sent to spam boxes. So, not that I expect an immediate answer, but just in case people didn’t see this message for that reason, here it is again. It seemed potentially odd that many other threads got replies but

[sqlite] 3.24.0 is 20% larger than 3.23.1

2018-06-11 Thread Lonnie Abelbeck
Hi, Our project did a SQLite version bump from 3.23.1 to 3.24.0 (identical build options), the /usr/lib/libsqlite3.so.0.8.6 lib increased by 20% ! 3.24.0 -rwxr-xr-x1 root root814112 Jun 10 15:31 /usr/lib/libsqlite3.so.0.8.6 (uses libm) 3.23.1 -rwxr-xr-x1 root root

Re: [sqlite] Idea: defining table-valued functions directly in SQL

2018-06-11 Thread sqlite
I have some of my own ideas about this. * Perhaps move PARAMETERS before AS, which may make the syntax easier. * You don't need computed columns in tables; use views instead. You can index computed values though. * I do agree that defining table-valued functions in these way can be useful

[sqlite] Query on SQLite - VxWorks

2018-06-11 Thread Guna Sekar
Hi Team, Is SQLite supports outfile query and dumps all data into specified file format ? I have tried to extract data from table using outfile query but query failed status returned. If supports , Can you please share the syntax or example that will really help lot to me. Awaiting for

Re: [sqlite] Insert with an '

2018-06-11 Thread Tim Streater
On 11 Jun 2018, at 09:07, Peter Nacken wrote: > I try to insert email addresses into a table and get an error with addresses > they have a single quotation mark ( na'm...@domain.ltd ). > > Sorry I'm facing this problem for weeks, I can't find a solution. > > Is there a known workaround for it ?

Re: [sqlite] Insert with an '

2018-06-11 Thread Olivier Mascia
> Le 11 juin 2018 à 10:07, Peter Nacken a écrit : > > I try to insert email addresses into a table and get an error with addresses > they have a single quotation mark ( na'm...@domain.ltd ). > Sorry I forgot I‘m using C# (Assuming: "create table T(E text);" for the following.) If you're

Re: [sqlite] Insert with an '

2018-06-11 Thread Simon Slavin
On 11 Jun 2018, at 9:07am, Peter Nacken wrote: > I try to insert email addresses into a table and get an error with addresses > they have a single quotation mark ( na'm...@domain.ltd ). > > Sorry I'm facing this problem for weeks, I can't find a solution. Every single ' character in a

Re: [sqlite] Insert with an '

2018-06-11 Thread Peter Nacken
Sorry I forgot I‘m using C# > Am 11.06.2018 um 10:07 schrieb Peter Nacken : > > Hi, > > I'm new in SQLite. > > I try to insert email addresses into a table and get an error with addresses > they have a single quotation mark ( na'm...@domain.ltd ). > > Sorry I'm facing this problem for

[sqlite] Insert with an '

2018-06-11 Thread Peter Nacken
Hi, I'm new in SQLite. I try to insert email addresses into a table and get an error with addresses they have a single quotation mark ( na'm...@domain.ltd ). Sorry I'm facing this problem for weeks, I can't find a solution. Is there a known workaround for it ? Thanks for help Peter

Re: [sqlite] Trigger Performance

2018-06-11 Thread Keith Medcalf
Okay, the difference is the "lots of inserts" -vs- the "one insert". When I do the same thing (dump the contents of the table to a file and then reload the dump), the overhead of the trigger is about 33% (same as you). There is not only the time to "insert the data" but also the overhead of

Re: [sqlite] Trigger Performance

2018-06-11 Thread David Burgess
> The trigger is adding a mere 10% overhead on a million rows ... 3.24 on a real data DB (16 columns), the inserts were generated from .dump in the shell, about 45MB of input data so BEGIN; lots of inserts COMMIT; Run on a laptop i7 with SSD (not that should make any difference to the relative