ines
>
> Both options would be very helpful for information of fixed format
> downloaded from information providers.
Hi, those would be very useful enhancements.
--
Robert M. Münch
signature.asc
Description: OpenPGP digital signature
__
that it’s not a dead-end… the
risk profile is just not good.
Viele Grüsse.
--
Robert M. Münch
signature.asc
Description: OpenPGP digital signature
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
back. I think using changesets
can be a bit more challenging for such a use-case.
* I see such a feature as a natural companion to the session extension. Where
versioning/branching works on the whole database.
Viele Grüsse. Robert M. Münch
On 29 Aug 2018, at 14:28, Simon Slavin wrote:
> I h
On 2 Sep 2019, at 10:59, Dominique Devienne wrote:
> On Mon, Sep 2, 2019 at 8:06 AM Robert M. Münch
> wrote:
>
>> Hi, I think that SQLite use some bitmap indexes
>
>
> Not that I know of, but I don't know the full source code. Maybe FTS[345]
> do/es, but SQLit
Hi, I think that SQLite use some bitmap indexes and this here might be of
interest if not already used/known: http://roaringbitmap.org/ I think it’s from
the same guy how did SIMDJSON.
Viele Grüsse.
--
Robert M. Münch, CEO
Saphirion AG
smarter | better | faster
http://www.saphirion.com
The docs at https://www.sqlite.org/compile.html state: „SQLITE_ENABLE_SESSION
This option enables the session extension.“ which is not enough. You need to
define SQLITE_ENABLE_PREUPDATE_HOOK too.
Robert M. Münch
On 8 Aug 2018, at 17:55, Larry Brasfield wrote:
> In shell.c, #defining
Hi, see: https://github.com/lemire/simdjson
Can parse GB/s of JSON input. This might be a good candidate to use in the
extension.
--
Robert M. Münch
signature.asc
Description: OpenPGP digital signature
___
sqlite-users mailing list
sqlite-users
Hi, when doing 2D hit-testing with only rectangular areas, is it faster to use
the geopoly extension and functions or is the bare R*Tree extension faster?
--
Robert M. Münch
signature.asc
Description: OpenPGP digital signature
___
sqlite-users
On 29 Jul 2018, at 14:07, Simon Slavin wrote:
> On 29 Jul 2018, at 12:56pm, Robert M. Münch
> wrote:
>
>> I want to add an autosave feature that stores some data at critical
>> points/specific intervals. This data of course should be commited to disk,
>> to survive
commit stuff to disk, while an outer-most transaction is open? Is
there something like an „UPDATE IMMEDIATELY…“ or so to bypass an open
transaction? How would one do this?
I would like to avoid using a 2nd database-file if possible.
--
Robert M. Münch
signature.asc
Description: OpenPGP
ypass most of the
> network filesystem bugs, at the expense of restricting database access
> to a single process at a time.
Ok, we can try that.
> Is your system able to live with that restriction and use PRAGMA
> locking_mode=EXCLUSIVE?
Yes, that shouldn’t be a problem. Thanks.
--
Ro
way that using sqlite files from a network share is per se
impossible.
Any insights on this?
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
On 20 May 2018, at 15:56, Clemens Ladisch wrote:
> Robert M. Münch wrote:
>> I’m wondering if the R*Tree index of Sqlite could be used to implement
>> GUI object hit testing?
>
> Yes, that would be possible.
Using this approach now for some time with a memory database and
eting goals.
Keeping things configurable as it is, is a very good approach, please keep it.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
_
entries.
What do you think? Or maybe any experiences with such a setup?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
: with the new name… but might be
dangerous… any better idea?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
s
e updated - if zero then you know the row didn't
> exist, so run the INSERT.
That’s a nice one. I’m going to try this. At least you don’t run two queries
but you need two calls, replacing the query for the #of-rows-changed query,
which should be quicker.
Viele Grüsse.
--
Robert M. Münch,
and this assumes
that you don’t use AUTOINCREMENT on a table otherwise this strategy will fail.
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP
ement. If I need to build this statement dynamically, IMO it would be
better to handle this code directly in code:
if(record-exists?){
UPDATE …
} else {
INSERT …
}
Any suggestions / feedback?
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
s
Hi, does anyone know the memory consumption when I track changes to a database
in relation to the change-size? For example: If my DB file is 10MB and I change
30% of the database will the memory consumption be something around 3MB?
--
Robert M. Münch, CEO
Saphirion AG
smarter | better
extension looks like something
that will handle the tracking tables for us and create those change-sets as in
the example. Storing change-sets inside the DB should work too, I think.
Or would it be better to use the approach from the example and omit the
SESSIONs extension at all?
Viele Grüsse.
hat can be played back and forth. I'm
not totally sure how to best tackle this.
If using VERSION extension and storing the changes inside the DB (while
excluding the tracking for the change-set-table) this should even give us a
persistent undo system, right?
Viele Grüsse.
--
Robert M. Münch
On 31 Jul 2017, at 17:21, Richard Hipp wrote:
> Ticket https://sqlite.org/src/info/de3403bf5ae5f72ed describes a
> problem with column naming, and a proposed solution. Today's
> question: Should the proposed solution be merged into the 3.20.0
> release?
+1 yes
--
Robert M.
punctuation, using a digest of the path, or making
> up an identifier that then has to be stored somewhere else.
Good point. We need to do the same in the future.
> It also makes the schema a lot easier to understand when looking at generated
> statements or poking around in the sqli
. BTW: Is this behaviour standard or a
SQLite variant?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
sqlite-user
names in there all the time, which is not feasible.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
sqli
iggers in the radar. Great, I
think that's solving my problem. Thanks a lot!
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
__
test VALUES ('field a', DEFAULT, 'field c', 'field d');
That's what I want to do.
> PS: Simon: Specifying NULL will just put a NULL value in there, it won't use
> the default.
I tried NULL and as you said, that doesn't work because NULL is pu
Hi, I have a table like:
CREATE TABLE test(a, b DEFAULT "-", c, d)
Now I would like to use
INSERT VALUES(a,?,c,d)
Where ? is something that the default value is used and not the provided value.
Is this possible at all?
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
I do this. I'm using 3.19.3 now.
I found out that if you don't set SQLITE_ENABLE_JSON1 it seems some functions
are available but not all... when setting SQLITE_ENABLE_JSON1 all are
available. That's a bit strange IMO, but might be a problem on my end, not sure.
--
Robert M. Münch,
-1":1000}')
json_extract works and json_value too. So I'm really wondering why json_patch
is missing. I checked the sources, and the code is there.
I really don't have an idea what's up here.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | f
X statement.
Ah, cool.
Since at one point I know all the columns and later on a couple columns could
be added, I'm thinking about creating the table with the known columns in a
classical way and have one additional JSON column for future expansion. I think
that could speed things up. Wh
RE parts look like this:
... WHERE col-1 <> NULL AND col-2 <> NULL ... AND col-x <> NULL
... WHERE col-x LIKE ...
and so on. So mostly pretty simple queries. No JOINS etc. We have about 50.000
records and maybe at max 50 columns.
--
Robert M. Münch, CEO
M: +41 79 65 1
SELECT requests will then run against the view.
This view works and of course takes some time to build. Can the JSON1 extension
be supported by adding indices or whatever, that speeds-up the VIEW
construction/updates?
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
s
On 19 Jun 2017, at 10:47, Robert M. Münch wrote:
> Well, the question for me is, which approach will be faster?
> ...
Hi, answering my own question as I tried it with 5 records and 50 columns.
The JSON approach is way faster up to factor 1000.
Viele Grüsse.
--
Robert M. Münch,
records each JSON object/array containing 5 - 50
fields.
Are there are any benchmarks available?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
attributes
and make it compatible with the session extension.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
s but get an error "Database schema changed" when applying the
inverted changeset.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPG
t transposes the data from a flat to column structure?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
sqlite-us
the idea would
be to just store JSON data in table A that contains column/value/...?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPG
On 17 Jun 2017, at 9:53, Wout Mertens wrote:
> Could you not combine the data on the app side?
We are currently holding all data on the app side and want to get it into
SQLite to make use of it's querying features. So, that would be a step back.
--
Robert M. Münch, CEO
M: +41 79 65
changes to our database. But the
session extension can't handle schema changes.
Thanks a lot.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital sign
oes SQLite count scheme changes incrementally,
so that even then it's not possible to apply the changeset?
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP di
long as all columns
are there a change can be applied. For additional columns the values would just
be deleted. Or even better add reversing of ALTER TABLE commands to the
changeset handler.
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
can suggest an
> alternative which is compatible with more systems. This is that for every SQL
> command you execute you provide one or more commands which would reverse the
> effect.
That's what SQLite constructs when creating an inverted changeset. That's what
re applied?
Viele Grüsse.
--
Robert M. Münch, CEO
M: +41 79 65 11 49 6
Saphirion AG
smarter | better | faster
http://www.saphirion.com
http://www.nlpp.ch
signature.asc
Description: OpenPGP digital signature
___
sqlite-users mailing list
sq
other database? How to keep
record references in sync?
Because if a new records is in the destination table it gets a new
auto-increment ID and all references need to be adjusted.
Thanks.
--
Robert M. Münch
http://www.robertmue
47 matches
Mail list logo