Re: [sqlite] New word to replace "serverless"

Someone should put all the proposals into a vote. The voting system could be driven by a serverless database I presume. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org

Re: [sqlite] New word to replace "serverless"

stack-capturing It captures the stack of the host. stack-dependent pointer-based ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Sanitising user input for FTS5 MATCH parameter

Thanks for the details Dan On Sat, 21 Dec 2019 at 18:40, Dan Kennedy wrote: > > On 20/12/62 22:03, test user wrote: > > Hello, > > > > I have a search box on a website that uses FTS5/MATCH. > > > > MATCH seems to take its own custom language for matching

Re: [sqlite] Sanitising user input for FTS5 MATCH parameter

or compiled which is why I was asking how safe that would be. On Fri, 20 Dec 2019 at 16:05, Jose Isaias Cabrera wrote: > > test user, on Friday, December 20, 2019 10:03 AM, wrote... > > > > Hello, > > > > I have a search box on a website that uses FTS5/MATCH. >

[sqlite] Sanitising user input for FTS5 MATCH parameter

be sanitising user input? - E.g. How can I transform a string of words and text into a query? What characters should I be removing or escaping? How can I prevent them using the FTS5 keywords "AND" "OR" etc? Thanks ___ sqlite-users maili

[sqlite] Securing user supplied SQL statements in a single process

Hello, How can I secure user supplied SQL statements in a single process? For example, if I had a public web service that allows users to create their own SQL strings that I then run in a single server process, what are the chances that they would be able to obtain general remote code execution

Re: [sqlite] [draft patch] interface for retrieving values of bound parameters

Wouldn’t your program already know what the values are as it passed them over the FFI initially? Why not hold onto that state? On Mon, 11 Nov 2019 at 17:57, x wrote: > Is http://www.sqlite.org/c3ref/expanded_sql.html no use to you? > > > > > From: sqlite-users

Re: [sqlite] Opposite of SQLite

CAHeavy Chaotic Answer Heavy On Thu, 10 Oct 2019 at 20:42, Simon Slavin wrote: > On 10 Oct 2019, at 7:55pm, Ned Fleming wrote: > > > SQLessLite > > SQDietStartsMonday > ___ > sqlite-users mailing list > sqlite-users@mailinglists.sqlite.org >

Re: [sqlite] Copy-on-write VFS

Hello Fredrik, Why does it need to be part of a VFS instead of using a file system with COW like ZFS? On Fri, 4 Oct 2019 at 12:18, Fredrik Larsen wrote: > Hi > > A copy-on-write IO-path where data is split into static and dynamic parts > (think snapshots for storage) would be very helpful for

Re: [sqlite] SQLITE_BUSY, database is locked in "PRAGMA journal_mode"

with `BEGIN IMMEDIATE`. `SQLITE_BUSY_RECOVERY` occurs at around 7 processes requesting a write lock, but not at 5 processes or below. Does this indicate corrupted data? On Mon, Sep 2, 2019 at 2:45 AM Rowan Worth wrote: > On Fri, 30 Aug 2019 at 04:18, test user > wrote: > > >

Re: [sqlite] SQLITE_BUSY, database is locked in "PRAGMA journal_mode"

etect lock transitions? - Where should I be looking? Id really appreciate any pointers, Thanks. On Wed, Aug 28, 2019 at 9:46 PM test user wrote: > Hello, > > Im getting this message in the log: > > `SQLITE_BUSY, database is locked in "PRAGMA journal_mode"` &

Re: [sqlite] dqlite 1.0.0 - SQLite replication and failover library

Hey Free, Looks like an interesting project. Is there a blog or docs about the reasons for the move from Go to C? Also what types of systems would utilise dqlite? Are there current users? Thanks On Thu, 29 Aug 2019 at 11:41, Free Ekanayaka wrote: > Hi, > > following up from my previous

[sqlite] SQLITE_BUSY, database is locked in "PRAGMA journal_mode"

Hello, Im getting this message in the log: `SQLITE_BUSY, database is locked in "PRAGMA journal_mode"` I get this response when running the query `PRAGMA journal_mode`. The file is in journal_mode=WAL. Another connection holds a write transaction. Seeing as `PRAGMA journal_mode` is just a

Re: [sqlite] Attached databases and union view.

What language/binding library are you using? On Thu, 22 Aug 2019 at 16:45, Peter da Silva wrote: > Database is on tmpfs and periodically snapshotted to SSD. There are > bottlenecks upstream of sqlite that we can see in traces. > > On Thu, Aug 22, 2019 at 10:36 AM Warren Young wrote: > > > On

Re: [sqlite] Getting a notification when a write lock is released.

Thanks for the example José. I was thinking of a more general method that would work when I do not control all of the clients. Your example would only work when all clients are aware of and use the locking logic. On Fri, Aug 16, 2019 at 3:39 PM Jose Isaias Cabrera wrote: > > tes

Re: [sqlite] Getting a notification when a write lock is released.

lock frequently in very short intervals resource intensive? Is SQLITE_ENABLE_SETLK_TIMEOUT the best way to try and implement this in my own library? On Thu, Aug 15, 2019 at 11:08 PM Simon Slavin wrote: > On 15 Aug 2019, at 10:43pm, test user > wrote: > > > Currently the API

Re: [sqlite] Getting a notification when a write lock is released.

ite queue" because my program uses an event loop, and each queued item is a request from some point in the program to acquire a write lock with "BEGIN IMMEDIATE". On Thu, Aug 15, 2019 at 8:48 PM Keith Medcalf wrote: > > On Thursday, 15 August, 2019 13:11, test user <

[sqlite] Getting a notification when a write lock is released.

Hello, If two processes are writing to the same db file, one will get a BUSY response if the other has locked it. Currently the API lets you set a timeout. Does this just retry again after a set amount of time? Or is it possible to get notified immediately when the lock has been released? Can I

[sqlite] Why does WAL prevent the need for async IO?

Hello, On this page: https://www.sqlite.org/asyncvfs.html Quote: The use of WAL mode largely obviates the need for this asynchronous I/O module. The WAL mode does not change the fact that these operations will still block the application process that embeds SQLite: - Slow read queries.

Re: [sqlite] [EXTERNAL] SQLITE_BUSY (SQLITE_BUSY_SNAPSHOT) due to a simple SELECT query -- Documentation needed!

You can also use “BEGIN EXCLUSIVE” before any writes; this gets you a write transaction immediately. If this returns OK all following read/writes will not return BUSY. A transaction can upgrade from a read only to a write (when you do a select followed by an insert). I think you get the snapshot

Re: [sqlite] How does errorLogCallback interrupt my running program?

By FFI I mean any of the public SQLite C functions exported from via FFI. Ok thanks, this makes sense the error callback is called whilst SQLite is executing exec/step. Do I need on callback per thread? On Sun, Aug 11, 2019 at 4:31 PM Clemens Ladisch wrote: > test user wrote: > >

[sqlite] How does errorLogCallback interrupt my running program?

Hello, The error log takes a callback which is called when an error occurs from any SQLite FFI function: https://www.sqlite.org/errlog.html How does this interrupt my program whilst its running? If my program is busy, does it wait until the current function has completed and the process is idle?

Re: [sqlite] THREADSAFE (1, SERIALIZED) vs (2, MULTITHREAD)

s across 8 CPU cores so they all compute concurrently (without blocking each other), and they all use a tiny portion of that disk read bandwidth, surely they would be 8x faster than using a single core? On Tue, Aug 6, 2019 at 1:42 PM Simon Slavin wrote: > On 6 Aug 2019, at 11:34am, tes

Re: [sqlite] THREADSAFE (1, SERIALIZED) vs (2, MULTITHREAD)

ed). Im just trying to confirm that SERIALIZED will not queue up requests for (1 file, multiple connections to that file, read only requests). On Tue, Aug 6, 2019 at 1:55 AM Keith Medcalf wrote: > > On Monday, 5 August, 2019 17:23, test user > wrote: > > >Whats th

[sqlite] THREADSAFE (1, SERIALIZED) vs (2, MULTITHREAD)

Hello, Whats the difference between these two options for the SQLITE_THREADSAFE compile time flag? From the docs: (1, SERIALIZED) - Safe for use in a multithreaded environment - Enables all mutexes including the recursive mutexes on database connection and prepared statement objects.

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

then allow better higher level libraries. On Wed, Jul 31, 2019 at 9:46 PM Igor Tandetnik wrote: > On 7/31/2019 12:32 PM, test user wrote: > > In some runtimes, the scheduling of functions is unpredictable, so > although > > you will not have a `sleep 5` in the code, the runti

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

Connection 1: SELECT report summary A, - Diff A and B to see what changed. On Wed, Jul 31, 2019 at 3:24 PM Igor Tandetnik wrote: > On 7/31/2019 6:36 AM, test user wrote: > > As an example, the client of this library could: > > > > - A. Obtain a "read transaction", *wi

Re: [sqlite] [SPAM?] Re: Explicit "read transaction" with journal_mode=WAL.

N SHARED IMMEDIATE operation becomes > available, you can change you function's internals, and the caller > doesn't know the difference except that the call got perhaps a bit faster. > > On 7/31/19 6:36 AM, test user wrote: > > Quote: What importance does it have for you that it alrea

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

Quote: What importance does it have for you that it already holds an "end-mark? Quote: Why would it matter that a writer did write and commit between the "reader" BEGIN and its first read? Im writing a library and would like to have an API where the "read transaction" has a clear beginning in

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

s reference? BEGIN READ is semantically what I was trying to describe as what I was trying to achieve, I understand its not in the language! On Tue, Jul 30, 2019 at 9:43 PM Simon Slavin wrote: > On 30 Jul 2019, at 9:39pm, test user wrote: > > > BEGIN IMMEDIATE will start a write transac

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

s duration. This "read transaction" can see all committed transactions that happened before it, but none after it. At the moment it seems to get this guarantee I will need to do a "BEGIN; SELECT * from sqlite_master LIMIT 1" On Tue, Jul 30, 2019 at 8:23 PM Simon Slavin wrote: > On

Re: [sqlite] Explicit "read transaction" with journal_mode=WAL.

e. So if you want to get that shared lock/read snapshot > you can always do something like a select from sqlite_master. "select 1;" > doesn't need to access the file to complete, so it doesn't take out the > shared lock (though it should be returning 1 row, are you sure it's 0?) > >

[sqlite] Explicit "read transaction" with journal_mode=WAL.

Hello, How can I start a "read transaction" from BEGIN? I am using `journal_mode=WAL`. What I am trying to do: From the first `BEGIN` that returns `SQLITE_OK`, all SELECTs read from the same snapshot/point in time. The issue is that its hard to tell if I reading from a read snapshot (where

Re: [sqlite] [EXTERNAL] Determining valid statement placeholders.

Thanks Keith, I think you are right. I can enforce only using index-based or key-based placeholders and force the user to supply data as an array (indexed) or an object (keyed). I think I was assuming I would allow treating index-based placeholders as keys {"?10": "data&qu

Re: [sqlite] [EXTERNAL] Determining valid statement placeholders.

I understand the problem, but I want my library to be able to detect the problem programatically. Currently if a user mixes index-based and key-based placeholders, the only thing a library using SQLite can do us run the query with unbound placeholders set to null (the SQLite default). Id like

Re: [sqlite] [EXTERNAL] Determining valid statement placeholders.

current SQLite FFI APIs. // It is useful because the SQLite default is to bind NULL to unbound placeholders, which may not be what the user wanted. If they wanted this they would of just used the constant NULL instead of a placeholder. // In dynamic languages where both the query string and the da

[sqlite] Determining valid statement placeholders.

Is there a `sqlite3` C FFI API that allows me to determine which index values are valid to bind to? The `sqlite3_bind_parameter_*` APIs (count, name, index) do not actually provide the valid indexes. For example: "?, ?10" would have two valid indexes: (1, 10). But how can I know that indexes

[sqlite] Converting my sqlite database to utf-8

Hello, I want to link my database to android and I am writing arabic words in it so I need to convert these words to utf-8 or else I won't be able to select them from android I am gonna get question marks so how to do that if I have already written the data but it's written in ansi how to

[sqlite] problem: sqlite for PowerPC

hi, I want to use sqlite in linux OS for IBM PowerPC, but I failed when I cross-compiled in MontaVista CGL pro3.1 platform. I have attentioned that somebody mentioned here he/she has SQLite 3 working on Power PC. Could you please send the sources or diffs? Thanks!