[sqlite] Suggestions for Fast Set Logic?

2015-07-13 Thread Scott Robison
On Sun, Jul 12, 2015 at 9:46 AM, James K. Lowden wrote: > On Sat, 11 Jul 2015 19:02:59 -0600 > Scott Robison wrote: > > > > I don't follow you. A complex query is an assemblage of clauses. > > > Whether or not broken down "to individual sub queries", the search > > > arguments are the same.

[sqlite] Question about getting size of stored data

2015-07-13 Thread Hick Gunter
AFAIKT you are attempting to determine the "size" of one row by the difference in the file size. This must fail, because SQLite allocates and writes the database file in units of "database pages". Does your definition of "size" include the index entries pertaining to a row? Does it include the

[sqlite] How to correctly a add string to a Mem?

2015-07-13 Thread Sairam Gaddam
I have tried a method to create a Mem and add a string to it, which is as below sqlite3VdbeMemInit(&(p->custom_aMem[0]), p->db, MEM_Null); memAboutToChange(p,&(p->custom_aMem[0])); sqlite3VdbeMemSetStr(&(p->custom_aMem[0]), zColumn ,

[sqlite] How to correctly a add string to a Mem?

2015-07-13 Thread Clemens Ladisch
Sairam Gaddam wrote: > I have tried a method to create a Mem and add a string to it, which is as > below > > sqlite3VdbeMemSetStr(&(p->custom_aMem[0]), zColumn , > strlen(zColumn)*sizeof(char), SQLITE_UTF8, SQLITE_STATIC); This is an internal function that applications are not supposed to know

[sqlite] Suggestions for Fast Set Logic?

2015-07-13 Thread Hick Gunter
Consider creating a bitmapped index on the fields you expect to be queried the most. Bitmaps may be stored and manipulated (combined by logical operations) very efficiently as long as the field values conform to certain criteria (usually "managable cardinality of distinct values"). Bitmap

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Shuhrat Rahimov
Hello, I was trying to run SQLite on ARM Cortex M4 CPU. What I need is a minimal SQLite without the most features. I have no file system, so I wanted to save a single file db on the internal MCU flash. I have successfully cross compiled SQLite for ARM Cortex M4. I have set among others compile

[sqlite] How to correctly a add string to a Mem?

2015-07-13 Thread Sairam Gaddam
I want to make some changes to the result set and I need to add an extra column. On Mon, Jul 13, 2015 at 12:33 PM, Clemens Ladisch wrote: > Sairam Gaddam wrote: > > I have tried a method to create a Mem and add a string to it, which is as > > below > > > >

[sqlite] SQLite transaction time limit

2015-07-13 Thread Iryna Atamanova
Hi guys, We have found the next feature of sqllite - it transaction takes more that 5 seconds, the database has been locked for some time. Could you please help us and let me know how we can increase this time - 5 seconds to 30 for example (what parameter / attribute can be used?) from source

[sqlite] How to correctly a add string to a Mem?

2015-07-13 Thread Clemens Ladisch
Sairam Gaddam wrote: > I want to make some changes to the result set The SQLite API does not allow making changes to the data in a sqlite3_stmt. > and I need to add an extra column. This can be done in SQL: SELECT Column1, ColumnA, 'some value' FROM ...; Regards, Clemens

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Jim Callahan
SQLite expects a file system. "SQLite reads and writes directly to ordinary disk files." https://www.sqlite.org/about.html You need a minimal file system. A file system does not have to be large. CP/M ran on an 8 bit Z-80 with less than 64k of RAM (but the original CP/M was written in Z-80

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Jim Callahan
Here is a link to a more recent (2013) discussion with a more recent (3.x.xx vs 2.x.xx) version of SQLite: http://comments.gmane.org/gmane.comp.db.sqlite.general/83038 Jim On Mon, Jul 13, 2015 at 11:22 AM, Jim Callahan < jim.callahan.orlando at gmail.com> wrote: > SQLite expects a file system.

[sqlite] how to cite SQLite

2015-07-13 Thread Roman Fleysher
Dear SQLiters, I am writing a scientific paper to describe our research. To manage data, we use SQLite. I would like to acknowledge SQLite and cite it properly in the paper. Is there a suggested way of doing it? A conference presentation? A paper, a book? In the simplest form I will use URL.

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Richard Hipp
On 7/13/15, Jim Callahan wrote: > SQLite expects a file system. > Not necessarily. Out-of-the-box SQLite does need a filesystem, but embedded system designers can substitute an alternative VFS implementation that writes directly to hardware. This has been done before. There are consumer

[sqlite] how to cite SQLite

2015-07-13 Thread Richard Hipp
On 7/13/15, Roman Fleysher wrote: > Dear SQLiters, > > I am writing a scientific paper to describe our research. To manage data, we > use SQLite. I would like to acknowledge SQLite and cite it properly in the > paper. Is there a suggested way of doing it? A conference presentation? A > paper, a

[sqlite] how to cite SQLite

2015-07-13 Thread Roman Fleysher
Thank you, Richard. I will. Our research has nothing to do with databases or computer science. We use SQLite as pure users, to help manage our data analysis. Nevertheless, it made a huge difference for us already and more to come as we replace text-file based/manual management. I am very

[sqlite] how to cite SQLite

2015-07-13 Thread Simon Slavin
On 13 Jul 2015, at 4:51pm, Roman Fleysher wrote: > I am writing a scientific paper to describe our research. To manage data, we > use SQLite. I would like to acknowledge SQLite and cite it properly in the > paper. Is there a suggested way of doing it? A conference presentation? A > paper, a

[sqlite] how to cite SQLite

2015-07-13 Thread Richard Hipp
On 7/13/15, Simon Slavin wrote: > > On 13 Jul 2015, at 4:51pm, Roman Fleysher > wrote: > >> I am writing a scientific paper to describe our research. To manage data, >> we use SQLite. I would like to acknowledge SQLite and cite it properly in >> the paper. Is there a suggested way of doing it? A

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Jim Callahan
At a minimum SQLite needs a C complier (or cross-compiler) for the CPU. The storage device manufacturer usually publishes some specs (and sample code -- such as assembly language routines callable from C) if a third party has a primitive file system (a term I prefer to VFS which could refer to

[sqlite] how to cite SQLite

2015-07-13 Thread Roman Fleysher
Thank you Simon and Richard. I will use this form. What I also meant is that software often impements unique algorithms, which I think SQLite does. These algorithms may be presented at conferences/journals. In turn, these publications cite the URL. Thus, I was looking for such a presentation,

[sqlite] VFS for an MCU internal flash

2015-07-13 Thread Scott Doctor
Below is a link to files for the Atmel SAM4S processor that implements a simple FAT file system. The Atmel part is an ARM M4 core which I used in a recent design. the link takes you to the C files. YOu can also easily navigate to the various documentation for the code.

[sqlite] Schema-less JSON SQLite DB?

2015-07-13 Thread Hayden Livingston
Is there a concept of a schema-less JSON SQLite DB? My reason is simple: versioning. We have lot of business metrics that get updated let's say once a month, and we need to be agile to get them. Right now, we just put the version in the SQLite file, and then make sure no queries cross the

[sqlite] Fwd: Usenix paper: Korean researchers invent sqlite WALDIO mode to circumvent redundant journaling by EXT4 on eMMC

2015-07-13 Thread Donald Griggs
There's an interesting paper at https://www.usenix.org/system/files/conference/atc15/atc15-paper-lee-wongun.pdf I don't know enough to evaluate it, but if I'm understanding correctly: -- They have modified sqlite so as to work directly with the EXT4 filesystem to prevent redundant journaling

[sqlite] Schema-less JSON SQLite DB?

2015-07-13 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/13/2015 05:43 PM, Hayden Livingston wrote: > Is there a concept of a schema-less JSON SQLite DB? What exactly is it you want? A schema-less database? A JSON database? Using SQLite to store JSON? (It is unclear if you mean something like

[sqlite] Schema-less JSON SQLite DB?

2015-07-13 Thread Hayden Livingston
We use SQLite as a library and we don't want to migrate to a server situation. So it seems using the month-to-month approach you outline is reasonable and not outrageous. Good to know. Thanks for the tip on schema modifications which get automatically upgraded on read. This is a great feature. I

[sqlite] Schema-less JSON SQLite DB?

2015-07-13 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/13/2015 08:00 PM, Hayden Livingston wrote: > Does your code also map object hierarchies in json? Yes, but thankfully I don't have much of them. Essentially the top level of the object has a unique id (SQLite allocated), and then other tables