[sqlite] concurrency differences between in-memory and on disk?

Hello, I've developed an application that has very high concurrency. In my initial testing we used SQLite 3 from python, but we experienced too many locks and the database always fell behind. We moved to MySQL, which handles the concurrency better, but there was a substantial increase in IO.

[sqlite] very large SQLite tables

We are using SQLite for indexing a huge number (i.e., 100 million to 1 billion) of key pairs that are represented by an 88-byte key. We are using a single table with a very large number of rows (one for each data chunk), and two columns. The table has two columns. One is of type ³text² and the

Re: [sqlite] very large SQLite tables

On Jun 24, 2009, at 3:21 PM, Matthew O'Keefe wrote: > disks accesses to (a) find, and (b) add a chunk, grows larger and > larger. We’ve tested up to 20 million chunks represented in the > table: as expected performance exponentially decreases as the number > of table entries grows. Did

Re: [sqlite] What's the different of the types TEXT and VARCHAR in sqlite3?

On Wed, 2009-06-24 at 14:21 +0200, Martin.Engelschalk wrote: > Hi, > > type names do not matter in sqlite, see http://www.sqlite.org/datatype3.html > > Martin > Yes, I see. Thank you:) ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] concurrency differences between in-memory and on disk?

Daniel Watrous wrote: > I've developed an application that has very high concurrency. In my > initial testing we used SQLite 3 from python, but we experienced too > many locks and the database always fell behind. What precisely is the nature of the concurrency? Are you opening multiple

Re: [sqlite] integer primary key autoincrement & sqlite_sequence

Pavel Ivanov wrote: > Could you explain why this scenario doesn't cause infinite call cycle > of the trigger by itself? Is there some protection in SQLite which > breaks such cycles? SQLite doesn't support recursive triggers: a trigger cannot call itself, directly or indirectly. SQLite keeps

[sqlite] Compiling without dependencies on Windows?

Hi all! Anyone being able to give me some pointers on how to compile SQLite3 into dependency-free .obj's on Windows? The only reason for this is to import it into Delphi, and dependencies are driving me crazy... It doesn't matter if You give me an example (or maybe project source(s)) in Borland

Re: [sqlite] very large SQLite tables

One approach might be to split the big, monolithic table into some number of hash buckets, where each 'bucket' is separate table. When doing a search, the program calculates the hash and accesses reads only the bucket that is needed. This approach also has the potential for allowing multiple

[sqlite] [ANN] SQLiteManager 3.0

VIADANA, Italy (June 24, 2009) - SQLabs is proud to announce today the worldwide availability of SQLiteManager 3.0, the most powerful sqlite database manager tool for MacOS X and Windows. SQLiteManager is a "next generation" GUI database manager for sqlite databases. It combines an

Re: [sqlite] very large SQLite tables

On Wed, Jun 24, 2009 at 3:21 PM, Matthew O'Keefe wrote: > > > We are using SQLite for indexing a huge number (i.e., 100 million to 1 > billion) of key pairs > that are represented by an 88-byte key. We are using a single table with a > very large number of rows (one for

Re: [sqlite] sqlite jdbc and rcp Eclipse

Well, tomorrow I'm going to try if the option clean works. At this moment I can't figure out how to do that because my application is under development and I'm using the eclipse launcher ( Run Configurations). I'm not using any executable file. I have to find the way to pass to the launcher

Re: [sqlite] very large SQLite tables

> "PK" == P Kishor writes: >> As expected, as the table grows, the underlying B-tree >> implementation for SQLite means that the number of disks accesses >> to (a) find, and (b) add a chunk, grows larger and larger. We¹ve >> tested up to 20 million chunks represented in the table: as >>

Re: [sqlite] very large SQLite tables

On Thu, Jun 25, 2009 at 12:36 PM, David Fletcher wrote: > >> "PK" == P Kishor writes: > >>> As expected, as the table grows, the underlying B-tree >>> implementation for SQLite means that the number of disks accesses >>> to (a) find, and (b) add a chunk, grows larger and

Re: [sqlite] very large SQLite tables

On 25 Jun 2009, at 5:43pm, P Kishor wrote: > heck! Do two comparisons -- SQLite v. BerkeleyDB v. Tokyo Cabinet. > > Nothing like thorough testing for the purpose of science. :-) Yes, there is: keeping to departmental budget and project deadlines. (I know, the argument is that the research will

Re: [sqlite] very large SQLite tables

Along the same lines, the buckets could be created in their own unique Sqlite Db, thus improving concurrency as well!!! --- On Thu, 6/25/09, Douglas E. Fajardo wrote: > From: Douglas E. Fajardo > Subject: Re: [sqlite] very large SQLite tables > To:

[sqlite] Cross-Compile and Installation of Sqlite

I have an embedded Linux ARM target and wish to run sqlite on it. I successfully cross-compiled sqlite-3.6.15 on my Ubuntu x86 host, and now I'm ready to install sqlite3, its libraries, and headers on my target system. I originally tried compiling sqlite on my embedded target system. Because

Re: [sqlite] Cross-Compile and Installation of Sqlite

On Thu, Jun 25, 2009 at 4:23 PM, Ben Atkinson wrote: > > I have an embedded Linux ARM target and wish to run sqlite on it.  I > successfully cross-compiled sqlite-3.6.15 on my Ubuntu x86 host, and now I'm > ready to install sqlite3, its libraries, and headers on my target

Re: [sqlite] Cross-Compile and Installation of Sqlite

On Jun 25, 2009, at 4:23 PM, Ben Atkinson wrote: > > I have an embedded Linux ARM target and wish to run sqlite on it. I > successfully cross-compiled sqlite-3.6.15 on my Ubuntu x86 host, and > now I'm ready to install sqlite3, its libraries, and headers on my > target system. > > I

[sqlite] Cross-Compile and Installation of Sqlite

> On Jun 25, 2009, at 4:23 PM, Ben Atkinson wrote: >> >> I have an embedded Linux ARM target and wish to run sqlite on it. I >> successfully cross-compiled sqlite-3.6.15 on my Ubuntu x86 host, and >> now I'm ready to install sqlite3, its libraries, and headers on my >> target system. >>

Re: [sqlite] Cross-Compile and Installation of Sqlite

On Jun 25, 2009, at 5:07 PM, Ben Atkinson wrote: > > On Jun 25, 2009, at 4:27 PM, D. Richard Hipp wrote: > >> What are you trying to install? The command-line shell? A shared >> library? If the latter, why do you need or want a shared library on >> your embedded system. Are aware that the