Re: [sqlite] WAL, threads, shared cache, etc

On Wed, Apr 13, 2011 at 9:05 AM, Mark Hamburg wrote: > I have a database for which I essentially want to support three streams of > operations: writing, reading fast queries (e.g., lookup a single record), and > reading complex queries (e.g., find all of the records matching a

Re: [sqlite] DeviceSQL

On Dec 14, 2007 10:38 AM, <[EMAIL PROTECTED]> wrote: > That would be the Serialized Statement Extension, SSE. > The SSE provides the programmer with two new APIs: > >int sqlite3_serialize(sqlite3_stmt*, void**, int*); >int sqlite3_deserialize(sqlite3*, void*, int, sqlite3_stmt**); > > The

[sqlite] Trac Account

of changes to tickets, which is a heck of a lot better than bookmarking a ticket and checking back every few days. Is there some policy setup for this that I just haven't found? Cheers, Shawn Wilsher - To unsubscribe

Re: [sqlite] sqlite3_release_memory Question

Hmm, the documentation (http://sqlite.org/compile.html) doesn't seem to say anything about that. Is there a cost to pay by enabling those functions, or no? Cheers, Shawn On Jan 11, 2008 8:42 AM, <[EMAIL PROTECTED]> wrote: > "Shawn Wilsher" <[EMAIL PROTECTED]> wrote:

[sqlite] sqlite3_release_memory Question

as much as possible, or does it do that automatically regardless of the value you provide to it? For reference purposes, the Mozilla tracker for this is Bug 411894 (https://bugzilla.mozilla.org/show_bug.cgi?id=411894). Cheers, Shawn Wilsher

[sqlite] Next Version of SQLite

, but at the same time do not want to delay this fix to our OS/2 users very long. The specific checkins we are looking at are 4646, 4647, and 4648. See Bug 411780 for details (https://bugzilla.mozilla.org/show_bug.cgi?id=411780). Cheers, Shawn Wilsher

Re: [sqlite] Next Version of SQLite

uch against patching sqlite locally in our tree (harder to upgrade). Cheers, Shawn Wilsher - To unsubscribe, send email to [EMAIL PROTECTED] -

Re: [sqlite] FTS3 Unicode support

The problem with ICU is that it's a rather large library, and mozilla already has it's own unicode system. That's we we opted on doing unicode support ourselves (less code duplication, and a smaller binary). Cheers, Shawn Wilsher On Jan 24, 2008 11:35 PM, Dan <[EMAIL PROTECTED]>

Re: [sqlite] [PATCH] cache preloading

On Mon, Aug 16, 2010 at 5:13 PM, Paweł Hajdan, Jr. wrote: > Is it something you'd like to include in SQLite? If so, does the patch need > any adjustments before that's possible? I'm slightly concerned about licensing here - do we know what license this patch is? Can we

Re: [sqlite] Can we get a pragma for SQLITE_FCNTL_CHUNKS_SIZE?

On Thu, Aug 19, 2010 at 2:56 PM, Simon Slavin wrote: > It might be worth noting that fragmentation is normally seen as an issue only > under Windows which is very sensitive to it however.  Other operating systems > use different ways of handling disk access, however, real

Re: [sqlite] Feature request: copying vacuum

On Wed, Sep 1, 2010 at 12:46 PM, Jay A. Kreibich wrote: >  On a personal level, I don't think it is worth it.  In the end, you're >  still hoping the OS and filesystem will make smart choices about block >  allocations.  An application shouldn't need to be spending a lot >  of

Re: [sqlite] upstreaming Chromium patches for file handle passing support

On Wed, Sep 1, 2010 at 5:57 PM, Paweł Hajdan, Jr. wrote: > Additionally, browsers seem to be moving to the multi-process architecture > (Chrome, Firefox, WebKit2), so I wouldn't be surprised if you get more > questions about this in the future, or just more forked copies.

Re: [sqlite] WAL for single user database on NFS and Solaris

On Sun, Jan 30, 2011 at 8:26 PM, Dan Kennedy wrote: > If you set "PRAGMA locking_mode=EXCLUSIVE" before reading or > writing the WAL-mode database it might work. That would make us only be able to use one database connection though, would it not? Cheers, Shawn

Re: [sqlite] WAL for single user database on NFS and Solaris

On Mon, Jan 31, 2011 at 5:44 AM, Dan Kennedy wrote: > Right. At most a single connection at a time. Unfortunately, that won't work for this issue since we use more than one connection in our process. Cheers, Shawn ___

Re: [sqlite] Most widely deployed?

> I have five different copies of the SQLite code on this computer > alone, I think. Every Mac has several of them. One of the servers > I deploy to has at least 10 copies of it. Every copy of Firefox 3 > contains a copy of SQLite. And Firefox 2 ;) Cheers, Shawn

Re: [sqlite] Most widely deployed?

> > > Every copy of Firefox 3 contains a copy of SQLite. > > And Firefox 2 ;) > > Really? What is it used for? I'm not sure what uses it internally, but it's exposed via mozIStorageService [1], so add-ons can use it as well! Cheers, Shawn [1]

[sqlite] SQLite Crashes

. If I don't know the answer, I'll get the people who should know involved. We'd really like to try and resolve this issue, so insight on this matter would be greatly appreciated. http://tinyurl.com/2393qs We are presently using the latest version of sqlite. Cheers, Shawn Wilsher Mozilla

Re: [sqlite] SQLite Crashes

w allocator we switched to may have landed around the time we started seeing this. I'll look into it further. Cheers, Shawn Wilsher Mozilla Developer [1] https://bugzilla.mozilla.org/show_bug.cgi?id=408518 ___ sqlite-users mailing list sqlite-users@sql

[sqlite] New crashes with SQLite 3.5.7

Hey all, Mozilla has recently upgraded to sqlite 3.5.7, and we've suddenly gotten a lot of crashes. The mozilla bug report is here: https://bugzilla.mozilla.org/show_bug.cgi?id=424163 We haven't looked into it to much, but I figured I'd point it out to so you were aware of it. Cheers, Shawn

Re: [sqlite] New crashes with SQLite 3.5.7

ains=sqlite3BitvecSet=sqlite_value=1 Example from one crash report (beware, really large html file): http://bonsai.mozilla.org/cvsblame.cgi?file=mozilla/db/sqlite3/src/sqlite3.c=1.14=22783#22783 > A reproducible test case would, of course, be ideal. That might be a bit difficult to reproduce.

[sqlite] SQLITE_LOCKED behavior

database pointers, one for each thread. Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLITE_LOCKED behavior

> Are you using a shared cache? You can get also get SQLITE_LOCKED when > using a shared cache. See section 2.2 of > . > > I've not used a shared cache myself. One day I was wondering if I > needed to worry about handling SQLITE_LOCKED errors and I

Re: [sqlite] SQLITE_LOCKED behavior

> I am not aware of any reason why you cannot retry an SQLITE_LOCKED > error after a delay, however. Have you actually tried doing that? > Is it giving you trouble? Attempting to retry after it being issues results in SQLITE_MISUSE being returned. Cheers, Shawn

Re: [sqlite] SQLITE_LOCKED behavior

> Did you call sqlite3_reset() before each retry? Ah, I didn't realize I'd have to do that. When I get SQLITE_BUSY returned, I can just retry it, so I made the wrong assumption that that would work in this case as well. Cheers, Shawn ___ sqlite-users

Re: [sqlite] SQLITE_LOCKED behavior

> Did you call sqlite3_reset() before each retry? Doing this fixed the issue. Thanks! Cheers, Shawn ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Transaction across threads

> 1) If shared, then the second threads insert is part of the transaction and > should succeed. > 2) No. > 3) If the connection is shared between threads, there can only be 1 txn at a > time. The second threads attempt to begin a txn will result in an error that > indicates a txn is already

Re: [sqlite] Proposed incompatible changes to the SQLite VFS layer

p://www.sqlite.org/c3ref/vfs.html Additionally, there are some inconsistencies between those documents (method headers aren't the same), and the vfs.html page doesn't give as detailed (or doesn't even talk about) some of the methods that the 34to35.html page does. Chee

[sqlite] Crash in SQLite [@ syncJournal ]

://bugzilla.mozilla.org/show_bug.cgi?id=432148 More details can be found in the bug. Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] sqlite3_transfer_bindings obsolete?

? What was the rational for removing it. If you need a use case for why Mozilla needs it, I'd be happy to oblige. Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo

Re: [sqlite] sqlite3_transfer_bindings obsolete?

). Cheers, Shawn [1] http://groups.google.com/group/mozilla.dev.planning/browse_thread/thread/045fed0ecba487cc On Tue, May 13, 2008 at 2:18 PM, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > > On May 13, 2008, at 2:05 PM, Shawn Wilsher wrote: > >> I was looking through the documentat

Re: [sqlite] sqlite3_transfer_bindings obsolete?

And a fun follow-up question. Will sqlite3_transfer_bindings transfer bindings across connection objects if the two statements are for two different connections to the same database? Cheers, Shawn On Tue, May 13, 2008 at 2:05 PM, Shawn Wilsher <[EMAIL PROTECTED]> wrote: > I was lookin

Re: [sqlite] sqlite3_transfer_bindings obsolete?

On Sat, May 17, 2008 at 2:39 AM, Dan <[EMAIL PROTECTED]> wrote: >> And a fun follow-up question. Will sqlite3_transfer_bindings transfer >> bindings across connection objects if the two statements are for two >> different connections to the same database? > > No. It will return SQLITE_MISUSE.

Re: [sqlite] sqlite3_transfer_bindings obsolete?

e we'll have to keep track of bound parameters as well now. Cheers, Shawn Wilsher ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

[sqlite] SQLite and Threadsafety (again)

ervatively, I'm assuming yes on all of the above, but I hope I'm wrong for at least some of those. I would, however, expect to have to protect the sqlite3 object when calling sqlite3_prepare_v2. Clarification on this would be greatly appreciated. Cheers, Shawn Wilsher Mozilla

Re: [sqlite] SQLite and Threadsafety (again)

file name > (SQLite database file name), you can get > this behaviour to work transparently for your consumers (I assume you´re not > using directly the sqlite3_* calls inside > your program, you have some kind of high-level abstraction to use them). > > > -Original Message--

Re: [sqlite] Firefox 3 and the SQLite "bug"

It was mentioned in the bug that opening the file with the O_SYNC flag would no longer require fsyncs. Has this been looked into before by sqlite? Cheers, Shawn ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] Firefox 3 and the SQLite "bug"

Thanks! I've posted that information in the bug. Cheers, Shawn On Thu, May 22, 2008 at 4:09 PM, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > > On May 22, 2008, at 9:40 AM, Shawn Wilsher wrote: > >> It was mentioned in the bug that opening the file with the O_SYNC fl

Re: [sqlite] Version number in sqlite3.pc file

On Thu, Jun 5, 2008 at 11:08 AM, Richard Hipp <[EMAIL PROTECTED]> wrote: > My understanding is that firefox uses the amalgamation, not > anything generated from a configure script. The SQLite amalgamation > is checked into their source tree. So I am thinking that FF does > not care about the

Re: [sqlite] SQLite bug on AFP?

On Thu, Jun 5, 2008 at 4:04 PM, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > I think the solution might be as simple as compiling with - > DSQLITE_ENABLE_LOCKING_STYLE=1. This option only works on a Mac. It > enables some Apple-contributed code that does file locking that works > on AFP as well

Re: [sqlite] Accessing SQLite from Javascript in Firefox

What you are looking for is the HTML 5 spec from the WHATWG. This contains a section on using SQL, but it is not yet implemented in Firefox (I think Opera is the only browser that supports it, and only when 9.5 comes out). Cheers, Shawn Wilsher Mozilla Developer On Tue, Jun 10, 2008 at 10:32

[sqlite] PRAGMA temp_store confusion

Hey all, Over at mozilla we are looking into using more temporary tables, and likely want them all to be in memory as opposed to files. I was looking at http://sqlite.org/pragma.html#pragma_temp_store, and noticed the table, which seems to imply that if TEMP_STORE is either zero or not defined,

[sqlite] Setting where AUTOINCREMENT starts?

Hey all, I was wondering if we could set the value that an AUTOINCREMENT starts at for temporary tables. Right now we are looking at having to manage it ourselves, but if we could use sqlite to handle it, as long as it starts at the right value, that would be ideal. Cheers, Shawn

Re: [sqlite] PRAGMA temp_store confusion

On Mon, Jun 30, 2008 at 6:41 PM, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > The default TEMP_STORE is 1, not 0. The default "PRAGMA temp_store" > is 0. TEMP_STORE=1 means that temporary storage defaults to a file > but can be overridden by the temp_store pragma. Alright, cool. > Temporary

[sqlite] SQLite and updating VIEWs

Hey all, I'm working with a partitioned table setup with a permanent table and a temp table with the same columns and indexes. Every X time we dump all the records in the temp table over to the permanent one. In order to make selection queries easier to manage, I've gone and created a view like

Re: [sqlite] SQLite and updating VIEWs

On Tue, Jul 1, 2008 at 3:24 PM, Igor Tandetnik <[EMAIL PROTECTED]> wrote: > CREATE TRIGGER > BEGIN >insert into temp_table >select * from perm_table >where and > ; > >update temp_table set ...; > END; I had thought of this, but I'm pretty sure this will only

Re: [sqlite] SQLite and updating VIEWs

On Tue, Jul 1, 2008 at 3:37 PM, Igor Tandetnik <[EMAIL PROTECTED]> wrote: > They won't fail - they will successfully insert zero records. It's > perfectly valid to run INSERT ... SELECT and have the SELECT part > produce an empty resultset. It simply does nothing. Sorry, I should have been more

Re: [sqlite] SQLite and updating VIEWs

On Tue, Jul 1, 2008 at 4:05 PM, Igor Tandetnik <[EMAIL PROTECTED]> wrote: > Will it? part is supposed to > be false when the data is in fact currently in temp table. A WHERE > clause that is always false will, naturally, produce no records. Fair. I hadn't thought of doing something like that.

[sqlite] Subselect question

Hey all, Quick (and hopefully simple) question regarding subselects in a where clause. Does sqlite cache the values of a subselect so it doesn't have to run the query each time it evaluates a row? Example: SELECT * FROM foo WHERE id NOT IN (SELECT id FROM bar) Cheers, Shawn

Re: [sqlite] Periodical dump of in-memory database into a disk file

You can try to help your issue by running "PRAGMA synchronous = OFF;" after you open your connection. Cheers, Shawn Wilsher Mozilla Developer On Thu, Jul 10, 2008 at 3:04 PM, X Wang <[EMAIL PROTECTED]> wrote: > Hi, I have a sqlite in-memory databse that I want to periodicall

Re: [sqlite] SQLite 3.6.0 coming soon...

I believe there is a typo in Section 1.1 in 1.c. You have "filesyste-specific" where I think you mean "filesystem-specific". Cheers, Shawn On Sat, Jul 12, 2008 at 5:00 PM, D. Richard Hipp <[EMAIL PROTECTED]> wrote: > The current plan is to release SQLite version 3.6.0 on Wednesday, >

[sqlite] New feature suggestion

you think (and if this is even feasible). Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite support stored procedure?

oject. Care to elaborate on this? Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] SQLite and updating VIEWs

Hey all, A month later, I have an updated plan for this with many more details. I'd really appreciate it if folks would take a look and point out any issues that you see. Here's my blog post explaining the current plan with extensive details: http://shawnwilsher.com/archives/169 Cheers, Shawn

[sqlite] Possible View bug

Any advice? Cheers, Shawn Wilsher ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Possible View bug

On Sat, Aug 9, 2008 at 9:39 PM, Igor Tandetnik <[EMAIL PROTECTED]> wrote: > Your trigger uses a curious syntax for SQL INSERT statement, along the > lines of I was hoping it was a bug in my code and not in SQLite. Thanks for spotting my fascinating syntax. Cheers, Shawn

[sqlite] Transactions and Threads

can have it's own transaction pending on the database? Cheers, Shawn Wilsher ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Google Chrome and SQLite3

gt; cool data mining / reports on their surfing habits, or any neat hacks > to Chrome with respect to sqlite? > Firefox also uses SQLite to store it's history and bookmarks. There have been some things done with it - the most recent one that comes to mind is this: http://surfmind.com/muzings/?p

Re: [sqlite] Specifing which index to use. Was: Performance/bug in multikey 'group by' in 3.6.2

So, I am > offering this choice: (1) The ability to select and index with an > error if that index won't work and (2) no new capabilities at all. I can see option (1) being useful to Mozilla, so we'd like to see that if possible. Cheers, Shawn Wilsher Mozilla Developer _

[sqlite] FTS 3 Crash in 3.6.5

Hey all, I seem to have found a crash that is 100% reproducible in SQLite 3.6.5. I'm managed to make a reduced test case in a C file that can be found here: http://files.shawnwilsher.com/2008/11/12/test.c The file is compiled with the following command: gcc sqlite3.c test.c

[sqlite] Thread-safety and sqlite3_stmt objects

, but if SQLite protects it internally, I don't want to add additional overhead by protecting it myself. Could someone please clarify this (and maybe add some documentation)? Cheers, Shawn Wilsher Mozilla Developer ___ sqlite-users mailing list sqlite

Re: [sqlite] Thread-safety and sqlite3_stmt objects

On Fri, Mar 6, 2009 at 9:26 PM, Dan wrote: > Why do you want to use a single sqlite3_stmt* from multiple threads > at the same time? Really the only thing I need to access is sqlite3_sql to copy the statement to another thread. We have an asynchronous API that we expose

Re: [sqlite] Getting SQLITE_BUSY within a transaction and how to handle it

On Mon, Mar 16, 2009 at 10:02 PM, Dennis Volodomanov < dennis.volodoma...@conceiva.com> wrote: > Do I need the finalize the statement and re-prepare it again in the > second thread before trying to step it? Are you at least reseting the statement? I hit this once before, and reseting the

Re: [sqlite] The next release of SQLite....

On Thu, Dec 3, 2009 at 10:26 AM, Tim Romano wrote: > The alternative, NOCASE collation, also does not get me out of the > woods. For some reason in Adobe (and in Mozilla) the index is not used > on LIKE clauses when the column in question has NOCASE collation, though >

Re: [sqlite] undefined reference to sqlite3_mutex_held

See https://bugzilla.mozilla.org/show_bug.cgi?id=533171 (this isn't really a SQLite issue). Cheers, Shawn On Wed, Dec 9, 2009 at 3:32 PM, Daniel Mierswa wrote: > Hi list, > when I try to build the current thunderbird 3.0 release against > sqlite-3.6.21 i get an undefined

Re: [sqlite] undefined reference to sqlite3_mutex_held

On Thu, Dec 10, 2009 at 10:18 AM, Daniel Mierswa wrote: > My concolusion is that the TB folks shouldn't assume that the system > sqlite library was built with debugging symbols or provide a mechanism > to opt out said function call with an easy switch/compiler flag. > Well,

Re: [sqlite] Mozilla's method

Where did you see this? It's inaccurate, and if I can, I'll remove it. If you want to use a proper asynchronous statement execution which wraps your statement[s] in a transaction, you want to use this: https://developer.mozilla.org/En/Storage#Asynchronously Cheers, Shawn Wilsher Mozilla

Re: [sqlite] Mozilla's method

On Thu, Dec 31, 2009 at 9:06 AM, Bert Nelsen wrote: > It's here: > > https://developer.mozilla.org/en/Storage:Performance > Thanks. I've removed the outdated information. Cheers, Shawn ___ sqlite-users mailing list