Re: [sqlite] SQLite performance for 10 Million Records

2006-06-19 Thread Brett Wilson
count(*) is pretty slow in sqlite because it basically does select * and then counts the results. This means it's looking through your whole big file. You can come up with some tricks like keeping a separate count up-to-date with triggers. There have been some old threads on optimizing count

[sqlite] Network-based DB performance for Mozilla

2005-09-13 Thread Brett Wilson
Hi everybody, I'm working on replacing a lot of Firefox's storage systems to use sqlite. It has been going well so far except for one issue. The database file is stored in the user's Mozilla profile directory. In companies and Universities using Linux, this directory is often hosted over the

Re: [sqlite] Network-based DB performance for Mozilla

2005-09-13 Thread Brett Wilson
. Like SQLite, it's a great piece of > software and I'm grateful to be able to use it. > > > > Brett Wilson wrote: > > Hi everybody, > > > > I'm working on replacing a lot of Firefox's storage systems to use > > sqlite. It has been going well so far exc

Re: [sqlite] Network-based DB performance for Mozilla

2005-09-13 Thread Brett Wilson
I'm still concerned about the warnings on the web page about some networked file systems not supporting locking. There will be multiple DB connections from the same process. They might even be multithreaded. Might we have a problem in this case? Brett On 9/13/05, Roger Binns <[EMAIL PROTECTED]>

Re: [sqlite] Network-based DB performance for Mozilla

2005-09-13 Thread Brett Wilson
The patch says "improve and support locking on the OSX platform (as well as others)". I see at least some enums in there for MSDOS NFS, etc. Can anybody clarify whether this works on other platforms as well? Basically, the question I have about this patch is: if I access the DB from more than

[sqlite] Cleared pager cache

2005-10-04 Thread Brett Wilson
Hi, I'm working on integrating sqlite into Mozilla. The problem is that some Linux users have their profile (and hence, database) over a network. Ignoring the safety issues for a moment, I'm trying to get good performance. Sometimes it takes the network "a while" to read a page, so I'm trying to

Re: [sqlite] Left Outer Joins

2005-10-06 Thread Brett Wilson
I believe saying "GROUP BY a.primarykey" clause at the end of your query will do what you want. It's explained in http://sqlite.org/lang_select.html There might also be better ways of doing it, but I'm not an expert. Brett On 10/6/05, Robert L Cochran <[EMAIL PROTECTED]> wrote: > Hi -- > > I'm

Re: [sqlite] Very Slow delete times on larger databases, please help!

2005-10-26 Thread Brett Wilson
Vacuuming is just slow. I don't think there is much you can do except don't do it unless you really need it, and don't turn on autovacuum. Brett On 10/26/05, R S <[EMAIL PROTECTED]> wrote: > In my case Delete happens reasonably OK but Vaccuuming takes incredibly > long? > > > On 10/21/05, Allan,

Re: [sqlite] Version 3.3.0 (alpha)

2006-01-21 Thread Brett Wilson
Does anybody know if there anything special we have to do to get the new boolean optimization? Does it apply to any 0/1 integer values you put in a cell, or does the column have to be declared as BOOLEAN? Thanks, Brett On 1/10/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > SQLite version

[sqlite] Suggestions for optimizing delete

2006-02-27 Thread Brett Wilson
Hi, I'm working on using sqlite for Firefox's bookmarks and history system. We need to expire history older than N days when the browser shuts down. It's currently slower than I would like and I'd appreciate any tricks you might be able to suggest. Database layout: We have a table of URLs and

Re: [sqlite] Help needed to diagnose "NOT IN" query

2006-03-14 Thread Brett Wilson
David, I asked a similar question, and here is drh's response to me, adapted to your situation. I think it is probably applicable to you as well. I'm not sure this is the type of query that can be made to go really fast no matter what. I actually haven't gotten around to doing this yet, so I

Re: [sqlite] Mozilla and SQLlite

2006-03-23 Thread Brett Wilson
You could write a standalone XUL application and run it using XULRunner, for example. That would link directly to sqlite. If you were thinking of local web pages, you would need to write some kind of fake web server running on a local port that would link to sqlite. Brett On 3/23/06, Vishal