Re: [sqlite] why select distinct does not use index?

2007-11-08 Thread Ian Frosst
In the call to create index, it looks like you're creating a duplicate index on [id], which I believe references the default btree id (also called rowid.) If you change that line to: CREATE INDEX [by_id] ON [profile_data] ([profile_id]); your index should be used (though whether indexes get

[sqlite] why select distinct does not use index?

2007-11-08 Thread Maxim V. Shiyanovsky
Suppose I have simple table: CREATE TABLE [profile_data] (   [profile_id] INTEGER,   [version] INTEGER); CREATE INDEX [by_id] ON [profile_data] ([id]); Why sqlite> explain query plan    ...> select distinct(profile_id) from profile_data; 0|0|TABLE profile_data Does not use index?

[sqlite] Is possible put a password in database ?

2007-11-08 Thread paulito santana
Hei all, is possible i put a password in the file that represents a SQLite database ?? There is any instruction in SQLite command line that allows this ? Regards, Paulito

Re: [sqlite] Is possible put a password in database ?

2007-11-08 Thread Trevor Talbot
On 11/8/07, paulito santana <[EMAIL PROTECTED]> wrote: > is possible i put a password in the file that represents a SQLite database > ?? There is any instruction in SQLite command line that allows this ? No. drh sells a version of SQLite with encryption support, and some others maintain their

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread RaghavendraK 70574
Try this, use mmap (i assume u'r db is readonly)this is much faster and better than ifstream read. Also ifstream read can keep the data in cache as long as no other serious i/o occurs. U need to accept it as we work with Virtual Mem or write your own FileSystem which is mem based and short

[sqlite] sqlite for 16 bits microcontroler x186

2007-11-08 Thread Felix
Hello, I would use sqlite in an embedded DOS system ( intel 16 bits processor ) . Do you think that is possible or sqlite work only on 32/64 bits systems? Do you know an alternative to sqlite? Thank you for your help. Felix

[sqlite] Can sqlite3_reset() ever fail?

2007-11-08 Thread Ralf Junker
Hello, I wonder if sqlite3_reset() can ever fail. In particular, does sqlite3_reset() always reset the statement even if it returns an error code? >From the documentation and mailing list, my understanding is that >sqlite3_reset() errors always relate to the latest (or possibly ongoing) VM

Re: [sqlite] Is possible put a password in database ?

2007-11-08 Thread Jonas Sandman
How much is it for the encrypted version? Regards, Jonas On Nov 8, 2007 1:12 PM, Trevor Talbot <[EMAIL PROTECTED]> wrote: > On 11/8/07, paulito santana <[EMAIL PROTECTED]> wrote: > > > is possible i put a password in the file that represents a SQLite database > > ?? There is any instruction in

RE: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Julien Renggli
Thanks for your quick answer. RaghavendraK 70574 wrote: > Try this, use mmap > (i assume u'r db is readonly)this is much faster and > better than ifstream read. Also ifstream read can keep the data in cache as long as no other serious > i/o occurs. Our DB is readwrite, though in my example

Re: [sqlite] Is possible put a password in database ?

2007-11-08 Thread Trevor Talbot
On 11/8/07, Jonas Sandman <[EMAIL PROTECTED]> wrote: > How much is it for the encrypted version? The info on that is here: http://www.hwaci.com/sw/sqlite/prosupport.html - To unsubscribe, send email to [EMAIL PROTECTED]

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Trevor Talbot
On 11/8/07, Julien Renggli <[EMAIL PROTECTED]> wrote: > As I said, the "nasty" trick works and we'll live with it (writing our > own FileSystem is not an option). We would just like to understand > better what's happening, to know why and when the "first run" is so much > slower. And should we

Re: [sqlite] why select distinct does not use index?

2007-11-08 Thread Joe Wilson
--- "Maxim V. Shiyanovsky" <[EMAIL PROTECTED]> wrote: > Suppose I have simple table: > > CREATE TABLE [profile_data] ( > [profile_id] INTEGER, > [version] INTEGER); > > CREATE INDEX [by_id] ON [profile_data] ([id]); > > Why > > sqlite> explain query plan >...> select

RE: [sqlite] is safe to use the same database connection at the same time in more than one thread?

2007-11-08 Thread Salles, Joaquim Campos
-Original Message- >From: Salles, Joaquim Campos [mailto:[EMAIL PROTECTED] >Sent: quinta-feira, 8 de novembro de 2007 11:45 >To: sqlite-users@sqlite.org >Subject: [sqlite] is safe to use the same database connection at the same >time in more than one thread? >Is safe to use the same

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread drh
"Trevor Talbot" <[EMAIL PROTECTED]> wrote: > Beyond that, I'm not aware of anything that would help. > All good advice. But you left off the obvious: Get a faster disk drive. ;-) -- D. Richard Hipp <[EMAIL PROTECTED]>

[sqlite] is safe to use the same database connection at the same time in more than one thread?

2007-11-08 Thread Salles, Joaquim Campos
Hello, Is safe to use the same database connection at the same time in more than one thread? The bellow like that is safe: http://www.sqlite.org/34to35.html "Restrictions on the use of the same database connection by multiple threads have been dropped. It is now safe for multiple threads to

Re: [sqlite] is safe to use the same database connection at the same time in more than one thread?

2007-11-08 Thread drh
"Salles, Joaquim Campos" <[EMAIL PROTECTED]> wrote: > Hello, > > Is safe to use the same database connection at the same time in more > than one thread? The bellow like that is safe: > > http://www.sqlite.org/34to35.html > > "Restrictions on the use of the same database connection by multiple

RE: [sqlite] Is possible put a password in database ?

2007-11-08 Thread Samuel R. Neff
Paulito, I believe from a previous post you're using the System.Data.SQLite wrapper, right? That provides Windows-only encryption built in to the wrapper. HTH, Sam --- We're Hiring! Seeking a passionate developer to join our team building Flex based

RE: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Renaud HUILLET
Is the mmap option part of sqlite or do we need to change the sqlite code ? If so, has somebody here already tried it ? Any source available ? What 's the order of improvement ? Renaud > Date: Thu, 8 Nov 2007 15:54:35 +0500 > From: [EMAIL PROTECTED] > To: sqlite-users@sqlite.org >

Re: [sqlite] sqlite for 16 bits microcontroler x186

2007-11-08 Thread Joe Wilson
--- Felix <[EMAIL PROTECTED]> wrote: > I would use sqlite in an embedded DOS system ( intel 16 bits processor ) . > > Do you think that is possible or sqlite work only on 32/64 bits systems? I could be wrong, but I think sqlite expects that int and pointers are at least 32 bit. See if you can

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Mark Spiegel
As Trevor cautioned, you run the risk of really impacting the other applications running on the system and the system itself. As you fill up the Windows cache manager with your file, you will push out other relevant data including data that the OS may be using. This will cause applications

Re[2]: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Teg
Hello Renaud, Thursday, November 8, 2007, 9:11:41 AM, you wrote: RH> Is the mmap option part of sqlite or do we need to change the sqlite code ? RH> If so, has somebody here already tried it ? Any source available ? RH> What 's the order of improvement ? RH> Renaud >> Date: Thu, 8 Nov

RE: [sqlite] is safe to use the same database connection at the same time in more than one thread?

2007-11-08 Thread Salles, Joaquim Campos
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: quinta-feira, 8 de novembro de 2007 12:04 To: sqlite-users@sqlite.org Subject: Re: [sqlite] is safe to use the same database connection at the same time in more than one thread? >Yes. The wiki page was correct

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Joe Wilson
This disk cache effect is pretty well known on this list. Mozilla/Firefox also uses a similar technique for its sqlite database: http://developer.mozilla.org/en/docs/Storage:Performance#Priming_the_cache They go to the extra step of populating the sqlite page cache with some custom code:

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread PokerAce
I am using Windows Task Manager to determine memory usage. I minimize my application (which causes the task manager to show a more accurate measurement of memory used) and still the memory usage is enormous. On Nov 8, 2007 11:55 AM, Roger Binns <[EMAIL PROTECTED]> wrote: > -BEGIN PGP

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Joe Wilson
--- [EMAIL PROTECTED] wrote: > We are looking at renovating the design of the SQLite > website and would love to have suggestions from the > community. If you have any ideas on how to improve > the SQLite website, please constribute either to the > mailing list or directly to me. Prize giveaway

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Michael Schlenker
[EMAIL PROTECTED] schrieb: We are looking at renovating the design of the SQLite website and would love to have suggestions from the community. If you have any ideas on how to improve the SQLite website, please constribute either to the mailing list or directly to me. Among the comments

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread PokerAce
"Are you certain it's sqlite RAM, and not your application?" Yes, we are also testing PostgreSQL and MySQL and the application memory with those stays < 20 mb. "Is your temp_store set to memory or file?" I have not changed this, so it's whatever the default is. "How are you performing your

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Rich Shepard
On Thu, 8 Nov 2007, Stephan Beal wrote: google code award implies that it's free (doesn't it?) Only to people not used to open source. "Release early, release often." Definitely not. Its simplicity is its main beauty. Stephan, Good comments from your point of view. However, what the

RE: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Evans, Mark (Tandem)
I love the website. Suggested improvements: - link to the users site from home: http://www.mail-archive.com/sqlite-users@sqlite.org/info.html - a publicity page that contains links to interviews, reviews, etc. - expand the list of things that cannot be done with virtual tables (it lists triggers

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread Joe Wilson
--- PokerAce <[EMAIL PROTECTED]> wrote: > I'm trying to see if SQLite is suitable for large databases ( > 1 gb, > millions of rows in each of several tables). Initially, the memory usage > was outrageous (~ 500 mb for a 1.3 gb db), but I got that down to < 30 mb by > setting the cache size to 0

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread drh
PokerAce <[EMAIL PROTECTED]> wrote: > I'm trying to see if SQLite is suitable for large databases ( > 1 gb, > millions of rows in each of several tables). Initially, the memory usage > was outrageous (~ 500 mb for a 1.3 gb db), but I got that down to < 30 mb by > setting the cache size to 0 and

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread bartsmissaert
What could be interesting is a listing of all the ways SQLite is used and for users to upload their details with a number of fixed fields like: short description, size of database, number of users, commercial/non-commercial, platform/OS, programming language, wrapper, satisfaction with the

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread PokerAce
If you have to set that manually, it was not set. I am using version 3.5.2. I am doing tens of thousands of transactions, each without ~30 separate INSERTs. On Nov 8, 2007 11:40 AM, <[EMAIL PROTECTED]> wrote: > PokerAce <[EMAIL PROTECTED]> wrote: > > I'm trying to see if SQLite is suitable

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread Joe Wilson
--- PokerAce <[EMAIL PROTECTED]> wrote: > "Are you certain it's sqlite RAM, and not your application?" > > Yes, we are also testing PostgreSQL and MySQL and the application memory > with those stays < 20 mb. You're not using the sqlite3 API directly, are you? If that's the case, I think your

RE: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Wilson, Ron
QFT I agree with both Stephan *and* Rich. It would be great if the site stayed clean, white, and straightforward. I don't personally have difficulty selling SQLite to my boss because we've used it in many successful projects, but I can see how the current site may not measure up to so-called

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 [EMAIL PROTECTED] wrote: > If you have any ideas on how to improve > the SQLite website, please constribute either to the > mailing list or directly to me. "Search" is missing on the main page. I always have to click around a bit until a page with

RE: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Igor Sereda
I'm new to this list and to the SQLite website, so my feedback is more of the "first impression" kind. And that impression is: the site is ok. It is clear, simple, with almost anything I need reachable through one or two clicks. The things I would probably do is place a google search field

[sqlite] SQLite and Large Databases

2007-11-08 Thread PokerAce
I'm trying to see if SQLite is suitable for large databases ( > 1 gb, millions of rows in each of several tables). Initially, the memory usage was outrageous (~ 500 mb for a 1.3 gb db), but I got that down to < 30 mb by setting the cache size to 0 and setting a low soft heap limit. That works

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Stephan Beal
On Nov 8, 2007 5:29 PM, <[EMAIL PROTECTED]> wrote: > We are looking at renovating the design of the SQLite > website and would love to have suggestions from the > community. If you have any ideas on how to improve > the SQLite website, please constribute either to the > mailing list or directly

[sqlite] Suggests for improving the SQLite website

2007-11-08 Thread drh
We are looking at renovating the design of the SQLite website and would love to have suggestions from the community. If you have any ideas on how to improve the SQLite website, please constribute either to the mailing list or directly to me. Here are some links to competing database products

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 PokerAce wrote: > Initially, the memory usage > was outrageous (~ 500 mb for a 1.3 gb db), How are you measuring memory usage? You have to be very careful as most operating system tools will report a number greater than the size of all current

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread John Stanton
Rich Shepard wrote: On Thu, 8 Nov 2007, Stephan Beal wrote: google code award implies that it's free (doesn't it?) Only to people not used to open source. "Release early, release often." Definitely not. Its simplicity is its main beauty. Stephan, Good comments from your point of

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread PokerAce
Actually, I am. I abstract the database communication in my application, but I access each database using their native API. On Nov 8, 2007 12:44 PM, Joe Wilson <[EMAIL PROTECTED]> wrote: > --- PokerAce <[EMAIL PROTECTED]> wrote: > > "Are you certain it's sqlite RAM, and not your application?"

Re: [sqlite] SQLITE_OMIT_MEMORY_ALLOCATION

2007-11-08 Thread drh
Mark Spiegel <[EMAIL PROTECTED]> wrote: > I just started looking at 3.5.2 and notice that support for > SQLITE_OMIT_MEMORY_ALLOCATION was removed. This is a problem for me. > Is there some reasoning behind this? Yes. We are doing a lot of experimental work on the memory allocation. See

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread P Kishor
Hi Richard, I might be in a minority on this list for suggesting that the SQLite website could indeed become more helpful and informative through a redesign. I am not suggesting that the redesign necessarily be focused on attractiveness, although, there can be some correlation in ease of use and

[sqlite] library versioning

2007-11-08 Thread Filipe Fernandes
I've noticed the 'Suggests for improving the SQLite website' e-mail and point number (4) that drh made was the frequent releases of the sqlite library make the library look bad. I'm quite happy at the release rate and believe as one of the respondents to the thread mentioned that 'release early,

Re[2]: [sqlite] SQLite and Large Databases

2007-11-08 Thread Teg
Hello Trevor, Thursday, November 8, 2007, 5:48:59 PM, you wrote: TT> On 11/8/07, PokerAce <[EMAIL PROTECTED]> wrote: >> I am using Windows Task Manager to determine memory usage. I minimize my >> application (which causes the task manager to show a more accurate >> measurement of memory used)

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Trevor Talbot
The documentation page is too scattered, and needs to be categorized: short bits, like the intro and features lists; reference material, like the SQL syntax and API pages; and detailed discussion, like the locking methods and the like. I echo P Kishor's comment that the date/time functions need

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Liam Healy
I think the documentation section needs to be organized. I count over two dozen links in a simple list with no apparent organization. Some (like "copyright") might be best under some other heading, like downloading. Some are minor topics, or of transient interest, such as moving from 3.4 to

Re: [sqlite] Suggests for improving the SQLite website

2007-11-08 Thread Richard Klein
[EMAIL PROTECTED] wrote: We are looking at renovating the design of the SQLite website and would love to have suggestions from the community. If you have any ideas on how to improve the SQLite website, please constribute either to the mailing list or directly to me. o The 'contrib' section

Re: [sqlite] SQLITE_OMIT_MEMORY_ALLOCATION

2007-11-08 Thread Mark Spiegel
I'm sure I can use some #defines to point to my own malloc, realloc, and free routines. Unfortunately, it may be some time before I get to this so I'll have to stick with 3.5.1 for now. Before I do that, I'm going to have to study the later source to try to get a better understanding of what

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread drh
PokerAce <[EMAIL PROTECTED]> wrote: > I am using Windows Task Manager to determine memory usage. I minimize my > application (which causes the task manager to show a more accurate > measurement of memory used) and still the memory usage is enormous. > > Recompile version 3.5.2 with

Re: [sqlite] SQLite and Large Databases

2007-11-08 Thread Nuno Lucas
On Nov 8, 2007 5:04 PM, PokerAce <[EMAIL PROTECTED]> wrote: > I am using Windows Task Manager to determine memory usage. I minimize my > application (which causes the task manager to show a more accurate > measurement of memory used) and still the memory usage is enormous. Windows Task Manager

Re[2]: [sqlite] SQLite and Large Databases

2007-11-08 Thread Teg
Hello drh, Thursday, November 8, 2007, 3:03:07 PM, you wrote: dhc> PokerAce <[EMAIL PROTECTED]> wrote: >> I am using Windows Task Manager to determine memory usage. I minimize my >> application (which causes the task manager to show a more accurate >> measurement of memory used) and still the

Re: [sqlite] Disk caching impacts performance.

2007-11-08 Thread Michael Scharf
[EMAIL PROTECTED] wrote: "Trevor Talbot" <[EMAIL PROTECTED]> wrote: Beyond that, I'm not aware of anything that would help. All good advice. But you left off the obvious: Get a faster disk drive. ;-) ...which does not really help unless you buy a very expensive flash disk drive. How