Re: [sqlite] SQLite v/s SQLite3 Performance Assay

2007-03-13 Thread Nitin Kashyap
Version 3 has a different default safety-level (default FULL) to version 3 (default NORMAL). So if you didn't explicitly set the safety-level during the tests, then version 3 was syncing the disk more often than version 2. I think this might be why version 3 appears slower in Test Case I

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread Vivien Malerba
On 3/12/07, Stef Mientki <[EMAIL PROTECTED]> wrote: If ask the table sturcture, with pragma table_info() I get of course the basic fields, like: CID,Name,Type, And also SOME special values, like Null, DefaultValue, PrimaryKey But NOT the following special values (and probably a lot more)

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread Martin Jenkins
Vivien Malerba wrote: I've already sent a proposal along with a patch some time ago about that, but nobody seemed to care, see http://www.mail-archive.com/sqlite-users@sqlite.org/msg21285.html Vivien, I can't see any patch attached to that post. Perhaps you should resubmit it? And I'll guess

[sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ralf Junker
>But what about: > >I am very interested to know if it would be possible to use an FTS indexing >module to store the inverted index only, but >not the document's text. This would safe disk space if the text to index is >stored on disk rather than inside the database. This is possible with just

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ion Silvestru
Thank you. Just a question: did you eliminated stop-words in your tests? >Concluding: Given the great database size savings possible by separating full >text index from data storage, I wish that >developers would consider adding such an option to the SQLite FTS interface. If such an option

Re[2]: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ion Silvestru
>Just a question: did you eliminated stop-words in your tests? Sorry, you specified that you indexed source code files, so no stop-words are applicable here. - To unsubscribe, send email to [EMAIL PROTECTED]

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ion Silvestru
To Ralf: >As a side effect, the offsets() and snippet() functions stopped working, as >they seem to rely on the presence of the full document text in the current >implementation. Did you tested "phrase" searching on the index-only version, didn't this kind of search rely on offsets()?

RE: [sqlite] SQLite v/s SQLite3 Performance Assay

2007-03-13 Thread Doug Nebeker
Be aware that the Windows GetTickCount call has a resolution of 10 to 15 ms on most machines, so that could throw throw your timings off if you're timing each individual test case as it appears below. To get better timer resolution, use QueryPerformanceCounter. Now, would that make SQLite3 looks

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread drh
Ion Silvestru <[EMAIL PROTECTED]> wrote: > To Ralf: > > >As a side effect, the offsets() and snippet() functions stopped working, as > >they seem to rely on the presence of the full document text in the current > >implementation. > > Did you tested "phrase" searching on the index-only version,

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread Dennis Cote
Vivien Malerba wrote: I've already sent a proposal along with a patch some time ago about that, but nobody seemed to care, see http://www.mail-archive.com/sqlite-users@sqlite.org/msg21285.html Vivien, This mailing list does not pass attachments. A patch such as your is best handled by

Re: [sqlite] SQLite v/s SQLite3 Performance Assay

2007-03-13 Thread drh
"Nitin Kashyap" <[EMAIL PROTECTED]> wrote: > > My Intentions are towards exploring the reason behind these differences; > and what can be done to counter these performance differences. I'm > seeking some pointers from the Community. > I use SQLite for a lot of different things (as you would

Re: [sqlite] SQLite v/s SQLite3 Performance Assay

2007-03-13 Thread Nitin Kashyap
Hi Doug, My bad... the getTickCount() in the snippet is basically a wrapper over ftime call, and the same is used on the linux platform also for timing. time_t getTickCount() { timeb tm = {0}; ftime(); return ( (tm.time*1000) + ((time_t)tm.millitm) ); } Thanks & Regards Nitin K

[sqlite] Degrouping, desummarizing or integrating headings

2007-03-13 Thread T
Hi All, I come across a fair bit of source data in summary format, where the one field's values are used as a heading for a group of records for which it applies. For instance, this shopping list: Aisle Product Cost Dairy Milk $2 Cream$1

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread Vivien Malerba
On 3/13/07, Martin Jenkins <[EMAIL PROTECTED]> wrote: Vivien Malerba wrote: > I've already sent a proposal along with a patch some time ago about > that, but nobody seemed to care, see > http://www.mail-archive.com/sqlite-users@sqlite.org/msg21285.html Vivien, I can't see any patch attached to

Re: [sqlite] Degrouping, desummarizing or integrating headings

2007-03-13 Thread P Kishor
On 3/13/07, T <[EMAIL PROTECTED]> wrote: Hi All, I come across a fair bit of source data in summary format, where the one field's values are used as a heading for a group of records for which it applies. For instance, this shopping list: Aisle Product Cost Dairy Milk

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Scott Hess
On 3/13/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: Ion Silvestru <[EMAIL PROTECTED]> wrote: > To Ralf: > >As a side effect, the offsets() and snippet() functions stopped working, > >as they seem to rely on the presence of the full document text in the > >current implementation. > > Did you

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread drh
"Vivien Malerba" <[EMAIL PROTECTED]> wrote: > On 3/13/07, Martin Jenkins <[EMAIL PROTECTED]> wrote: > > Vivien Malerba wrote: > > > I've already sent a proposal along with a patch some time ago about > > > that, but nobody seemed to care, see > > >

[sqlite] date/time implementation question

2007-03-13 Thread Rafi Cohen
Hi, I hope this question is not off-topic for this list. I'm recieveing, occasionally, a .csv file from a source which I need to process accordcing to some criteria and either insert, delet or update it's rows into a database. One of it's criterias is date comparison. In other words, proceeding

Re: [sqlite] date/time implementation question

2007-03-13 Thread Dennis Cote
Rafi Cohen wrote: Hi, I hope this question is not off-topic for this list. I'm recieveing, occasionally, a .csv file from a source which I need to process accordcing to some criteria and either insert, delet or update it's rows into a database. One of it's criterias is date comparison. In other

[sqlite] LEMON question

2007-03-13 Thread Cesar Rodas
I want to know if I can here public some LEMON PARSER examples that I have done... because as i far i know LEMON is maintained into SQLite project. Best Regards -- Cesar Rodas http://www.cesarodas.com/ Mobile Phone: 595 961 974165 Phone: 595 21 645590 [EMAIL PROTECTED] [EMAIL PROTECTED]

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread Stef Mientki
You should also consider how your change might effect backwards compatibility. The last time that table_info() was modified, the Ruby-On-Rails community got really upset. I'm rather of a mind to leave table_info() alone. Forgive my ignorance, I'm just a beginner in databases, but what

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ralf Junker
Ion Silvestru wrote: >Just a question: did you eliminated stop-words in your tests? No, I did not eliminate any stop-words. The two test runs were equal except for the small changes in FTS 2. My stop words question was not intended for source code but for human language texts. Ralf

Re: [sqlite] FTS: index only, no text storage - Was: [sqlite] FTS: Custom Tokenizer / Stop Words

2007-03-13 Thread Ralf Junker
Hello Scott, I was hoping that you would read my message, many thanks for your reply! >UPDATE and DELETE need to have the previous document text, because the >docids are embedded in the index, and there is no docid->term index >(or, put another way, the previous document text _is_ the

Re: [sqlite] Degrouping, desummarizing or integrating headings

2007-03-13 Thread T
Thanks Puneet for your response. this is a programming problem and not necessarily a SQLite problem. Well, I can program it, but hope that instead there's a way to do it within SQL. Nevertheless, you don't specify how you are getting this summary data... are they in a database? are they

[sqlite] MingW32 help wanted

2007-03-13 Thread Stefan de Konink
Hello, I have found this post: http://marc.10east.com/?l=sqlite-users=115689163614925=2 My target is to get sqlite compiled on my host platform i686 and my target platform mingw32. Could someone get a step by step manual to get the 'precious' dll/.a? When removing the os_unix.c from the

Re: [sqlite] MingW32 help wanted

2007-03-13 Thread Stefan de Konink
Mike Frysinger wrote: On Tuesday 13 March 2007, Stefan de Konink wrote: My target is to get sqlite compiled on my host platform i686 and my target platform mingw32. Could someone get a step by step manual to get the 'precious' dll/.a? well, this could be autotoolized and force people to do

Re: [sqlite] MingW32 help wanted

2007-03-13 Thread Scott Hess
I took Makefile.linux-gcc, and made the obvious changes (there are mingw lines all over in there). EXE = .exe, SO =dll, SHPREFIX = , [that was nothing for that setting], and TCC, AR, and RANLIB set to the path to the appropriate commands from mingw. I should warn that I haven't actually built

Re: [sqlite] MingW32 help wanted

2007-03-13 Thread Stefan de Konink
Scott Hess wrote: I took Makefile.linux-gcc, and made the obvious changes (there are mingw lines all over in there). EXE = .exe, SO =dll, SHPREFIX = , [that was nothing for that setting], and TCC, AR, and RANLIB set to the path to the appropriate commands from mingw. I should warn that I

Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT

2007-03-13 Thread COS
Hi, - Original Message - From: "Stef Mientki" <[EMAIL PROTECTED]> To: Sent: Tuesday, March 13, 2007 3:47 PM Subject: Re: [sqlite] Pragma table_info(), why no fields like UNIQUE, AUTOINCREMENT > > > > > > You should also consider how your change might effect >

[sqlite] retrieving data from multiple tables

2007-03-13 Thread Kirrthana M
Hi all, I have created a database with four tables,i have to search and retrieve data from all the four tables based on the entry i get from the previous table and display all the entries,could anybody tell how to do it. Regards Kirrthana