Re: [sqlite] Read only scaling optimization

2011-08-11 Thread Simon Slavin
On 11 Aug 2011, at 9:51pm, Drew Kozicki wrote: > Unfortunately reading from disk appears not to be the problem. Even at 32 > threads the IO appears to be very minimal. Our inability to scale appears to > be caused by a mutex in the caching. My CPU usage is at 30% and my disk is > near silent

Re: [sqlite] Read only scaling optimization

2011-08-11 Thread Drew Kozicki
I'll try this. Unfortunately reading from disk appears not to be the problem. Even at 32 threads the IO appears to be very minimal. Our inability to scale appears to be caused by a mutex in the caching. My CPU usage is at 30% and my disk is near silent watching the performance monitor. This is on

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Abhinav Upadhyay
On Fri, Aug 12, 2011 at 12:28 AM, Richard Hipp wrote: > On Thu, Aug 11, 2011 at 2:48 PM, Abhinav Upadhyay < > er.abhinav.upadh...@gmail.com> wrote: > >> On Fri, Aug 12, 2011 at 12:05 AM, Michael Stephenson >> wrote: >> > If you use INTEGER PRIMARY KEY,

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Richard Hipp
On Thu, Aug 11, 2011 at 2:48 PM, Abhinav Upadhyay < er.abhinav.upadh...@gmail.com> wrote: > On Fri, Aug 12, 2011 at 12:05 AM, Michael Stephenson > wrote: > > If you use INTEGER PRIMARY KEY, that column becomes your rowids; this > does > > not create a new, separate column

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Abhinav Upadhyay
On Fri, Aug 12, 2011 at 12:05 AM, Michael Stephenson wrote: > If you use INTEGER PRIMARY KEY, that column becomes your rowids; this does > not create a new, separate column in addition to the rowid column. Indeed, but the INTEGER PRIMARY KEY column would count as a user

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Michael Stephenson
If you use INTEGER PRIMARY KEY, that column becomes your rowids; this does not create a new, separate column in addition to the rowid column. -Original Message- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Abhinav Upadhyay Sent: Thursday,

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Abhinav Upadhyay
On Thu, Aug 11, 2011 at 11:14 PM, Igor Tandetnik wrote: > On 8/11/2011 1:35 PM, Abhinav Upadhyay wrote: >> The documentation page of the VACUUM command says that "The VACUUM >> command may change the ROWIDs of entries in any tables that do not >> have an explicit INTEGER

Re: [sqlite] Fwd: Case Sensitive FTS searches.

2011-08-11 Thread Scott Hess
On Thu, Aug 11, 2011 at 8:57 AM, Dennis Suehr wrote: > After some digging through the sqlite3 source code, I came across the code > for the ICU tokenizer.  After enabling that and then commenting out the one > line where u_foldCase() is called, i.e. icuOpen(), I retested and >

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Abhinav Upadhyay
On Thu, Aug 11, 2011 at 11:15 PM, Simon Slavin wrote: > > On 11 Aug 2011, at 6:35pm, Abhinav Upadhyay wrote: > >> The documentation page of the VACUUM command says that "The VACUUM >> command may change the ROWIDs of entries in any tables that do not >> have an explicit

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Igor Tandetnik
On 8/11/2011 1:35 PM, Abhinav Upadhyay wrote: > The documentation page of the VACUUM command says that "The VACUUM > command may change the ROWIDs of entries in any tables that do not > have an explicit INTEGER PRIMARY KEY." So what are the possible cases > in which the ROWIDs might change ?

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Richard Hipp
On Thu, Aug 11, 2011 at 1:35 PM, Abhinav Upadhyay < er.abhinav.upadh...@gmail.com> wrote: > Hi, > > The documentation page of the VACUUM command says that "The VACUUM > command may change the ROWIDs of entries in any tables that do not > have an explicit INTEGER PRIMARY KEY." So what are the

Re: [sqlite] Use of VACUUM

2011-08-11 Thread Simon Slavin
On 11 Aug 2011, at 6:35pm, Abhinav Upadhyay wrote: > The documentation page of the VACUUM command says that "The VACUUM > command may change the ROWIDs of entries in any tables that do not > have an explicit INTEGER PRIMARY KEY." So what are the possible cases > in which the ROWIDs might change

Re: [sqlite] sqlite3_wal_checkpoint wrror

2011-08-11 Thread Richard Hipp
On Thu, Aug 11, 2011 at 1:03 PM, Lisa Davey wrote: > Hi, reinstalling itunes didn't work. More info on the error, the label on > the error is "AppleSyncNotifier.exe-Entry Point Not Found" Perhaps try this: https://discussions.apple.com/message/15712311#15712311 > > > >

[sqlite] Use of VACUUM

2011-08-11 Thread Abhinav Upadhyay
Hi, The documentation page of the VACUUM command says that "The VACUUM command may change the ROWIDs of entries in any tables that do not have an explicit INTEGER PRIMARY KEY." So what are the possible cases in which the ROWIDs might change ? Thanks Abhinav

Re: [sqlite] SQLite with 10M record

2011-08-11 Thread Sumit Gupta
Hello, You are Absolutely right on "if it ain't broke don't fix it". However said software is indeed broken on 32bit machine. When software try to load couple of XML together it won't load and goes out of memory. Even if PC has 700 MB free memory, However for some strange reason it works on 64bit

[sqlite] Fwd: Case Sensitive FTS searches.

2011-08-11 Thread Dennis Suehr
Hello again, After some digging through the sqlite3 source code, I came across the code for the ICU tokenizer. After enabling that and then commenting out the one line where u_foldCase() is called, i.e. icuOpen(), I retested and case-sensitive searching now seems to work as expected for FTS. I

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
It`s so hard for me. I'll be very grateful :jumping: -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32243061.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users mailing list

[sqlite] Case Sensitive FTS searches.

2011-08-11 Thread Dennis Suehr
Hello, I need to implement case-SENSITIVE searching for an FTS(4) table. As near as I can determine, that would seem to require a new user-defined tokenizer. I am hopeful that one or more of you might respond with hints, insights, experience, etc. which might aid me toward that end.

Re: [sqlite] Constraint failed infos

2011-08-11 Thread Richard Hipp
On Thu, Aug 11, 2011 at 10:09 AM, Pavel Ivanov wrote: > This is a known issue and it has an open ticket: > http://www.sqlite.org/src/tktview?name=23b2128201. > It is a known "feature request". It is not a bug. There is a lot of additional overhead involved in keeping track

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
please kill me %-| -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32242440.html Sent from the SQLite mailing list archive at Nabble.com. ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] Constraint failed infos

2011-08-11 Thread Pavel Ivanov
This is a known issue and it has an open ticket: http://www.sqlite.org/src/tktview?name=23b2128201. Pavel On Wed, Aug 10, 2011 at 1:05 PM, Julien Laffaye wrote: > Hello, > > Is it possible to get more info when I get a constraint failed error > from the C API? > I am

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Pavel Ivanov
> Don't use sqlite3_exec. Use sqlite3_prepare16 (which accepts wchar_t*), > sqlite3_step, sqlite3_finalize. Read text from columns with > sqlite3_column_text16 (which returns wchar_t*). I'd say it's not exactly this way. AFAIK, wchar_t on Linux is 32-bit, but sqlite3_column_text16 will return

Re: [sqlite] SQLite with 10M record

2011-08-11 Thread Black, Michael (IS)
Although I think you'll pick up speed going to a database my philosophy is "if it ain't broke don't fix it". If you're speed is OK now why worry about the organization? Putting it in a database only gives you more chance for corruption which could hose your entire database. If I were you

Re: [sqlite] SQLite with 10M record

2011-08-11 Thread Alexey Pechnikov
2011/8/11 Sumit Gupta : > 10-10-2011 18:48:42, 10,20, 30, 40, 50, 60, 80 .. <48 such entries> Use unixtime (time in seconds) and index on this field and your queries will be fast. You can use single blob as integers array for more compact database. -- Best regards, Alexey

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Igor Tandetnik
NOCaut wrote: > I want use but sqlity3.h NOT have this function. Does not have which function? The one you can download from http://sqlite.org/download.html certainly declares all the functions I've mentioned. -- Igor Tandetnik ___

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
I want use but sqlity3.h NOT have this function. and i create this post for you help me use this function -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32241783.html Sent from the SQLite mailing list archive at Nabble.com.

Re: [sqlite] how let readonly connection wait for locked database ?

2011-08-11 Thread Richard Hipp
On Wed, Aug 10, 2011 at 10:35 PM, Wenbo Zhao wrote: > Hi guys, > I want a readonly connection wait for locked database instead of error > return immediately. > The question is equivalence to how to let a reaonly connection have > busy_handler triggered > when the database

Re: [sqlite] SQLite with 10M record

2011-08-11 Thread Sumit Gupta
Hello, I have Experience with SQL Server and MySql, but not with SQLite. Since this application will run on Desktop Machine and Data it store is kind a Temporary, so I think Locking is not needed at all [as this reduce processing time for application]. The data is actually Reading on 48

Re: [sqlite] SQLite with 10M record

2011-08-11 Thread Black, Michael (IS)
Have you ever used SQLite before? 10M records is not a big deal. With experience it should take you less than hour to prove this one way or the other. But that depends on you having experience with databases (indexes) and SQLite in particular (WAL mode, exclusive locking, etc). Without

[sqlite] SQLite with 10M record

2011-08-11 Thread Sumit Gupta
Hello, I am developing an application using .NET 4.0, and we need to store about 10M entries to let our system work on them. Currently we are using XML files to store those value [in multiple XMLFile tokeep XML size small] and later load one of XML File based on parameter. It took our software

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Igor Tandetnik
NOCaut wrote: > I now how work with sqlite guys > > my problem: in const char * and i wont wchar_t*. becouse wchar_t* - > unicode type understand > > int sqlite3_exec( > sqlite3*, /* An open database */ > const char *sql, /* SQL to be

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
You think i most 1 -convert to UTF-8 2 -read un the const char * 3 - convert to anscii i right understand you? -- View this message in context: http://old.nabble.com/SQLite-%2B-unicode-tp32235242p32241427.html Sent from the SQLite mailing list archive at Nabble.com.

[sqlite] Loading Options from the command line binary

2011-08-11 Thread Ryan Henrie
I finally figured out how to load multiple "dot commands", pragma settings, or settings from the command line tool. (Some users only have the default binary to rely on, ya know.) Since I have never found this information on the web before, I thought I would post it here to share the

Re: [sqlite] SQLite + unicode

2011-08-11 Thread Teg
Hello NOCaut, I convert everything to UTF-8 for insert and then back to ascii or unicode when I pull the data from the DB. C Thursday, August 11, 2011, 4:20:36 AM, you wrote: N> I now how work with sqlite guys N> my problem: in const char * and i wont wchar_t*. becouse wchar_t* - N> unicode

Re: [sqlite] SQLite + unicode

2011-08-11 Thread NOCaut
I now how work with sqlite guys my problem: in const char * and i wont wchar_t*. becouse wchar_t* - unicode type understand int sqlite3_exec( sqlite3*, /* An open database */ const char *sql, /* SQL to be executed */ sqlite3_callback, /*

Re: [sqlite] sqlite-src-3070701.zip compilation issues

2011-08-11 Thread Baruch Burstein
Also, what command are you using to compile? On Thu, Aug 11, 2011 at 6:19 AM, wrote: > > Pls list the compilation errors.. > > --Original Message-- > From: Raja Kondu > Sender: sqlite-users-boun...@sqlite.org > To: sqlite-users@sqlite.org > ReplyTo: General

Re: [sqlite] tcl incrblob interface

2011-08-11 Thread Dan Kennedy
On 08/10/2011 11:24 PM, Victor Mayevski wrote: > Hello, > > I am trying to learn how to use the "incrblob" command in the Tcl > interface and I can't get it to work. I create a one column table "t", > insert one empty value into it, than do "db incrblob t a 1", which > works fine, I get a file