[sqlite] typo in vdbe.c

2012-08-28 Thread li yusheng
file vdbe.c line 659: /* On any opcode with the "out2-prerelase" tag, free any should be "out-prerelease" ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] How to determine the effective cache size

2012-08-28 Thread Foster, Kristina (CIV)
Thank you for the clarification. I was wondering if I missed something with the command line or Python interface. I will stay tuned for the sqlite3_db_status method in future releases. From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.or

Re: [sqlite] How to determine the effective cache size

2012-08-28 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/08/12 11:46, Foster, Kristina (CIV) wrote: > I set the pragma cache_size to 64 GiB per the online documentation. You may want to check that using SQLite's cache is actually beneficial. The operating system will also be doing caching so having da

Re: [sqlite] How to determine the effective cache size

2012-08-28 Thread Richard Hipp
On Tue, Aug 28, 2012 at 2:46 PM, Foster, Kristina (CIV) wrote: > Is there a way to determine when the cache has been filled or how full it > currently is? > sqlite3_db_status(db, SQLITE_DBSTATUS_CACHE_USED, ...). See http://www.sqlite.org/c3ref/db_status.html and http://www.sqlite.org/c3ref/c_db

Re: [sqlite] How to determine the effective cache size

2012-08-28 Thread Foster, Kristina (CIV)
Thank you for the speedy response and references. Is there a way to determine when the cache has been filled or how full it currently is? I set the pragma cache_size to 64 GiB per the online documentation. From: sqlite-users-boun...@sqlite.org [sqlite-

Re: [sqlite] How to determine the effective cache size

2012-08-28 Thread Simon Slavin
On 28 Aug 2012, at 7:19pm, "Foster, Kristina (CIV)" wrote: > Is there an SQLite command to determine the effective cache_size, or how much > of the cache is currently being used? I haven't seen any solutions for using > the Python sqlite module. I also haven't seen any solutions for determin

[sqlite] How to determine the effective cache size

2012-08-28 Thread Foster, Kristina (CIV)
Hello, I am testing the query rate for an SQLite database (DB) that has a table with 100 Million rows. The DB file size is 9.7 GiB and I am running it on a Dell Server that has 128 GiB of RAM available. The sqlite cache_size pragma is set to 64 GiB before I start querying so the entire DB co

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Simon Slavin
On 28 Aug 2012, at 5:34pm, kritesh tripathi wrote: > Is performance due to hardware like SD card > speed or Filesystem ? SD cards are very slow to read and write to. They have to use almost no power at all. I think any PRAGMA settings you may do are being drowned by how slow it is to access

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Black, Michael (IS)
And...once you confirm an in-memory database helps you, then you can try WAL mode and keep the DB on the SD card and see how that works for you. I don't know what you're trying to do since loading the images is already 66% of your time. I guess that's OK with your application? Michael D. Black

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
Thanks alot Michael .lets upgrade it and hope i need your help in case getting stuck:) Cheers Kritesh On Tue, Aug 28, 2012 at 10:05 PM, Black, Michael (IS) < michael.bla...@ngc.com> wrote: > Oh yeah...you need to upgrade your sqlite. > > You are hitting the SD card which is dog slow. > > Keeping

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Black, Michael (IS)
Oh yeah...you need to upgrade your sqlite. You are hitting the SD card which is dog slow. Keeping your DB in memory may solve all of your database speed concerns. Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop Grumman Informatio

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
Hi, Sorry but i am not using memory database since sqlite version -3.6.4 does not support i guess ..I am not indexing any data and i am sure that all insertion , i am doing under one transaction . Do you think creating index or i n memory database or binding the values using sqlite_binding will

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Black, Michael (IS)
So you're already doing the smart thinggoodand I believe you did say you're using a memory database, right? Not storing it on the SD card? Are you able to run your timing test on a standard PC? 50 inserts/sec is definitely NOT fast (that's your .02 number). Thousands/sec is more like i

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
HI Michael, I am not stroing the video data in the table .For example -Suppose i have one image - ABC.jpg in the folder contains in SD Card 1- First i am parsing the image 2- Second Get the values like - Fullpath (Wht is the exact path of image in SD Card),file Size and create unique id . 3-Third

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Black, Michael (IS)
I think the first thing you'll hear is to NOT store the video data in the database. Just store a file path. That is much faster and should complete a lot faster than your expectations. Is there some specific reason why you want the blob data in your database? How long does it take you just to

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
Hi Michael, Righ Now i am inserting only 500 records in three different tables in 42 sec . I have 500 imagesor video (.jpg or MP4) in the SD card which i am parsing and then inserting one by one in the video table or image table . I am expecting this in between 10-20 sec . Presently i am using t

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Black, Michael (IS)
Tell us what kind of speed you're seeing. And what your insert looks like. Then tell us what you expect. Then we can tell you if your expectations are reasonable or if you're already getting as much speed as one can expect. Michael D. Black Senior Scientist Advanced Analytics Directorate Advanc

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
Thanks to suugestion I am using the Sqlite version -3.6.4 and support for WAL mode started from version 3.7.0.If i upgrade to recent sqlite version then is any possibilty to increase in performance or any other good idea . Cheers kritesh On Tue, Aug 28, 2012 at 8:11 PM, Jonathan Engle wrote:

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Jonathan Engle
Try WAL mode. On Aug 28, 2012, at 9:38 AM, kritesh tripathi wrote: > Hi Pavel, > > Thanks for the information . I am using all insert under one transection > hence may be the reson its not effecting much . But do you suggest me the > way to increase more insert speed what i need to do in this sc

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread kritesh tripathi
Hi Pavel, Thanks for the information . I am using all insert under one transection hence may be the reson its not effecting much . But do you suggest me the way to increase more insert speed what i need to do in this scenario. Is same happen for all pragma like Page_Size or Journal_Mode or Cache_s

Re: [sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread Pavel Ivanov
If all your inserts are in one transaction then pragma synchronous = OFF won't affect your transaction speed too much. To understand whether this pragma works or not you should measure how long it takes to execute COMMIT (just this one statement). With synchronous = OFF COMMIT will be executed much

[sqlite] Pragma Synchronous=OFF is not working

2012-08-28 Thread tripathi.kritesh
Hi , I am executing all below mentioned pragma before start the (BEGIN --COMMIT) transaction in sqlite version (3.6.4) sqlite3_exec(mDb, “PRAGMA synchronous=OFF”, NULL, NULL, &errorMessage); sqlite3_exec(mDb, “PRAGMA count_changes=OFF”, NULL, NULL, &errorMessage); sqlite3_exec(mDb, “PRAGMA jou