Re: [sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 J Jayavasanthan wrote: > Does anyone know how sqlite3_get_table works in the above scenario, does it > load up the memory as such. It is written pretty much as you would expect by aggregating the results of a call to sqlite3_exec. sqlite3_exec does a

Re: [sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread Kees Nuyt
On Sat, 6 Dec 2008 19:47:06 +0530, "J Jayavasanthan" <[EMAIL PROTECTED]> wrote in General Discussion of SQLite Database : >And BTW, we narrowed down the Memory Usage only when processing the >resultsets it was growing till 1.2 GB of memory and was quite visible. After >the resultset was processed

Re: [sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread J Jayavasanthan
Hi All, I actually found the issue, it was with the pre_processor settings we were using. We were using TEMP_STORE=3 (older version SQLite - 3.5.4), which enforced memory being used by the SQLite to process the resultset. I changed it to 2 and then used pragma options to set it to 1 where we are pr

Re: [sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread Jay A. Kreibich
On Sat, Dec 06, 2008 at 03:53:42AM -0800, Roger Binns scratched on the wall: > J Jayavasanthan wrote: > > I thought that only the sqlite3_get_table function was supposed to fetch the > > rows in the memory, am I wrong or I missed some PRE_PROCESSOR while > > compiling the static library which resu

Re: [sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 J Jayavasanthan wrote: > In the process I noticed that the memory grew to enormous proportions that > terminated my app with OutOfMemory issue. How do you know it is SQLite consuming the memory and not your code? You can use sqlite3_status to find out

[sqlite] Out of Memory issue with sqlite 3.5.4

2008-12-06 Thread J Jayavasanthan
Hi All, I am using SQLite version 3.5.4 statically linked in my application. In one of my processes I query a database with numerous (> 1 million) entries using sqlite3_step function and process the rows. In the process I noticed that the memory grew to enormous proportions that terminated my app