Re: [sqlite] Attach databases using tons of memory (DBI Perl)

I will try what you have mentioned below. I am 99% sure it isnt the perl script, since it doesn't have the same behavior without attaches. I will let you know what happens. Thank You 2009/9/25 D. Richard Hipp > > On Sep 25, 2009, at 11:02 AM, John Lynch wrote: > > > page size

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

I only query for one row at a time. 2009/9/25 Simon Slavin > > On 25 Sep 2009, at 1:10pm, Kees Nuyt wrote: > > > 4) Don't try to collect the full resultset into a Perl > > array. > > LOL > > Simon. > ___ > sqlite-users

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

On 25 Sep 2009, at 1:10pm, Kees Nuyt wrote: > 4) Don't try to collect the full resultset into a Perl > array. LOL Simon. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

On Sep 25, 2009, at 11:02 AM, John Lynch wrote: > page size is max (32768). These sqlt files are around 100Gig with 200 > million rows. > I have query_cache set to 0. > > I am running single queries against these attach tables and then > putting the > data in memcached. The script runs

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

page size is max (32768). These sqlt files are around 100Gig with 200 million rows. I have query_cache set to 0. I am running single queries against these attach tables and then putting the data in memcached. The script runs thousands of queries before it runs out of memory. If I use the same

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

On Thu, Sep 24, 2009 at 3:30 PM, John Lynch wrote: > Sqlite Users, > > I am using sqliute user for a very large customer database.  I have 3 > seperate DB files with a table in each file.  The files are cust,acct, and > web. > > Each DB table has  ~ 200 Million Rows.  When I

Re: [sqlite] Attach databases using tons of memory (DBI Perl)

On Thu, 24 Sep 2009 15:30:40 -0500, John Lynch wrote: >Sqlite Users, > >I am using sqliute user for a very large customer database. I have 3 >seperate DB files with a table in each file. The files are cust,acct, and >web. > >Each DB table has ~ 200 Million Rows. When I

[sqlite] Attach databases using tons of memory (DBI Perl)

Sqlite Users, I am using sqliute user for a very large customer database. I have 3 seperate DB files with a table in each file. The files are cust,acct, and web. Each DB table has ~ 200 Million Rows. When I attach web and acct to cust with perl DBI/DBD::Sqlite the process runs out of memory