As per your questions:
1. I do not use sqlite from C or some other language. The calls are
from the command line using sqlite3 command line utility. Hence no
sqlite3_memory_used calls. Memory used by sqlite3 process was obtained by
eyeballing the sqlite3 process in Windows task manager.
On Sun, Jan 27, 2013 at 2:57 PM, ammon_lymphater <
ammon_lympha...@hotmail.com> wrote:
>
> I think I localized the bug - potential query memory use with larger cache
> sizes
>
> Details
> - created a database and started in a loop 10 times { import 1m
> records; run query}
> - for
I think I localized the bug - potential query memory use with larger cache
sizes
Details
- created a database and started in a loop 10 times { import 1m
records; run query}
- for each iteration observe the memory use by SQLITE3 process using
task manager
- the mimimum use
CL> This looks as if all temporary data is stored in memory (of which you
CL> don't have too much in a 32-bit process.)
Yeah, this. Typically you only have 2 gigs of address space to work
with, in 32 bit windows. I've run out of RAM by having
"temp_store=memory" before. I also have 30-60 GB DB
ammon_lymphater wrote:
> - during import the memory growth up to 800 mb (the cache size)
> - during select count(*) it goes up to 1.5gb
> - when starting select ... group by the memory it goes up to 1.6 gb
> for successful imports, up to 2gb for out of memory condition
This looks as if all
To answer your question:
- Disk space is not a problem - there is over 500gb free space on that disk
(with database size 80gb).
- Memory - 16gb with at least 8 free at all times during testing
- Platform - I moved the platform to Windows Server 2012
I did more testing. I have a large csv
How much free disk space do you have? Your temp tables might be exceeding
capacity.
-Original Message-
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of ammon_lymphater
Sent: Thursday, January 24, 2013 1:41 PM
To: sqlite-users@sqlite.org
Subject:
Summary: except for select count(*) , all operations on a large table (500m
rows/80gb) result in out-of-memory error
Details:
a. Using SQLite3 ver 3.7.15.2, Windows 7 64 bit AMD(but the error
also in 3.6.xx and on other Windows platforms)
b. Created a table (schema attached),
8 matches
Mail list logo
