Re: [sqlite] generic advice for insert performance in-memory database optimization

2017-12-21 Thread Keith Medcalf
he fact that there's a Highway to Hell but only a Stairway to Heaven says a lot about anticipated traffic volume. >-Original Message- >From: sqlite-users [mailto:sqlite-users- >boun...@mailinglists.sqlite.org] On Behalf Of Nelson, Erik - 2 >Sent: Thursday, 21 December, 2017 12:06 >To: SQLi

Re: [sqlite] generic advice for insert performance in-memory database optimization

2017-12-21 Thread Simon Slavin
On 21 Dec 2017, at 7:06pm, Nelson, Erik - 2 wrote: > I'm running on linux with the OS page size configured to 4096 and ~380 GB of > ram (much more than required for the table so I think I'm not swapping) and > haven't altered the sqlite page size. I am using sqlite version 3.13.0 and > the

[sqlite] generic advice for insert performance in-memory database optimization

2017-12-21 Thread Nelson, Erik - 2
I've got an in-memory database with a single table that I need to fill with ~500 million rows. There are no indexes and the table definitions is create table data(id int, path int, month int, val1 double, val2 double, val3 double... val20 double) I'm running on linux with the OS page size conf