Re: [sqlite] Bug in CREATE INDEX

2016-08-18 Thread James K. Lowden
On Mon, 8 Aug 2016 10:48:58 -0700 "Kevin O'Gorman" wrote: > Very cool. But 4? I will be running this on machines with 8 and 16 > cores. Does going beyond 4 not help much? Four doesn't seem like a bad starting point. I don't have any information specific to SQLite,

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Dan Kennedy
On 08/09/2016 12:48 AM, Kevin O'Gorman wrote: On Sun, Aug 7, 2016 at 11:11 PM, Dan Kennedy wrote: On 08/08/2016 02:03 AM, Dominique Pellé wrote: Kevin O'Gorman wrote: CREATE INDEX has two problems: 1) poor default location of temporary storage. 2) gets wedged on

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Kevin O'Gorman
On Sun, Aug 7, 2016 at 11:11 PM, Dan Kennedy wrote: > On 08/08/2016 02:03 AM, Dominique Pellé wrote: > >> Kevin O'Gorman wrote: >> >> CREATE INDEX has two problems: >>> 1) poor default location of temporary storage. >>> 2) gets wedged on very large indexes. >>> >>> I'm

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Kevin O'Gorman
On Mon, Aug 8, 2016 at 2:41 AM, Philip Newton wrote: > On 7 August 2016 at 22:37, Kevin O'Gorman wrote: > > I use the LTS (long-term support) version of Ubuntu, and like not having > to > > keep up with all the latest. My current 14.04 is at

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Philip Newton
On 7 August 2016 at 22:37, Kevin O'Gorman wrote: > I use the LTS (long-term support) version of Ubuntu, and like not having to > keep up with all the latest. My current 14.04 is at end-of-life LTS are supported for 5 years; your 14.04 is good till April 2019. Ph.

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Stephan Mueller
Kevin asks: " Does anybody know where the actual defaults and controlling environment " variables are documented, by operating system? Or are they? I believe Section 5.0. near the end of https://www.sqlite.org/tempfiles.html describes what you're looking for. thanks, stephan();

Re: [sqlite] Bug in CREATE INDEX

2016-08-08 Thread Dan Kennedy
On 08/08/2016 02:03 AM, Dominique Pellé wrote: Kevin O'Gorman wrote: CREATE INDEX has two problems: 1) poor default location of temporary storage. 2) gets wedged on very large indexes. I'm using the sqlite that came with Xubuntu 14.04, I think it's version 3.8.2. SQLite-3.8.2 is old (Dec

Re: [sqlite] Bug in CREATE INDEX

2016-08-07 Thread Kevin O'Gorman
On Sun, Aug 7, 2016 at 12:03 PM, Dominique Pellé wrote: > Kevin O'Gorman wrote: > > > CREATE INDEX has two problems: > > 1) poor default location of temporary storage. > > 2) gets wedged on very large indexes. > > > > I'm using the sqlite that came with Xubuntu 14.04,

Re: [sqlite] Bug in CREATE INDEX

2016-08-07 Thread Dominique Pellé
Kevin O'Gorman wrote: > CREATE INDEX has two problems: > 1) poor default location of temporary storage. > 2) gets wedged on very large indexes. > > I'm using the sqlite that came with Xubuntu 14.04, I think it's version > 3.8.2. SQLite-3.8.2 is old (Dec 2013). It's better to download and compile

Re: [sqlite] Bug in CREATE INDEX

2016-08-07 Thread Olivier Mascia
> Does anybody know where the actual defaults and controlling environment > variables are documented, by operating system? https://www.sqlite.org/tempfiles.html -- Meilleures salutations, Met vriendelijke groeten, Best Regards, Olivier Mascia (from mobile device), integral.be/om

Re: [sqlite] Bug in CREATE INDEX

2016-08-07 Thread Kevin O'Gorman
RETRACTED: Not wedged, just somewhat slower than I expected. I was expecting about an hour, and it takes 6. On reflection, it's okay. My ideas about what's going on were wrong too -- anonymous files are used, but only two of them at a time. I still think it is using a poor choice of default

[sqlite] Bug in CREATE INDEX

2016-08-05 Thread Kevin O'Gorman
CREATE INDEX has two problems: 1) poor default location of temporary storage. 2) gets wedged on very large indexes. I'm using the sqlite that came with Xubuntu 14.04, I think it's version 3.8.2. I created a table, and used .import to populate it with records, about 1.4 billion of them. The