On Tue, Apr 28, 2015 at 1:03 PM, Dan Kennedy <danielk1977 at gmail.com> wrote:
> On 04/29/2015 01:55 AM, Scott Robison wrote: > >> I just took a quick glance at the FTS code. As I said, it has been a >> couple >> years, but this looks like the malloc that was failing for me at the time: >> http://www.sqlite.org/cgi/src/artifact/81f9ed55ad586148?ln=2473 >> > > That one is allocating enough space for the doclist associated with a > single term. Doclists are between say 2 and 12 bytes in size for each > instance of a term in the document set. So they can get quite large for > common terms ("a", "the" etc.). And the OP does have over a billion > documents. So I guess if there is a fairly common term in there, that > allocation could be too large for the OS to satisfy. > Perhaps ... it has been years, and I could be mistaken about the exact allocation, but that one looked right. In any case, hope it helps someone. :) SDR
