[sqlite] ROWID-based queries slow in FTS db

2015-01-28 Thread farkas andras
Hi all, Im using FTS through DBD::SQLite (perl) to query large text databases (~10GB, ~10 million records). The regular FTS MATCH searches work fine (they usually run under a second), but searches based on ROWID are atrociously slow and hog massive amounts of memory. Im trying to retrieve a

Re: [sqlite] ROWID-based queries slow in FTS db

2015-01-30 Thread farkas andras
t;> >>> On 01/29/2015 02:29 AM, farkas andras wrote: >>> >>>> [...] but searches based on ROWID are atrociously slow and hog massive >>>> amounts of memory [...] >>>> >>> Looks like range constraints on rowids were only t

[sqlite] FTS5

2015-02-11 Thread farkas andras
Hi all, I found a previous FTS5 thread and, encouraged by the comments of Dan Kennedy, thought I would comment on the issue. - Smaller memory footprint and more speed is always great. Im already very impressed with the speed but even faster is even better of course. My experience is that