Hi all,
In our system we have default implementation of querying the data from riak
using “pagination”.
For some of the queries, with huge number of resulting records (into the tunes
of 10,000+) , it is becoming an issue and hence we wanted to change it to use
“cursorMark” as suggested here :
Okay, I probably spoke too soon.
While Solr 4.7 supports cursor marks, we do have an issue in Riak (or Yokozuna)
whereby it is actually impractical to use cursor marks for query. The problem
is that while Yokozuna uses coverage plans generate a filter query that will
guarantee that we get no
I'm very curious of your cursorMark implementation, I'm in deep need of
that feature.
From my experience I wasn't even able to trigger a query with my riak
version as it was not yet supported by the Solr bundled with it. But I
might missed a point with that.
I'm using 2.1.2.
Guillaume
On
Hi Fred,
Thanks for the pointer! 'cursorMark' is a lot more performant alright,
though apparently it doesn't suit our use case.
I've written a loop function using OTP's httpc that reads each page, gets
the cursorMark and repeats, and it returns all 147 pages with consistent
times in the 40-60ms
