Hi Matt,
This feature is commonly known as deep paging and Lucene and Solr have
issues with it ... take a look at
http://solr.pl/en/2011/07/18/deep-paging-problem/ as a potential
starting point using filters to bucketize a result set into sets of
sub result sets.
Cheers,
Tim
On Tue, Jul 23, 2013 at 3:04 PM, Matt Lieber <mlie...@impetus.com> wrote:
> Hello Solr users,
>
> Question regarding processing a lot of docs returned from a query; I
> potentially have millions of documents returned back from a query. What is
> the common design to deal with this ?
>
> 2 ideas I have are:
> - create a client service that is multithreaded to handled this
> - Use the Solr "pagination" to retrieve a batch of rows at a time ("start,
> rows" in Solr Admin console )
>
> Any other ideas that I may be missing ?
>
> Thanks,
> Matt
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential, proprietary,
> privileged or otherwise protected by law. The message is intended solely for
> the named addressee. If received in error, please destroy and notify the
> sender. Any use of this email is prohibited when received in error. Impetus
> does not represent, warrant and/or guarantee, that the integrity of this
> communication has been maintained nor that the communication is free of
> errors, virus, interception or interference.
