On a single server, Solr already does streaming of returned documents... the stored fields of selected docs are retrieved one at a time as they are written to the socket. The servlet container already handles sending out chunked encoding for large responses too.
-Yonik http://www.lucidimagination.com On Sat, May 30, 2009 at 12:45 PM, Grant Ingersoll <[email protected]> wrote: > Anyone have any thoughts on what is involved with streaming lots of results > out of Solr? > > For instance, if I wanted to get something like 1M docs out of Solr (or > more) via *:* query, how can I tractably do this? Likewise, if I wanted to > return all the terms in the index or all the Term Vectors. > > Obviously, it is impossible to load all of these things into memory and then > create a response, so I was wondering if anyone had any ideas on how to > stream them. > > Thanks, > Grant >
