I was actually curious about the same thing. Perhaps an endpoint
reference could be passed in the request where the documents can be
sent asynchronously, such as a jms topic.
solr/query?q=*:*&epr=/my/topic&eprtype=jms
Then we would need to consider how to break up the response, how to
cancel a running query, etc.
Is this along the lines of what you're looking for? I would be
interested in looking at how the request/response contract changes and
what types of endpoint references would be supported.
Thanks,
D
On May 30, 2009, at 12:45 PM, Grant Ingersoll <[email protected]>
wrote:
Anyone have any thoughts on what is involved with streaming lots of
results out of Solr?
For instance, if I wanted to get something like 1M docs out of Solr
(or more) via *:* query, how can I tractably do this? Likewise, if
I wanted to return all the terms in the index or all the Term Vectors.
Obviously, it is impossible to load all of these things into memory
and then create a response, so I was wondering if anyone had any
ideas on how to stream them.
Thanks,
Grant
