[
https://issues.apache.org/jira/browse/SOLR-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705656#comment-13705656
]
Mikhail Khludnev commented on SOLR-2112:
----------------------------------------
I don't run it, just played with it a year ago up to passing distributed search
test, see github. I'm ready to collaborate if anyone is interested. The most
questionable thing is the overall design. To discuss it we need to have two
separate issues, I suppose, for core ability and distributed support.
IIRC there is a special component, which injects own delegating collector which
writes into ServletResponse while search is going. It needs to require
sort=_docid_&rows=0 (to avoid buffering results).
Then for distributed search index should be presorted to keep internal and
external ids monotonic. I didn't cover index sorting.
But passing all these traps we've got yet another one MapReduce platform!
Sounds cool isn't it!
> Solrj should support streaming response
> ---------------------------------------
>
> Key: SOLR-2112
> URL: https://issues.apache.org/jira/browse/SOLR-2112
> Project: Solr
> Issue Type: New Feature
> Components: clients - java
> Reporter: Ryan McKinley
> Fix For: 4.0-ALPHA
>
> Attachments: SOLR-2112-StreamingSolrj.patch,
> SOLR-2112-StreamingSolrj.patch, SOLR-2112-StreamingSolrj.patch
>
>
> The solrj API should optionally support streaming documents.
> Rather then putting all results into a SolrDocumentList, sorlj should be able
> to call a callback function after each document is parsed. This would allow
> someone to call query.setRows( Integer.MAX_INT ) and get each result to the
> client without loading them all into memory.
> For starters, I think the important things to stream are SolrDocuments, but
> down the road, this could also stream other things (consider reading all
> terms from the index)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
