[ https://issues.apache.org/jira/browse/SOLR-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764351#comment-13764351 ]
Yonik Seeley commented on SOLR-5232: ------------------------------------ bq. there has been anecdotal evidence that the batch size of 10 we were using is a bottleneck batch size != queue size... and it's not even clear the queue does anything unless one is somehow producing documents in a very bursty fashion. Streaming rather than buffering is definitely the way to go. > SolrCloud should distribute updates via streaming rather than buffering. > ------------------------------------------------------------------------ > > Key: SOLR-5232 > URL: https://issues.apache.org/jira/browse/SOLR-5232 > Project: Solr > Issue Type: Improvement > Components: SolrCloud > Reporter: Mark Miller > Assignee: Mark Miller > Fix For: 4.5, 5.0 > > Attachments: SOLR-5232.patch, SOLR-5232.patch > > > The current approach was never the best for SolrCloud - it was designed for a > pre SolrCloud Solr - it also uses too many connections and threads - nailing > that down is likely wasted effort when we should really move away from > explicitly buffering docs and sending small batches per thread as we have > been doing. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org