[
https://issues.apache.org/jira/browse/SOLR-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760516#comment-13760516
]
Tim Vaillancourt commented on SOLR-5216:
----------------------------------------
Hey guys,
We tested this patch and unfortunately encountered some serious issues a few
hours of 500 update-batches/sec. Our update batch is 10 docs, so we are writing
about 5000 docs/sec total, using autoCommit to commit the updates (no explicit
commits).
Our environment:
* Solr 4.3.1 w/SOLR-5216 patch.
* Jetty 9, Java 1.7.
* 3 solr instances, 1 per physical server.
* 1 collection.
* 3 shards.
* 2 replicas (each instance is a leader and a replica).
* Soft autoCommit is 1000ms.
* Hard autoCommit is 15000ms.
After a few hours of this testing, we see many of these stalled transactions,
and the solr instances start to see each other as down, flooding our solr logs
with Connection Refused exceptions, and otherwise no useful logs (that I could
see).
Stack /select seems stalled on: http://pastebin.com/Y1NCrXGC
Stack /update seems stalled on: http://pastebin.com/cFLbC8Y9
Lastly, I have a summary of the ERROR-severity logs from this 24-hour soak. My
script "normalizes" the ERROR-severity stack traces and returns them in order
of ocurrance.
Summary of my solr.log: http://pastebin.com/pBdMAWeb
Thanks!
Tim Vaillancourt
> Document updates to SolrCloud can cause a distributed deadlock.
> ---------------------------------------------------------------
>
> Key: SOLR-5216
> URL: https://issues.apache.org/jira/browse/SOLR-5216
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Reporter: Mark Miller
> Assignee: Mark Miller
> Priority: Critical
> Fix For: 4.5, 5.0
>
> Attachments: SOLR-5216.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
