[
https://issues.apache.org/jira/browse/SOLR-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056571#comment-14056571
]
Timothy Potter commented on SOLR-6136:
--------------------------------------
Thanks Shalin ... that helped a little. Here's where I'm at with this: using
the current "spin-lock" code on trunk (without wait/notify), VisualVM shows
some self CPU time in the blockUntilFinished, with Brandon's patch + the fix
for SOLR-4260 added back in, the self CPU time is negligible, which aligns with
what Brandon reported :-) So I think I'm convinced this is a good improvement
and am now going to run some stress tests on this and then post a patch for
review. Also, surprisingly, CUSS didn't have a unit test case for it, so I'm
building that too.
> ConcurrentUpdateSolrServer includes a Spin Lock
> -----------------------------------------------
>
> Key: SOLR-6136
> URL: https://issues.apache.org/jira/browse/SOLR-6136
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 4.6, 4.6.1, 4.7, 4.7.1, 4.7.2, 4.8, 4.8.1
> Reporter: Brandon Chapman
> Assignee: Timothy Potter
> Priority: Critical
> Attachments: wait___notify_all.patch
>
>
> ConcurrentUpdateSolrServer.blockUntilFinished() includes a Spin Lock. This
> causes an extremely high amount of CPU to be used on the Cloud Leader during
> indexing.
> Here is a summary of our system testing.
> Importing data on Solr4.5.0:
> Throughput gets as high as 240 documents per second.
> [tomcat@solr-stg01 logs]$ uptime
> 09:53:50 up 310 days, 23:52, 1 user, load average: 3.33, 3.72, 5.43
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 9547 tomcat 21 0 6850m 1.2g 16m S 86.2 5.0 1:48.81 java
> Importing data on Solr4.7.0 with no replicas:
> Throughput peaks at 350 documents per second.
> [tomcat@solr-stg01 logs]$ uptime
> 10:03:44 up 311 days, 2 min, 1 user, load average: 4.57, 2.55, 4.18
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 9728 tomcat 23 0 6859m 2.2g 28m S 62.3 9.0 2:20.20 java
> Importing data on Solr4.7.0 with replicas:
> Throughput peaks at 30 documents per second because the Solr machine is out
> of CPU.
> [tomcat@solr-stg01 logs]$ uptime
> 09:40:04 up 310 days, 23:38, 1 user, load average: 30.54, 12.39, 4.79
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 9190 tomcat 17 0 7005m 397m 15m S 198.5 1.6 7:14.87 java
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
