Scott Blum created SOLR-8744:
--------------------------------
Summary: SplitShard needs finer-grained mutual exclusion
Key: SOLR-8744
URL: https://issues.apache.org/jira/browse/SOLR-8744
Project: Solr
Issue Type: Improvement
Components: SolrCloud
Affects Versions: 5.4.1
Reporter: Scott Blum
SplitShard creates a mutex over the whole collection, but in practice this is a
big scaling problem. Multiple split shard operations could happen at the time
time, as long as different shards are being split. In practice, those shards
often reside on different machines, so there's no I/O bottleneck in those
cases, just the mutex in Overseer forcing the operations to be done serially.
Given that a single split can take many minutes on a large collection, this is
a bottleneck at scale.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
