[
https://issues.apache.org/jira/browse/SOLR-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17280708#comment-17280708
]
Noble Paul commented on SOLR-15138:
-----------------------------------
Diagnosis:
As we create collections using perReplicaState=true the replicas keep coming up
after some time. Each replica coming up fires an event. Overseer is watching
all these collections and as there are more collections the events take longer
to process.
At some point, the message that is sent to overseer Q takes longer than the
wait time out (30 secs) to get processed. In my machine, it started happening
after around 220 collections were created.
I have created a PR with a temp solution.
This is still WIP
> PerReplicaStates does not scale to large collections as well as state.json
> --------------------------------------------------------------------------
>
> Key: SOLR-15138
> URL: https://issues.apache.org/jira/browse/SOLR-15138
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 8.8
> Reporter: Mike Drob
> Assignee: Noble Paul
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> I was testing PRS collection creation with larger collections today
> (previously I had tested with many small collections) and it seemed to be
> having trouble keeping up.
>
> I was running a 4 node instance, each JVM with 4G Heap in k8s, and a single
> zookeeper.
>
> With this cluster configuration, I am able to create several (at least 10)
> collections with 11 shards and 11 replicas using the "old way" of keeping
> state. These collections are created serially, waiting for all replicas to be
> active before proceeding.
> However, when attempting to do the same with PRS, the creation stalls on
> collection 2 or 3, with several replicas stuck in a "down" state. Further,
> when attempting to delete these collections using the regular API it
> sometimes takes several attempts after getting stuck a few times as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
