[
https://issues.apache.org/jira/browse/SOLR-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ishan Chattopadhyaya updated SOLR-14665:
----------------------------------------
Description:
Plain and simple collection creation (or even shard splits etc.) get
progressively slower as more and more collections are in the system. The
culprit is the autoscaling framework (possibly some unnecessary policy
computation), even when *no autoscaling is being used whatsoever*.
Here is how bad the situation is:
https://issues.apache.org/jira/browse/SOLR-14656?focusedCommentId=17160311&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17160311
!Screenshot from 2020-07-18 07-49-01.png!
Btw, even when using createnodeset parameter, there is still a gradual slowdown
(but less steep than the graph here).
This is a matter of grave concern for anyone running a Solr cluster with more
than a few hundred collections.
was:
Plain and simple collection creation (or even shard splits etc.) get
progressively slower as more and more collections are in the system. The
culprit is the autoscaling framework (possibly some unnecessary policy
computation).
Here is how bad the situation is:
https://issues.apache.org/jira/browse/SOLR-14656?focusedCommentId=17160311&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17160311
!Screenshot from 2020-07-18 07-49-01.png!
Btw, even when using createnodeset parameter, there is still a gradual slowdown
(but less steep than the graph here).
This is a matter of grave concern for anyone running a Solr cluster with more
than a few hundred collections.
> Collection creation is progressively slower
> -------------------------------------------
>
> Key: SOLR-14665
> URL: https://issues.apache.org/jira/browse/SOLR-14665
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Ishan Chattopadhyaya
> Priority: Blocker
> Fix For: 8.7
>
> Attachments: Screenshot from 2020-07-18 07-49-01.png
>
>
> Plain and simple collection creation (or even shard splits etc.) get
> progressively slower as more and more collections are in the system. The
> culprit is the autoscaling framework (possibly some unnecessary policy
> computation), even when *no autoscaling is being used whatsoever*.
>
> Here is how bad the situation is:
> https://issues.apache.org/jira/browse/SOLR-14656?focusedCommentId=17160311&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17160311
>
> !Screenshot from 2020-07-18 07-49-01.png!
>
> Btw, even when using createnodeset parameter, there is still a gradual
> slowdown (but less steep than the graph here).
>
> This is a matter of grave concern for anyone running a Solr cluster with more
> than a few hundred collections.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
