[
https://issues.apache.org/jira/browse/SOLR-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449016#comment-17449016
]
Ishan Chattopadhyaya commented on SOLR-15715:
---------------------------------------------
{quote}To sustain that, a separate scalability model will be required for the
aggregation nodes, thus leading to more complexity and state.
{quote}
What do you mean by a "separate scalability model"? These query aggregation
nodes are stateless and can be scaled up and down independently of the data
nodes. Cost of bringing up a new aggregation node and bringing down a
misbehaving aggregation node is much lower than misbehaving nodes with data in
it.
{quote}What are the steps taken to avoid the situation described above, and
what kind of testing/simulation has been performed for the same?
{quote}
At FullStory, this solution has been running in a production Solr cluster with
hundreds of nodes for several months now with immense benefits in reducing load
on the data nodes.
> Dedicated query aggregator nodes in the solr cluster.
> ------------------------------------------------------
>
> Key: SOLR-15715
> URL: https://issues.apache.org/jira/browse/SOLR-15715
> Project: Solr
> Issue Type: New Feature
> Components: SearchComponents - other
> Affects Versions: 8.10.1
> Reporter: Hitesh Khamesra
> Priority: Major
> Attachments: coordinator-poc.jpg, coordinator-poc.pdf,
> regular-node.jpg, regular-node.pdf
>
>
> We have a large collection with 1000s of shards in the solr cluster. We have
> observed that distributed solr query takes many resources(thread, memory,
> etc.) on the solr data node(node which contains indexes). Thus we need
> dedicated query nodes to execute distributed queries on large solr
> collection. That would reduce the memory/cpu pressure from solr data nodes.
> Elastis search has similar functionality
> [here|https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-node.html#coordinating-node]
>
> [~noble.paul] [~ichattopadhyaya]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
