zhangyue19921010 commented on pull request #10524: URL: https://github.com/apache/druid/pull/10524#issuecomment-744143180
> In my opinion, the dynamic scaling taskcount operation is related to the number of partitions in Kafka. when the data traffic increases, the taskcount has been adjusted to the number of partitions in Kafka. If the data volume keeps increasing, you can only increase the number of partitions or adjust the JVM parameter of PEON to keep consumption. Hi @Mrxiashu, generally speaking, the number of topic partitions is pretty large in PRD. Adjust taskCount to the number of partitions maybe is relatively rare. But you also can do that by setting `taskCountMax ` as you wish. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
