abhishekagarwal87 commented on issue #13692: URL: https://github.com/apache/druid/issues/13692#issuecomment-1396532889
Wow. that's a pretty impressive scale. I would definitely recommend upgrading to 25.0. However, that alone won't be sufficient. There are some config changes required to make the best use of optimizations that are added in 25.0. Switching to round-robin assignment for segment assignment will definitely help with long handoff time (https://github.com/apache/druid/pull/13367). That strategy is not available in 24.0 release. You should also turn on - druid.indexer.tasklock.batchSegmentAllocation - chatAsync (https://github.com/apache/druid/pull/13491/files) I have seen these settings work well in large scale clusters and would likely be turned on by default in future releases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
