umisan commented on PR #17732: URL: https://github.com/apache/druid/pull/17732#issuecomment-2661312257
@kfaraz Thanks for reviewing my PR. Sorry, I haven't tested this change on our Druid cluster yet. I completely agree with your point that most of the time spent during polling is due to I/O, and the improvement from deserialization optimization might be negligible. Our Druid cluster has about 1 million segments and takes several minutes to load newly added segments. Unfortunately, we don't have a staging Druid cluster, so I haven't been able to test this change in an environment with a large number of segments. I am considering setting up a test Druid cluster to evaluate this change. However, it's possible that the results will show that this PR doesn't provide meaningful improvements. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
