himanshug commented on issue #10193: URL: https://github.com/apache/druid/issues/10193#issuecomment-664665992
Technically possible even in `http` if historicals were super slow in downloading segments from deep storage but it is much less likely to happen because all segments to load are not immediately placed in historical's queue of segments to load unlike the zk version where historical's queue is in the zk. Also, there are no problems in case of `http` when increasing the `numLoadingThreads` to improve historical's speed of loading segments to match the rate at which they are assigned to it. from a quick skim over the discussion, solution proposed in #10213 is ok if only one historical was slow/mis-behaving due to a host issue but if this is a cluster level problem then you might not get desired behavior, considering that solution would end up over allocating segment assignment to historicals, consequently requiring overall "historical cluster" to do more work than was being done otherwise. I would try to increase `numLoadingThreads` to improve historical's segment loading speed(.. using `http` segment loading if you get zk troubles in doing that) and/or adding more historicals if possible. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
