zachjsh commented on PR #14662: URL: https://github.com/apache/druid/pull/14662#issuecomment-1655066933
> Re: the number of tasks being used for kill tasks, have you considered adjusting the kill task such that it can accept multiple intervals, and then adjusting the coordinator to launch only one task to cover all intervals? > > I assume the main driver of excessive task slot usage would be situations where there are many intervals with low segment count being auto-killed, and a separate task being spawned per-interval, consolidating those into one task should alleviate that problem actually the auto kill task already submits an "umbrella" interval, which contains at leat maxSegments, but may include more. This change enforces that max limit for fully now. See the pr description for details of scenario where the max segment config was not being enforced -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
