jihoonson commented on issue #8061: Native parallel batch indexing with shuffle URL: https://github.com/apache/incubator-druid/issues/8061#issuecomment-537287192 > with 0 `requiredCapacity` overlord would try and send them to MM but MM would reject them saying its full, no ? Hmm, I just tested with `RemoteTaskRunner` and it worked. Is MM supposed to reject it? > yes, I meant reserve something else and not task slots i.e. maybe a "supervisor slot" concept. Sounds good. I was thinking a task scheduler respecting task priority. Like, it can schedule high priority tasks more often, but also should be able to avoid starvation for low priority tasks. Maybe the supervisor slot concept can go along with this idea together. > For other reliability reasons, maybe also a first class "Supervisor" class like "Task" ... handling of "Supervisor" could be different than that of a Task e.g. all Supervisors are always restartable , unlike Tasks they are not failed if a MM running them dies and instead they are re-run etc. Also sounds good.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
