jihoonson commented on issue #8061: Native parallel batch indexing with shuffle URL: https://github.com/apache/incubator-druid/issues/8061#issuecomment-537260198 @himanshug good point. I don't think we have any protection against this kind of scenario yet. One possible short term workaround could be checking timeout for pending sub tasks. If timeout expires, the supervisor task can kill its sub tasks, which will lead to killing itself in the end either by killing sub tasks 3 times just like in general failure handling or killing itself immediately in this case. In the future, we may need to improve task scheduling to consider task type to avoid this kind of deadlock.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
