ankit0811 commented on issue #7962: Killing hadoop ingestion task does not kill spawned Hadoop MR task URL: https://github.com/apache/incubator-druid/issues/7962#issuecomment-513030440 @jon-wei I tested the kill task which included the changes from PR #8085 and the kill task works as expected. I dint see any inconsistency in terminating the underlying MR job. Scenarios tested: 1. Kill as soon as the MR job starts - works as expected 2. Kill when the map phase is completed (100%) - works as expected 3. Kill when the reducer phase is still in running phase - works as expected 4. Kill when the MR job is almost completed - This leads to a race condition where in if the overlord issue the kill command and the job is completed, we see the above log lines
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
