[ 
https://issues.apache.org/jira/browse/PIG-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317951#comment-15317951
 ] 

Daniel Dai commented on PIG-4921:
---------------------------------

Thanks for taking care of shutdown hook with priority. In case of 
InterruptedException of a Tez job, do you actually want to call 
TezSessionManager.shutdown()? TezLauncher.kill only kill the running job and 
may leave idle AM behind.

> Kill running jobs on InterruptedException
> -----------------------------------------
>
>                 Key: PIG-4921
>                 URL: https://issues.apache.org/jira/browse/PIG-4921
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.17.0
>
>         Attachments: PIG-4921-1.patch, PIG-4921-2.patch, PIG-4921-3.patch
>
>
> Shutdown hook kills running jobs, but when running in Oozie launcher 
> sometimes NodeManager can issue a SIGKILL after AM unregisters and before 
> shutdown hook gets to execute causing orphaned jobs that continue to run. So 
> it is better to kill when we see the InterruptedException.
> Added additional System.err logging to code in shutdown hooks as 
> LogManager.shutdown() is called by mapreduce AM (Oozie launcher job is 
> mapreduce) and log4j logging does not appear anymore.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to