Rohini Palaniswamy commented on OOZIE-2194:

Previously oozie used application tags only to deal with AM restarts and RM 
non-work preserving restarts which may launch duplicate AMs. OOZIE-2243 used it 
to also kill if user issued a kill. Previously it was relying only on the 
shutdown hooks of Pig and Hive for the launched child jobs to be killed. 
Problem was that shutdown hook might not be executed in some scenarios and it 
did not kill jobs launched by users from java actions as they usually don't 
bother killing jobs in finally or shutdown hooks.

Even with the application tags, shutdown hook which calls application specific 
kill API is useful in following scenarios
    - Give child jobs a chance to do graceful shutdown/kill and write down any 
required history. 
    - In case of failures and no user kill, the application will continue to 
run. So for cases like Tez which reuses applications to launch multiple DAGs, 
Pig needs to shutdown the application. Else it will be hanging around till the 
configured idle timeout. Not sure how that works with Spark

> oozie job -kill doesn't work with spark action
> ----------------------------------------------
>                 Key: OOZIE-2194
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2194
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Thomas Graves
> I was trying the spark action out with oozie and was able to launch fine. But 
> when I tried do use oozie job -kill it only killed the launcher job and not 
> the spark application itself.

This message was sent by Atlassian JIRA

Reply via email to