Dana Assa created AIRFLOW-3297:
----------------------------------

             Summary: EmrStepSensor marks cancelled step as successful 
                 Key: AIRFLOW-3297
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3297
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Dana Assa


When a step is manually cancelled or when the cluster is terminated 
unexpectedly, an EMR step can reach 'CANCEL_PENDING' state or 'INTERRUPTED' 
state.

These states are not mentioned as FAILED_STATES nor as NON_TERMINAL_STATES in 
the "EmrStepSensor" class, thus the sensor returns True and the Airflow stage 
is marked as success instead of failed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to