pateash commented on issue #15468: URL: https://github.com/apache/airflow/issues/15468#issuecomment-952550267
> I have similar use case but I don't cause the DAG itself to fail if EMR failed. Like you I run a task task to terminate the machine. Am I correct that what you are asking is to change the way that Airflow consider DAG runs statuses (success/failure) by giving the user the option to set it according to his own logic? In your case, if you consider dag to be successful even though intermediate jobs have failed, How are you monitoring your jobs and Isn't the dag should fail ideally in your case? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
