[
https://issues.apache.org/jira/browse/AIRFLOW-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793305#comment-16793305
]
Bryan Yang commented on AIRFLOW-4093:
-------------------------------------
There are three cases will throw the Exception
1. get a 'FAILED' state
2. get a 'CANCELLED' state
3. exceeded max retries
> Athena job won't be failed even the query is failed
> ----------------------------------------------------
>
> Key: AIRFLOW-4093
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4093
> Project: Apache Airflow
> Issue Type: Improvement
> Components: aws
> Reporter: Bryan Yang
> Assignee: Bryan Yang
> Priority: Major
>
> {{run_query}} function in {{Athena Operator}} just return the final state of
> the query. Because {{aws_athena_hook.poll_query_status}} won't raise an
> exception when get a 'FAILED' or 'CANCELLED' state.
> So if the upstream query failed, the downstream job will keep going.
> I will add some conditions which will result in exception in
> {{aws_athena_hook.poll_query_status}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
