GitHub user liiang-huang edited a discussion: Airflow DAG sometimes fail with
unknown reason
Hi Airflow community, our DAG sometimes fail with the below error
```
[2024-11-17, 23:21:17 UTC] {{base.py:287}} INFO - Success criteria met. Exiting.
[2024-11-17, 23:21:17 UTC] {{subdag.py:187}} INFO - Execution finished. State
is failed
[2024-11-17, 23:21:17 UTC] {{taskinstance.py:1937}} ERROR - Task failed with
exception
Traceback (most recent call last):
File
"/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py",
line 1518, in _run_raw_task
self._execute_task_with_callbacks(context, test_mode, session=session)
File
"/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py",
line 1684, in _execute_task_with_callbacks
self.task.post_execute(context=context, result=result) # type:
ignore[union-attr]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/operators/subdag.py",
line 190, in post_execute
raise AirflowException(f"Expected state: SUCCESS. Actual state:
{dag_run.state}")
airflow.exceptions.AirflowException: Expected state: SUCCESS. Actual state:
failed
[2024-11-17, 23:21:17 UTC] {{taskinstance.py:1400}} INFO - Marking task as
FAILED. dag_id=linepay_recon_v1, task_id=copier_subdag,
execution_date=20241116T230000, start_date=20241117T230015,
end_date=20241117T232117
[2024-11-17, 23:21:17 UTC] {{base.py:73}} INFO - Using connection ID
'aws_default' for task execution.
[2024-11-17, 23:21:17 UTC] {{base.py:73}} INFO - Using connection ID
'slack_api_default' for task execution.
[2024-11-17, 23:21:18 UTC] {{base.py:73}} INFO - Using connection ID
'slack_api_default' for task execution.
[2024-11-17, 23:21:18 UTC] {{standard_task_runner.py:104}} ERROR - Failed to
execute job 363190 for task copier_subdag (Expected state: SUCCESS. Actual
state: failed; 32466)
[2024-11-17, 23:21:18 UTC] {{local_task_job_runner.py:228}} INFO - Task exited
with return code 1
[2024-11-17, 23:21:18 UTC] {{taskinstance.py:2778}} INFO - 0 downstream tasks
scheduled from follow-on schedule check
```
Can anyone help to identify the issue/cause?
GitHub link: https://github.com/apache/airflow/discussions/44231
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
