Christopher created AIRFLOW-3543:
------------------------------------

             Summary: rescheduled block DAG deletion
                 Key: AIRFLOW-3543
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3543
             Project: Apache Airflow
          Issue Type: Bug
          Components: cli, database
         Environment: postgres 10 database
            Reporter: Christopher


This applies to current master branch after 
[AIRFLOW-2747|https://github.com/apache/incubator-airflow/commit/dc59d7e2750aa90e099afad8689f2646f18f92a6]
 was merged. 

Once a sensor task is rescheduled, the task cannot be deleted from the DB due 
to a foreign key constraint. This prevents deletion of tasks and DAGS. This 
occurs regardless of whether the DAG is still running or whether the sensor is 
actually rescheduled to run in the future or not (ie the task may complete 
successfully but its entry still resides as a row in the task_reschedule table.

 

I am running a postgres-backed airflow instance.

 

{{Traceback (most recent call last):}}
{{ File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", 
line 1193, in _execute_context}}
{{context)}}}}
{{File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", 
line 509, in do_execute}}}}
{{cursor.execute(statement, parameters)}}
{{psycopg2.IntegrityError: update or delete on table "task_instance" violates 
foreign key constraint "task_reschedule_dag_task_date_fkey" on table 
"task_reschedule"}}
{{DETAIL: Key (task_id, dag_id, execution_date)=(check_images_ready_11504, 
flight5105_v0.0.1, 2018-12-13 00:00:00+00) is still referenced from table 
"task_reschedule".}}

{{sqlalchemy.exc.IntegrityError: (psycopg2.IntegrityError) update or delete on 
table "task_instance" violates foreign key constraint 
"task_reschedule_dag_task_date_fkey" on table "task_reschedule"}}

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to