[
https://issues.apache.org/jira/browse/AIRFLOW-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161422#comment-17161422
]
Michel Goldstein commented on AIRFLOW-7116:
-------------------------------------------
+1 on this issue too. We've run into it on 1.10.10, or one variation on it
every time a task is removed from the DAG it seems like the old task now is
unschedulable but keeps the DAG in a running state forever (very puzzling
because if you look at the DAG, all its tasks finished but it is still marked
as running).
The biggest problem here for us is that after {{max_active_runs_per_dag}} it
stops scheduling the DAG "silently".
We fortunately did not have a case yet where we tried to re-add the task to the
DAG and then had the weird issue above where the task won't run.
> Tasks get stuck in the "removed" state
> --------------------------------------
>
> Key: AIRFLOW-7116
> URL: https://issues.apache.org/jira/browse/AIRFLOW-7116
> Project: Apache Airflow
> Issue Type: Bug
> Components: DAG
> Affects Versions: 1.10.9
> Environment: Mac OS Catalina
> Airflow 1.10.9
> Airflow running locally using out of box sqlite database
> Reporter: Chris
> Priority: Major
> Labels: DAG, local, sqlite, tasks
> Attachments: Untitled.png
>
>
> This appears to be a regression of:
>
> https://issues.apache.org/jira/browse/AIRFLOW-1460
>
> Repro steps:
>
> # Configure Dag to run within context manager via "with" keyword.
> # Comment out one or more tasks within a Dag.
> # Refresh Dag.
> # Trigger Dag.
> # Notice the tasks are removed from the dag and the dag runs the
> non-commented task(s) successfully.
> # Uncomment the tasks that were commented before.
> # refresh dag.
> # trigger dag.
>
> Observed results:
> * The tree view of the dag does not update, showing the re-added tasks.
> * After Triggering the Dag, (only the task(s) that was/were tested while the
> others were commented out appears in the Graph View)
> * On the graph view, the dag's uncommented tasks only appear after
> restarting Airflow Server/Scheduler.
> * Even though the Airflow server was restarted, and although the dag now
> shows all the tasks in both Tree view and Graph view, the dag, when
> triggered, only runs the task(s) that were previously not commented.
> * Note that the tasks when hovering mouse over them in Graph View, show
> "State" as "removed".
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
