[
https://issues.apache.org/jira/browse/AIRFLOW-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned AIRFLOW-1491:
-------------------------------------
Assignee: George Leslie-Waksman (was: Holden Karau's magical unicorn)
> Celery executor restarts result in duplicate tasks
> --------------------------------------------------
>
> Key: AIRFLOW-1491
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1491
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: George Leslie-Waksman
> Assignee: George Leslie-Waksman
> Priority: Major
>
> Since the Celery executor uses internal state to determine what it has queued
> already, anything that wipes the executor state (such as a scheduler restart)
> will result in rescheduling of tasks.
> This bug exacerbates a number of task scheduling race conditions and can
> result in duplicate task execution.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
