Dan Davydov created AIRFLOW-1024:
------------------------------------

             Summary: Handle CeleryExecutor errors gracefully
                 Key: AIRFLOW-1024
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1024
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Dan Davydov


If the Airflow celery executor receives a bad response from a worker (e.g. 
unpickled response), then it will crash the scheduler and cause it to restart.

We should code defensively around the interactions with celery so that we just 
log errors instead of crashing the scheduler.

It might makes sense to make the try catches one level higher (to catch errors 
from all executors), but this needs some investigation.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to