Dan Davydov created AIRFLOW-1024:
------------------------------------
Summary: Handle CeleryExecutor errors gracefully
Key: AIRFLOW-1024
URL: https://issues.apache.org/jira/browse/AIRFLOW-1024
Project: Apache Airflow
Issue Type: Bug
Reporter: Dan Davydov
If the Airflow celery executor receives a bad response from a worker (e.g.
unpickled response), then it will crash the scheduler and cause it to restart.
We should code defensively around the interactions with celery so that we just
log errors instead of crashing the scheduler.
It might makes sense to make the try catches one level higher (to catch errors
from all executors), but this needs some investigation.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)