[
https://issues.apache.org/jira/browse/AIRFLOW-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786692#comment-16786692
]
ASF subversion and git services commented on AIRFLOW-2156:
----------------------------------------------------------
Commit be7121b89416201df599da7f722738f29c0f6393 in airflow's branch
refs/heads/v1-10-stable from yrqls21
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=be7121b ]
[AIRFLOW-2156] Parallelize Celery Executor task state fetching (#3830)
> Parallelize Celery Executor
> ---------------------------
>
> Key: AIRFLOW-2156
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2156
> Project: Apache Airflow
> Issue Type: Improvement
> Components: celery
> Reporter: Dan Davydov
> Assignee: Kevin Yang
> Priority: Major
> Fix For: 1.10.3
>
>
> The CeleryExecutor doesn't currently support parallel execution to check task
> states since Celery does not support this. This can greatly slow down the
> Scheduler loops since each request to check a task's state is a network
> request.
>
> The Celery Executor should parallelize these requests.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
