[
https://issues.apache.org/jira/browse/AIRFLOW-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158429#comment-16158429
]
Ash Berlin-Taylor commented on AIRFLOW-129:
-------------------------------------------
Will be fixed by the more general solution to AIRFLOW-1527
> Allow CELERYD_PREFETCH_MULTIPLIER to be configurable
> ----------------------------------------------------
>
> Key: AIRFLOW-129
> URL: https://issues.apache.org/jira/browse/AIRFLOW-129
> Project: Apache Airflow
> Issue Type: Improvement
> Components: celery
> Affects Versions: Airflow 1.7.0
> Reporter: Nam Ngo
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Airflow needs to allow everyone to customise their prefetch limit. Some might
> have short running task and don't want the overhead of celery latency.
> More on that here:
> http://docs.celeryproject.org/en/latest/userguide/optimizing.html#optimizing-prefetch-limit
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)