[
https://issues.apache.org/jira/browse/AIRFLOW-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743482#comment-16743482
]
ASF subversion and git services commented on AIRFLOW-3516:
----------------------------------------------------------
Commit a7e369f082025fb089d909a6978106bb7cd24798 in airflow's branch
refs/heads/master from raman
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=a7e369f ]
[AIRFLOW-3516] Support to create k8 worker pods in batches (#4434)
> Improve K8 Executors Pod creation Rate
> --------------------------------------
>
> Key: AIRFLOW-3516
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3516
> Project: Apache Airflow
> Issue Type: Improvement
> Components: executor, kubernetes
> Affects Versions: 1.10.1
> Reporter: raman
> Assignee: raman
> Priority: Major
>
> It seems that Airflow scheduler is creating worker pod sequentially(one pod
> per scheduler loop) in Kubernetes executors sync function which is called
> from base executors.heartbeat() function.
> One enhancement could be to create the k8 pod in batches where batch size can
> be configured through airflow.cfg file
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
