raman created AIRFLOW-3516:
------------------------------
Summary: Improve K8 Executors Pod creation Rate
Key: AIRFLOW-3516
URL: https://issues.apache.org/jira/browse/AIRFLOW-3516
Project: Apache Airflow
Issue Type: Improvement
Components: executor, kubernetes, scheduler
Affects Versions: 1.10.1
Reporter: raman
It seems that Airflow scheduler is creating worker pod sequentially(one pod per
scheduler loop) in Kubernetes executors sync function which is called from base
executors.heartbeat() function.
One enhancement could be to create the k8 pod in batches where batch size can
be configured through airflow.cfg file
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
