GitHub user nitinmahawadiwar edited a discussion: Airflow 2.9.3 , KubernetesExecutor , worker pod creation in batch.
Hello team, I am trying to understand how to reduce the pod creation time in case of KubernetesExecutor, specially a case when parallel tasks are more and each task runs in separate pod. Google search results following two websites about the variable, but I couldn't find this variable in 2.9.3 source. Is this still applicable or the variable is changed/no longer supported. ? https://hevodata.com/learn/airflow-parallelism/ AIRFLOW_KUBERNETES_WORKER_PODS_CREATION_BATCH_SIZE (extra underscore is missing) https://www.astronomer.io/docs/learn/airflow-scaling-workers/ AIRFLOW__KUBERNETES__WORKER_PODS_CREATION_BATCH_SIZE can you please suggest appropriate documentation for 2.9.3 version. ? GitHub link: https://github.com/apache/airflow/discussions/44476 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
