ephraimbuddy commented on issue #57347: URL: https://github.com/apache/airflow/issues/57347#issuecomment-3455254178
Can you check the difference when you have it in the same namespace? The capacity of your cluster would determine the number of pods that can be run on the cluster. So you can increase parallelism but still be limited by your cluster capacity on the number of pods it can run. I also recommend increasing `AIRFLOW__KUBERNETES_EXECUTOR__WORKER_PODS_CREATION_BATCH_SIZE` to the size of your cluster -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
