dstandish commented on PR #40568: URL: https://github.com/apache/airflow/pull/40568#issuecomment-2211458880
But yeah, re your comments on the first PR, I think yeah it would be a good idea to try and repro the users's situation. You would ask what their setup is, how many tasks are concurrently waiting for pods to start -- I presume this is celery? This would help you understand whether the issue is real. E.g. is there not another noisy neighbor that is using lots of CPU. But then, in any case, having repro'd it, you could use the same setup to evaluate whether your enhancement helps and if so how much and under what scenarios -- whether it is this optimization or some other one such as longer waits. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
