potiuk commented on PR #25583: URL: https://github.com/apache/airflow/pull/25583#issuecomment-1207434145
Hey @ephraimbuddy and @jedcunningham - I know you've been looking for ways how to speed up the Helm Unit tests on CI and here it is. Seems that `pytest xdist` is actually lying us a little when we use `auto` switch and it runs number of parallel tests corresponding to a number of CPUs we have rather than number of cores. And we have 2x number of cores than CPUS. It looked like our workers were just ~65% busy with Helm Tests. Let's see the docker-compose ones and Public Runners, but the first test have shown going down from 32 to even 18 minutes to run full suite of Helm Unit tests on Self Hosted runners :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
