JDarDagran commented on PR #40053:
URL: https://github.com/apache/airflow/pull/40053#issuecomment-2168178698
> I think we should only run the tests for the "upstream" provider. I.e. run
only the upstream provider tests when older versions of downstram providers are
installed. This will make the tests much smaller and it will avoid running long
tests for amazon/google multiple times. For example I'd just downgrade all
downstream providers for Google and run tests for Google provider only once. We
do not care which provider is problematic in this case so we can downgrade all
of them and check all of them at once.
That was my thinking too once I saw how long tests take. Will do the switch.
> This is easy. We just need to figure which version of the providers to
install, prepare all of them from head, remove the ones we want to replace and
run:
```pip download --no-deps apache-airflow-providers-xxxx==x.y.z
apache-airflow-providers-nnnn==x.y.z --dest ./dist```
As this is ran in parallel - doesn't each parallel breeze instance use the
same `./dist`? At the moment this is what I'm doing in the entrypoint script
(with `--mount tests` and Airflow installed from prepared wheel):
```
uv pip uninstall --python "$(which python)"
"apache-airflow-providers-${provider//./-}"
uv pip install --python "$(which python)" --constraint
https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-source-providers-${PYTHON_MAJOR_MINOR_VERSION}.txt
"apache-airflow-providers-${provider//./-}"
```
constraints are kind of blind shot but they worked.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
