potiuk commented on PR #40053: URL: https://github.com/apache/airflow/pull/40053#issuecomment-2168158895
> @potiuk seems like the general idea works. However, the fully automated way runs heavy tests for google/amazon multiple times. I wonder if there's a way to mark cross-provider tests somehow but at the moment it seems improbable. I think we should only run the tests for the "upstream" provider. I.e. run only the upstream provider tests when older versions of downstram providers are installed. This will make the tests much smaller and it will avoid running long tests for amazon/google multiple times. For example I'd just downgrade all downstream providers for Google and run tests for Google provider only once. We do not care which provider is problematic in this case so we can downgrade all of them and check all of them at once. > Also: I'm not sure how to deal with running all providers and airflow core from HEAD but selected providers to be installed and used from downloaded released package. So far I've been preparing all packages to wheels and installing all needed packages per test. This is easy. We just need to figure which version of the providers to install, prepare all of them from head, remove the ones we want to replace and run: ``` pip download --no-deps apache-airflow-providers-xxxx==x.y.z apache-airflow-providers-nnnn==x.y.z --dest ./dist ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
