potiuk commented on pull request #12512: URL: https://github.com/apache/airflow/pull/12512#issuecomment-731781430
Hey @ashb. It's green - this one is "pure" provider discovery - without connections/extra links - it just contains the discovery and restructured provider package tests to show better what's happening. Right now what happens: 1) for backport providers I install airflow 1.10.12 (soon 1.10.13) install all the provider.whl and provider.tgz packages and check if all classes from airlfow.providers are importable 2) for regular providers, I prepare now "airflow" wheel package and install it from there (not from sources directly) and install all the providers from packages (whl or .tgz - I run two checks), I check if all providers are importable and then I run the new `airflow providers list` command to get all the providers and see if we see the expected number of providers as output. This does not work now because we have import version conflict problems, but once we solve it, it should work - we have 59 out of 60 now - so for now I just skip the number check. See here: https://github.com/apache/airflow/runs/1438201616?check_suite_focus=true#step:9:4436 I will continue on rebasing the others and we can discuss tomorrow how close we can get to support the cases that you have in mind (with plugins) not only the providers. I think we can find some good future-proof solutions now, I simply do not have the capacity to also implement plugins at the same time, but I think if we implement it correctly, we can have a follow up PR implementing the "plugin" case you mentioned as well, without some heavy modifications. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
