potiuk opened a new pull request #17682: URL: https://github.com/apache/airflow/pull/17682
This change implements lazy loading of individual hooks for providers manager. First the hooks list is discovered by the manager when hooks are accessed, but the hooks are not immediately imported - the hooks initially keep just a callable that will be used to retrieve the hook when first accessed. Besides listing details of all hooks, all Hooks are only imported when we want to retrieve the list of available field behaviours and widgets (which only happens in webserver and should happen anyway whenever one of those are needed because they are all collectively used in the connection view). In the case when hooks are accessed in tasks (connection.get_hook()) only the individual Hooks are imported when accessed. The chand deprecates 'hook-class-names' json-schema and replaces it with 'connection-types' because we need to know connection-type for each HookClass name declaratively so that we can utilse it in connection.get_hook() mehtod (otherwise we do not know which Hooks conrrespond to which connection type without importing them. The change is fully - backwards compatible. It adds deprecation warnings in case providers use the 'hook-class-names' property only and log warnings in case it provides both `hook-class-names' and `connection-types' but there are inconsistencies between those. <!-- Thank you for contributing! Please make sure that your code changes are covered with tests. And in case of new features or big changes remember to adjust the documentation. Feel free to ping committers for the review! In case of existing issue, reference it using one of the following: closes: #ISSUE related: #ISSUE How to write a good git commit message: http://chris.beams.io/posts/git-commit/ --> --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed. In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x). In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
