xinbinhuang commented on a change in pull request #14554:
URL: https://github.com/apache/airflow/pull/14554#discussion_r585867407
##########
File path: airflow/providers/apache/beam/provider.yaml
##########
@@ -41,6 +41,3 @@ hooks:
- integration-name: Apache Beam
python-modules:
- airflow.providers.apache.beam.hooks.beam
-
-hook-class-names:
- - airflow.providers.apache.beam.hooks.beam.BeamHook
Review comment:
I think it's a bit tricky for `BeamHook` to have those attributes
because Beam doesn't tie to a specified "backend/runner", it can be run on
Dataflow, Flink, Spark, etc. and so their credentials may also come in
different forms (i.e. the current operator is using `GcsHook`).
I think it's possible to specify those attributes, but it requires some
extra thoughts on what the `Connection` object for Beam will look like. For
now, we can at least get rid of those warnings whenever `ProvidersManager` is
instantiated, and this is the intention of this PR.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
