mik-laj commented on a change in pull request #7391: [AIRFLOW-6663] Prepare
backporting packages
URL: https://github.com/apache/airflow/pull/7391#discussion_r376827479
##########
File path: setup.py
##########
@@ -591,5 +594,144 @@ def do_setup():
)
+PROVIDERS_DEPENDENCIES = {
+ "amazon": [aws],
+ "apache.cassandra": [cassandra],
+ "apache.druid": [druid],
+ "apache.hdfs": [hdfs],
+ "apache.hive": [hive],
+ "apache.pig": [],
+ "apache.pinot": [pinot],
+ "apache.spark": [],
+ "apache.sqoop": [],
+ "celery": [celery],
+ "cloudant": [cloudant],
+ "cncf.kubernetes": [kubernetes],
+ "databricks": [databricks],
+ "datadog": [datadog],
+ "dingding": [],
+ "discord": [],
+ "docker": [docker],
+ "email": [],
+ "ftp": [],
+ "google.cloud": [gcp],
Review comment:
For me it seems reasonable to release it as one package because all
integration requires a common hook - CloudBaseHook. The division into various
departments e.g. cloud, ads, marketing_platform, analytics can also change over
time. Currently, this is not a big problem, because we focused mainly on GCP,
where the division into departments is clear, but other services do not have a
clear division. For example: Google Ads is not related to Google Marketing
Platform, Google Analytics is also not related to GMP. Why? I don't know that,
but for new people, understanding these structures will be problematic.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services