[
https://issues.apache.org/jira/browse/AIRFLOW-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280614#comment-16280614
]
Chris Riccomini commented on AIRFLOW-15:
----------------------------------------
[~barrywhart], to be honest, I am not sure what the right path forward is. I
was told specifically by several Google PMs at Google Next last year not to use
the idiomatic library. Since then, the message you are pointing to has appeared
on the google python client.
The use case is further muddied by the fact that I'm not convinced an idiomatic
Python client is actually what we want. The fact that the Google APIs all work
the same way in the service binding API makes it pretty easy to abstract over a
lot of the mechanics around interacting with Google in a generic way that can
be leveraged by all GCP operators. I haven't looked into whether or not this
overhead would increase if we went to an idiomatic library where interacting
with GCS might look very different from interacting with Dataflow, etc.
> Remove GCloud from Airflow
> --------------------------
>
> Key: AIRFLOW-15
> URL: https://issues.apache.org/jira/browse/AIRFLOW-15
> Project: Apache Airflow
> Issue Type: Task
> Components: gcp
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Labels: gcp
>
> After speaking with Google, there was some concern about using the
> [gcloud-python|https://github.com/GoogleCloudPlatform/gcloud-python] library
> for Airflow. There are several concerns:
> # It's not clear (even to people at Google) what this library is, who owns
> it, etc.
> # It does not support all services (the way
> [google-api-python-client|https://github.com/google/google-api-python-client]
> does).
> # There are compatibility issues between google-api-python-client and
> gcloudpython.
> We currently support both, after libraries depending on which package you you
> install: {{airfow[gcp_api]}} or {{airflow[gcloud]}}. This ticket is to remove
> the {{airflow[gcloud]}} packaged, and all associated code.
> The main associated code, afaik, is the use of the {{gcloud}} library in the
> Google cloud storage hooks/operators--specifically for Google cloud storage
> Airfow logging.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
