[
https://issues.apache.org/jira/browse/AIRFLOW-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282154#comment-16282154
]
Chris Riccomini commented on AIRFLOW-15:
----------------------------------------
[~fenglu], that sounds good to me. This JIRA is actually about removing the
gcloud library, though. [~fenglu], can you open a new JIRA that proposes what
you're saying, and assign to yourself for process tracking?
Also, we need to make sure that the compatibility issues are worked out. Last
time we tried running both in parallel, we had major dependency conflict issues
(see third bullet point in the description of this JIRA).
> Remove GCloud from Airflow
> --------------------------
>
> Key: AIRFLOW-15
> URL: https://issues.apache.org/jira/browse/AIRFLOW-15
> Project: Apache Airflow
> Issue Type: Task
> Components: gcp
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Labels: gcp
>
> After speaking with Google, there was some concern about using the
> [gcloud-python|https://github.com/GoogleCloudPlatform/gcloud-python] library
> for Airflow. There are several concerns:
> # It's not clear (even to people at Google) what this library is, who owns
> it, etc.
> # It does not support all services (the way
> [google-api-python-client|https://github.com/google/google-api-python-client]
> does).
> # There are compatibility issues between google-api-python-client and
> gcloudpython.
> We currently support both, after libraries depending on which package you you
> install: {{airfow[gcp_api]}} or {{airflow[gcloud]}}. This ticket is to remove
> the {{airflow[gcloud]}} packaged, and all associated code.
> The main associated code, afaik, is the use of the {{gcloud}} library in the
> Google cloud storage hooks/operators--specifically for Google cloud storage
> Airfow logging.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
