[
https://issues.apache.org/jira/browse/AIRFLOW-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012931#comment-17012931
]
ASF subversion and git services commented on AIRFLOW-5167:
----------------------------------------------------------
Commit 415d41977ddc08d8237ca29eb7057e49d4a8f855 in airflow's branch
refs/heads/master from Ray
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=415d419 ]
[AIRFLOW-5167] Update dependencies for GCP packages (#7116)
> Dependancy conflict with grpc-google-iam-v1
> -------------------------------------------
>
> Key: AIRFLOW-5167
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5167
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Affects Versions: 1.10.4
> Reporter: Sujay Mansingh
> Priority: Trivial
>
> If we use a tool that does script requirements checking (e.g.
> {{pip-compile}}) then an erroe is thrown when handling the dependencies for
> {{apache-airflow[gcp_api]}}
> {code:java}
> $ pip-compile --version
> pip-compile, version 3.7.0
> $ cat requirements.in
> apache-airflow[gcp_api]
> $ pip-compile -o requirements.txt requirements.in
> Could not find a version that matches
> grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2,
> 0.12.3
> There are incompatible versions in the resolved dependencies.
> {code}
> Looks like a set of inconsistent dependencies in the google libs :/
> {code:java}
> $ pip-compile -v -o requirements.txt requirements.in | grep -i grpc-google-iam
> google-cloud-container==0.3.0 requires
> google-api-core[grpc]<2.0.0dev,>=1.14.0, grpc-google-iam-v1<0.13dev,>=0.12.3
> google-cloud-bigtable==0.33.0 requires
> google-api-core[grpc]<2.0.0dev,>=1.6.0, google-cloud-core<2.0dev,>=1.0.0,
> grpc-google-iam-v1<0.12dev,>=0.11.4
> google-cloud-spanner==1.9.0 requires
> google-api-core[grpc,grpcgcp]<2.0.0dev,>=1.4.1,
> google-cloud-core<2.0dev,>=1.0.0, grpc-google-iam-v1<0.12dev,>=0.11.4
> adding ['grpc-google-iam-v1', '<0.12dev,<0.13dev,>=0.11.4,>=0.12.3', '[]']
> grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Could not find a version that matches
> grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2,
> 0.12.3
> There are incompatible versions in the resolved dependencies.
> {code}
> So it looks like {{google-cloud-bigtable==0.33.0}} and
> {{google-cloud-spanner==1.9.0}} require a version that is {{>=0.11.4}} and
> {{<0.12dev}}
> {{google-cloud-container==0.3.0}} upsets everything though by specifying
> version {{>=0.12.3}} and {{<0.13dev}}
> For now, we can work around issue by not checking any conflicts when
> installing {{apache_airflow[gcp]}}.
> That isn't ideal
> - All it means is that the version of {{grpc-google-iam-v1}} that is
> specified last will be installed
> - I'm assuming that there are no major api changes in {{grpc-google-iam}}
> between {{<0.12dev}} and {{<0.13dev}}. If there are then I imagine tests
> would fail, but it still feels a little wrong to allow use of a lib that
> doesn't match the version required
> - Relaxing the check just means that we could have a conflict elsewhere that
> isn't reported
> I understand this is not an issue with airflow, but more to do with the
> google python libraries.
> However it does affect us when we try to use airflow and be strict with
> python requirements.
> Any ideas on what to do?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
