[
https://issues.apache.org/jira/browse/HADOOP-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228710#comment-17228710
]
Steve Loughran commented on HADOOP-17366:
-----------------------------------------
{code}
[INFO] +- org.apache.spark:spark-hadoop-cloud_2.12:jar:3.1.0-SNAPSHOT:compile
[INFO] | +- org.apache.hadoop:hadoop-aws:jar:3.1.4:compile
[INFO] | | \- com.amazonaws:aws-java-sdk-bundle:jar:1.11.271:compile
[INFO] | +- org.apache.hadoop:hadoop-openstack:jar:3.1.4:compile
[INFO] | | +- org.apache.hadoop:hadoop-annotations:jar:3.1.4:compile
[INFO] | | | \- jdk.tools:jdk.tools:jar:1.8:system
[INFO] | | +- (org.apache.httpcomponents:httpcore:jar:4.4.4:compile - omitted
for conflict with 4.4.12)
[INFO] | | +-
(com.fasterxml.jackson.core:jackson-annotations:jar:2.10.0:compile - omitted
for duplicate)
[INFO] | | \- (com.fasterxml.jackson.core:jackson-databind:jar:2.10.0:compile
- omitted for duplicate)
[INFO] | +- joda-time:joda-time:jar:2.10.5:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.10.0:compile
[INFO] | | +-
(com.fasterxml.jackson.core:jackson-annotations:jar:2.10.0:compile - omitted
for duplicate)
[INFO] | | \- com.fasterxml.jackson.core:jackson-core:jar:2.10.0:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.0:compile
[INFO] | +-
com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.10.0:compile
[INFO] | | \- (com.fasterxml.jackson.core:jackson-core:jar:2.10.0:compile -
omitted for duplicate)
[INFO] | +- org.apache.httpcomponents:httpclient:jar:4.5.6:compile
[INFO] | | +- (org.apache.httpcomponents:httpcore:jar:4.4.10:compile -
omitted for conflict with 4.4.4)
[INFO] | | +- commons-logging:commons-logging:jar:1.1.3:compile
[INFO] | | \- commons-codec:commons-codec:jar:1.9:compile
[INFO] | +- org.apache.httpcomponents:httpcore:jar:4.4.12:compile
[INFO] | +- org.apache.hadoop:hadoop-azure:jar:3.1.4:compile
[INFO] | | +- (org.apache.httpcomponents:httpclient:jar:4.5.2:compile -
omitted for conflict with 4.5.6)
[INFO] | | +- com.microsoft.azure:azure-storage:jar:7.0.0:compile
[INFO] | | | +- org.slf4j:slf4j-api:jar:1.7.30:compile
[INFO] | | | \- com.microsoft.azure:azure-keyvault-core:jar:1.0.0:compile
[INFO] | | +- (org.eclipse.jetty:jetty-util-ajax:jar:9.4.20.v20190813:compile
- omitted for conflict with 9.4.28.v20200408)
[INFO] | | \-
(com.fasterxml.jackson.core:jackson-databind:jar:2.9.10.4:compile - omitted for
conflict with 2.10.0)
[INFO] | +- org.apache.hadoop:hadoop-cloud-storage:jar:3.1.4:compile
[INFO] | | +- (org.apache.hadoop:hadoop-annotations:jar:3.1.4:compile -
omitted for duplicate)
[INFO] | | +- org.apache.hadoop:hadoop-aliyun:jar:3.1.4:compile
[INFO] | | | \- com.aliyun.oss:aliyun-sdk-oss:jar:3.4.1:compile
[INFO] | | | +- org.jdom:jdom:jar:1.1:compile
[INFO] | | | +- org.codehaus.jettison:jettison:jar:1.1:compile
[INFO] | | | | \- stax:stax-api:jar:1.0.1:compile
[INFO] | | | +- com.aliyun:aliyun-java-sdk-core:jar:3.4.0:compile
[INFO] | | | +- com.aliyun:aliyun-java-sdk-ram:jar:3.0.0:compile
[INFO] | | | +- com.aliyun:aliyun-java-sdk-sts:jar:3.0.0:compile
[INFO] | | | \- com.aliyun:aliyun-java-sdk-ecs:jar:4.2.0:compile
[INFO] | | +- (org.apache.hadoop:hadoop-aws:jar:3.1.4:compile - omitted for
duplicate)
[INFO] | | +- (org.apache.hadoop:hadoop-azure:jar:3.1.4:compile - omitted for
duplicate)
[INFO] | | +- org.apache.hadoop:hadoop-azure-datalake:jar:3.1.4:compile
[INFO] | | | \-
com.microsoft.azure:azure-data-lake-store-sdk:jar:2.2.7:compile
[INFO] | | | \- (org.slf4j:slf4j-api:jar:1.7.21:compile - omitted for
conflict with 1.7.30)
[INFO] | | \- (org.apache.hadoop:hadoop-openstack:jar:3.1.4:compile - omitted
for duplicate)
{code}
> hadoop-cloud-storage transient dependencies need review
> -------------------------------------------------------
>
> Key: HADOOP-17366
> URL: https://issues.apache.org/jira/browse/HADOOP-17366
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build, fs, fs/azure
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Priority: Minor
>
> A review of the hadoop cloud storage dependencies shows that things are
> creeping in there
> {code}
> [INFO] | +- org.apache.hadoop:hadoop-cloud-storage:jar:3.1.4:compile
> [INFO] | | +- (org.apache.hadoop:hadoop-annotations:jar:3.1.4:compile -
> omitted for duplicate)
> [INFO] | | +- org.apache.hadoop:hadoop-aliyun:jar:3.1.4:compile
> [INFO] | | | \- com.aliyun.oss:aliyun-sdk-oss:jar:3.4.1:compile
> [INFO] | | | +- org.jdom:jdom:jar:1.1:compile
> [INFO] | | | +- org.codehaus.jettison:jettison:jar:1.1:compile
> [INFO] | | | | \- stax:stax-api:jar:1.0.1:compile
> [INFO] | | | +- com.aliyun:aliyun-java-sdk-core:jar:3.4.0:compile
> [INFO] | | | +- com.aliyun:aliyun-java-sdk-ram:jar:3.0.0:compile
> [INFO] | | | +- com.aliyun:aliyun-java-sdk-sts:jar:3.0.0:compile
> [INFO] | | | \- com.aliyun:aliyun-java-sdk-ecs:jar:4.2.0:compile
> [INFO] | | +- (org.apache.hadoop:hadoop-aws:jar:3.1.4:compile - omitted for
> duplicate)
> [INFO] | | +- (org.apache.hadoop:hadoop-azure:jar:3.1.4:compile - omitted
> for duplicate)
> [INFO] | | +- org.apache.hadoop:hadoop-azure-datalake:jar:3.1.4:compile
> [INFO] | | | \-
> com.microsoft.azure:azure-data-lake-store-sdk:jar:2.2.7:compile
> [INFO] | | | \- (org.slf4j:slf4j-api:jar:1.7.21:compile - omitted for
> conflict with 1.7.30)
> {code}
> Need to review and cut things which come in hadoop-common (slf4j, maybe some
> of the allyun stuff)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
