[
https://issues.apache.org/jira/browse/HADOOP-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079256#comment-17079256
]
Steve Loughran commented on HADOOP-16855:
-----------------------------------------
Looking at the wildfly dependencies
hadoop-common, "provided" . == compile with but dont' force it downstream
hadoop-azure: runtime: don't build, but put on downstream CP
org.wildfly.openssl:wildfly-openssl:jar:1.0.7.Final:runtime . *this is new*
hadoop-cloud-storage
{code}
[INFO] +- org.apache.hadoop:hadoop-aws:jar:3.4.0-SNAPSHOT:compile
[INFO] | +- com.amazonaws:aws-java-sdk-bundle:jar:1.11.563:compile
[INFO] | \- org.wildfly.openssl:wildfly-openssl:jar:1.0.7.Final:compile
[INFO] +- org.apache.hadoop:hadoop-azure:jar:3.4.0-SNAPSHOT:compile
[INFO] | +- com.microsoft.azure:azure-storage:jar:7.0.0:compile
[INFO] | | \- com.microsoft.azure:azure-keyvault-core:jar:1.0.0:compile
[INFO] | +- org.eclipse.jetty:jetty-util-ajax:jar:9.4.20.v20190813:compile
[INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
[INFO] | \- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
[INFO] +- org.apache.hadoop:hadoop-azure-datalake:jar:3.4.0-SNAPSHOT:compile
[INFO] | \- com.microsoft.azure:azure-data-lake-store-sdk:jar:2.3.6:compile
{code}
{code}
[INFO] | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.3:compile
[INFO] +- org.apache.hadoop:hadoop-aws:jar:3.4.0-SNAPSHOT:compile
[INFO] | +- com.amazonaws:aws-java-sdk-bundle:jar:1.11.563:compile
[INFO] | \- org.wildfly.openssl:wildfly-openssl:jar:1.0.7.Final:compile
{code}
* because com.microsoft.azure:azure-data-lake-store-sdk has hidden wildfly 1.0
in its JAR, it may always have been there, and now hadoop-aws declares it as a
new dependency.
* it now gets into the hadoop dist on ASF builds through hadoop-aws
If microsoft builds are excluding hadoop-aws, then hadoop-azure will fall off
the CP
* I don't want hadoop-aws to add yet another dependency. you don't need wildfly
except in deployments where you have a compatible openssl*
* For hadoop-azure, given it was always mandatory, we can do so again. it
should be fine as is.*
We have enough classpath problems to not want to any add more downstream.
> ABFS: hadoop-dist fails to add wildfly in class path for hadoop-azure
> ---------------------------------------------------------------------
>
> Key: HADOOP-16855
> URL: https://issues.apache.org/jira/browse/HADOOP-16855
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build, fs/azure, fs/s3
> Affects Versions: 3.3.0
> Reporter: Sneha Vijayarajan
> Assignee: Bilahari T H
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
