[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377701#comment-16377701
]
Hudson commented on HADOOP-15265:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13718 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/13718/])
HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being (arp:
rev 78a10029ec5b2ecc7b9448be6dc6a1875196a68f)
* (edit) hadoop-common-project/hadoop-auth/pom.xml
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Fix For: 3.1.0
>
> Attachments: HADOOP-15265.2.patch, HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377567#comment-16377567
]
genericqa commented on HADOOP-15265:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 18m
47s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 14m
45s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
36s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
44m 37s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
24s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 13m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
10m 25s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
24s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 3m
4s{color} | {color:green} hadoop-auth in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
36s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 75m 32s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:5b98639 |
| JIRA Issue | HADOOP-15265 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12912100/HADOOP-15265.2.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient xml |
| uname | Linux 69b5100f344e 3.13.0-135-generic #184-Ubuntu SMP Wed Oct 18
11:55:51 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 451265a |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_151 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/14213/testReport/ |
| Max. process+thread count | 341 (vs. ulimit of 1) |
| modules | C: hadoop-common-project/hadoop-auth U:
hadoop-common-project/hadoop-auth |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/14213/console |
| Powered by | Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377478#comment-16377478
]
Arpit Agarwal commented on HADOOP-15265:
+1 for the rebased patch, pending Jenkins.
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.2.patch, HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:335)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377457#comment-16377457
]
Nishant Bangarwa commented on HADOOP-15265:
---
[~arpitagarwal] rebased from apache trunk.
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.2.patch, HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:335)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377423#comment-16377423
]
Arpit Agarwal commented on HADOOP-15265:
+1 from me also, pending Jenkins.
[~nishantbangarwa], can you please rebase your patch to Apache trunk?
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:335)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377416#comment-16377416
]
Bharat Viswanadham commented on HADOOP-15265:
-
+1.
LGTM.
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:335)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377417#comment-16377417
]
genericqa commented on HADOOP-15265:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 5s{color}
| {color:red} HADOOP-15265 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-15265 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12912093/HADOOP-15265.patch |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/14212/console |
| Powered by | Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
>
[jira] [Commented] (HADOOP-15265) Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively
[
https://issues.apache.org/jira/browse/HADOOP-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377405#comment-16377405
]
Nishant Bangarwa commented on HADOOP-15265:
---
+cc [~arpitagarwal] [~rchiang]
> Exclude json-smart explicitly in hadoop-auth avoid being pulled in
> transitively
> ---
>
> Key: HADOOP-15265
> URL: https://issues.apache.org/jira/browse/HADOOP-15265
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Priority: Major
> Attachments: HADOOP-15265.patch
>
>
> this is an extension of - https://issues.apache.org/jira/browse/HADOOP-14903
> We need to exclude the dependency explicitly in hadoop-auth pom.xml and add
> the correct version so that it is not being pulled transitively.
> In Druid we use,
> [https://github.com/tesla/tesla-aether/blob/master/src/main/java/io/tesla/aether/TeslaAether.java]
> to fetch dependencies transitively, which is still pulling in wrong version
> of json-smart jar.
> {code:java}
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT{code}
>
> Full Stack trace
> {code:java}
> 2018/02/26 03:47:22 INFO: 2018-02-26T03:47:22,878 ERROR [main]
> io.druid.cli.PullDependencies - Unable to resolve artifacts for
> [io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 (runtime) ->
> [] < [ (https://repo1.maven.org/maven2/, releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (http://nexus-private.hortonworks.com/nexus/content/groups/public,
> releases+snapshots),
> (https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local,
> releases+snapshots)]].
> 2018/02/26 03:47:22 INFO:
> org.eclipse.aether.resolution.DependencyResolutionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:380)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> io.tesla.aether.internal.DefaultTeslaAether.resolveArtifacts(DefaultTeslaAether.java:289)
> ~[tesla-aether-0.0.5.jar:0.0.5]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.downloadExtension(PullDependencies.java:350)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.PullDependencies.run(PullDependencies.java:249)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: at
> io.druid.cli.Main.main(Main.java:108)
> [druid-services-0.10.1.2.6.5.0-129.jar:0.10.1.2.6.5.0-129]
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.collection.DependencyCollectionException: Failed to
> collect dependencies at
> io.druid.extensions:druid-hdfs-storage:jar:0.10.1.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-client:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-common:jar:2.7.3.2.6.5.0-129 ->
> org.apache.hadoop:hadoop-auth:jar:2.7.3.2.6.5.0-129 ->
> com.nimbusds:nimbus-jose-jwt:jar:4.41.1 ->
> net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:292)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:342)
> ~[aether-impl-0.9.0.M2.jar:?]
> 2018/02/26 03:47:22 INFO: ... 4 more
> 2018/02/26 03:47:22 INFO: Caused by:
> org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read
> artifact descriptor for net.minidev:json-smart:jar:2.3-SNAPSHOT
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:335)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
> org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
> ~[maven-aether-provider-3.1.1.jar:3.1.1]
> 2018/02/26 03:47:22 INFO: at
>
