[jira] [Updated] (HADOOP-13989) Remove erroneous source jar option from hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas updated HADOOP-13989:
Attachment: HADOOP-13989.003.patch
Needed rebase after HADOOP-13999
> Remove erroneous source jar option from hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Assignee: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch, HADOOP-13989.002.patch,
> HADOOP-13989.003.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13989) Remove erroneous source jar option from hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas updated HADOOP-13989:
Assignee: Joe Pallas
Status: Patch Available (was: Reopened)
> Remove erroneous source jar option from hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Assignee: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch, HADOOP-13989.002.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-13989) Remove erroneous source jar option from hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830532#comment-15830532
]
Joe Pallas edited comment on HADOOP-13989 at 1/19/17 8:16 PM:
--
Repeal now, replace later (new patch)
was (Author: jpallas):
Repeal now, replace later
> Remove erroneous source jar option from hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch, HADOOP-13989.002.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13989) Remove erroneous source jar option from hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas updated HADOOP-13989:
Attachment: HADOOP-13989.002.patch
Repeal now, replace later
> Remove erroneous source jar option from hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch, HADOOP-13989.002.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828775#comment-15828775
]
Joe Pallas commented on HADOOP-13989:
-
Agreed, the current {{createSourceJar}} option does nothing (except possibly
confuse people who are looking for source jars), so removing it seems
reasonable.
I'm not sure about the JIRA protocol here: would we rename this JIRA to
something like "Remove erroneous source jar option from hadoop-client shade
configuration" and open a new one for something like "Create shaded sources
jars in hadoop-client modules"?
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827224#comment-15827224
]
Joe Pallas commented on HADOOP-13989:
-
So far my experiments with {{true}} have not
been successful, although the shade plugin is cited by the jar plugin
documentation for forceCreation as a use case. I'm guessing that something
about the handling of sources jars is different or broken.
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826847#comment-15826847
]
Joe Pallas commented on HADOOP-13989:
-
[~busbey], it looks like there is such a known bug in the shade plugin
(MSHADE-126, resolved as Won't Fix). The workaround is to force the jar file
to be recreated every time. Doing {{clean install}} followed by {{deploy}} did
reproduce the problem in my environment, so at least I can verify an attempted
solution.
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826683#comment-15826683
]
Joe Pallas commented on HADOOP-13989:
-
That's a fair point. Since I haven't been able to reproduce the problem, I'm
not able to confirm that reversion fixes it. All I have to go on is that the
last successful build was just before the change and the first failing build
only included this and YARN-6057 (changes to {{yarn-default.xml}}). So, any
changes in dependencies would have to be outside of hadoop, I think. Are there
unstable dependencies?
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Reopened] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas reopened HADOOP-13989:
-
Assignee: (was: Joe Pallas)
The build failure that was reported appears during {{mvn deploy}}, but not
during {{mvn install}}. This is puzzling, since the change is to the shade
configuration, and shade is run during the packaging phase of the lifecycle. I
haven't been able to reproduce the problem in my build environment, either.
This seemingly trivial fix may actually require someone who is much more of a
Maven wizard than I am. ([~busbey]?)
For now it looks like the only sensible thing is to revert the commit,
[~ajisakaa]. Do you agree?
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826471#comment-15826471
]
Joe Pallas commented on HADOOP-13989:
-
I don't get it. Pre-commit build was fine, but the build failure certainly
seems to be connected to this change.
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Assignee: Joe Pallas
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas updated HADOOP-13989:
Fix Version/s: 3.0.0-alpha2
Status: Patch Available (was: Open)
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13989) Fix typo in hadoop-client shade configuration
[
https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Pallas updated HADOOP-13989:
Attachment: HADOOP-13989.001.patch
> Fix typo in hadoop-client shade configuration
> -
>
> Key: HADOOP-13989
> URL: https://issues.apache.org/jira/browse/HADOOP-13989
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Affects Versions: 3.0.0-alpha2
>Reporter: Joe Pallas
>Priority: Minor
> Attachments: HADOOP-13989.001.patch
>
>
> The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
> typo in the configuration of the shade module. They say
> {{}} instead of {{}}. (This was noticed
> by IntelliJ, but not by maven.)
> Shade plugin doc is at
> [http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13989) Fix typo in hadoop-client shade configuration
Joe Pallas created HADOOP-13989:
---
Summary: Fix typo in hadoop-client shade configuration
Key: HADOOP-13989
URL: https://issues.apache.org/jira/browse/HADOOP-13989
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 3.0.0-alpha2
Reporter: Joe Pallas
Priority: Minor
The pom files for hadoop-client-minicluster and hadoop-client-runtime have a
typo in the configuration of the shade module. They say {{}}
instead of {{}}. (This was noticed by IntelliJ, but not by
maven.)
Shade plugin doc is at
[http://maven.apache.org/plugins/maven-shade-plugin/shade-mojo.html#createSourcesJar].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13922) Some modules have dependencies on hadoop-client jar removed by HADOOP-11804
[ https://issues.apache.org/jira/browse/HADOOP-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784367#comment-15784367 ] Joe Pallas commented on HADOOP-13922: - I confirmed that a build with a novel version number works with this patch. With regard to the packaging question, my Maven experience is pretty vanilla, and I had to read up in the Sonatype book to get a better understanding of when and how pom packaging should be used. To be honest, that left me with very little understanding/motivation for using pom packaging outside of inter-module dependencies within a single project. > Some modules have dependencies on hadoop-client jar removed by HADOOP-11804 > --- > > Key: HADOOP-13922 > URL: https://issues.apache.org/jira/browse/HADOOP-13922 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.0.0-alpha2 >Reporter: Joe Pallas >Assignee: Sean Busbey >Priority: Blocker > Attachments: HADOOP-13922.1.patch > > > As discussed in [HADOOP-11804 comment > 15758048|https://issues.apache.org/jira/browse/HADOOP-11804?focusedCommentId=15758048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15758048] > and following comments, there are still dependencies on the now-removed > hadoop-client jar. The current code builds only because an obsolete snapshot > of the jar is found on the repository server. Changing the project version > to something new exposes the problem. > While the build currently dies at hadoop-tools/hadoop-sls, I'm seeing issues > with some Hadoop Client modules, too. > I'm filing a new bug because I can't reopen HADOOP-11804. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13922) Some modules have dependencies on hadoop-client jar removed by HADOOP-11804
[ https://issues.apache.org/jira/browse/HADOOP-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HADOOP-13922: Description: As discussed in [HADOOP-11804 comment 15758048|https://issues.apache.org/jira/browse/HADOOP-11804?focusedCommentId=15758048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15758048] and following comments, there are still dependencies on the now-removed hadoop-client jar. The current code builds only because an obsolete snapshot of the jar is found on the repository server. Changing the project version to something new exposes the problem. While the build currently dies at hadoop-tools/hadoop-sls, I'm seeing issues with some Hadoop Client modules, too. I'm filing a new bug because I can't reopen HADOOP-11804. was: As discussed in [HADOOP-11804 comment 15758048|https://issues.apache.org/jira/browse/HADOOP-11804?focusedCommentId=15758048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15758048] and following comments, there are still dependencies on the now-removed hadoop-client jar. The current code builds only because an obsolete snapshot of the jar is found on the repository server. Changing the project version to something new exposes the problem. While the build currently dies at hadoop-tools/hadoop-sls, I'm seeing issues with some Hadoop Client modules, too. I'm filing a new bug because I can't reopen HDFS-11804. > Some modules have dependencies on hadoop-client jar removed by HADOOP-11804 > --- > > Key: HADOOP-13922 > URL: https://issues.apache.org/jira/browse/HADOOP-13922 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 3.0.0-alpha2 >Reporter: Joe Pallas >Priority: Blocker > > As discussed in [HADOOP-11804 comment > 15758048|https://issues.apache.org/jira/browse/HADOOP-11804?focusedCommentId=15758048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15758048] > and following comments, there are still dependencies on the now-removed > hadoop-client jar. The current code builds only because an obsolete snapshot > of the jar is found on the repository server. Changing the project version > to something new exposes the problem. > While the build currently dies at hadoop-tools/hadoop-sls, I'm seeing issues > with some Hadoop Client modules, too. > I'm filing a new bug because I can't reopen HADOOP-11804. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-11804) Shaded Hadoop client artifacts and minicluster
[ https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762708#comment-15762708 ] Joe Pallas commented on HADOOP-11804: - I opened HADOOP-13922 because we didn't have any open bug capturing that the build really is broken. No criticism of [~busbey] intended. > Shaded Hadoop client artifacts and minicluster > -- > > Key: HADOOP-11804 > URL: https://issues.apache.org/jira/browse/HADOOP-11804 > Project: Hadoop Common > Issue Type: Sub-task > Components: build >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 3.0.0-alpha2 > > Attachments: HADOOP-11804.1.patch, HADOOP-11804.10.patch, > HADOOP-11804.11.patch, HADOOP-11804.12.patch, HADOOP-11804.13.patch, > HADOOP-11804.14.patch, HADOOP-11804.2.patch, HADOOP-11804.3.patch, > HADOOP-11804.4.patch, HADOOP-11804.5.patch, HADOOP-11804.6.patch, > HADOOP-11804.7.patch, HADOOP-11804.8.patch, HADOOP-11804.9.patch, > hadoop-11804-client-test.tar.gz > > > make a hadoop-client-api and hadoop-client-runtime that i.e. HBase can use to > talk with a Hadoop cluster without seeing any of the implementation > dependencies. > see proposal on parent for details. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13922) Some modules have dependencies on hadoop-client jar removed by HADOOP-11804
Joe Pallas created HADOOP-13922: --- Summary: Some modules have dependencies on hadoop-client jar removed by HADOOP-11804 Key: HADOOP-13922 URL: https://issues.apache.org/jira/browse/HADOOP-13922 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: 3.0.0-alpha2 Reporter: Joe Pallas Priority: Blocker As discussed in [HADOOP-11804 comment 15758048|https://issues.apache.org/jira/browse/HADOOP-11804?focusedCommentId=15758048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15758048] and following comments, there are still dependencies on the now-removed hadoop-client jar. The current code builds only because an obsolete snapshot of the jar is found on the repository server. Changing the project version to something new exposes the problem. While the build currently dies at hadoop-tools/hadoop-sls, I'm seeing issues with some Hadoop Client modules, too. I'm filing a new bug because I can't reopen HDFS-11804. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-11804) Shaded Hadoop client artifacts and minicluster
[
https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15758048#comment-15758048
]
Joe Pallas commented on HADOOP-11804:
-
I think there's a problem with this change. When I change the project version
to something that's not already in the Apache maven repository (e.g.,
3.0.0-beta1-SNAPSHOT), my build fails:
{noformat}
[ERROR] Failed to execute goal on project hadoop-sls: Could not resolve
dependencies for project org.apache.hadoop:hadoop-sls:jar:3.0.0-beta1: Could
not find artifact org.apache.hadoop:hadoop-client:jar:3.0.0-beta1 in
apache.snapshots.https
(https://repository.apache.org/content/repositories/snapshots) -> [Help 1]
{noformat}
It looks like the current trunk is building only because there is a left-over
3.0.0-alpha2-SNAPSHOT of hadoop-client:jar in the repository. The patch
changed hadoop-client from jar packaging to pom packaging.
> Shaded Hadoop client artifacts and minicluster
> --
>
> Key: HADOOP-11804
> URL: https://issues.apache.org/jira/browse/HADOOP-11804
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build
>Reporter: Sean Busbey
>Assignee: Sean Busbey
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-11804.1.patch, HADOOP-11804.10.patch,
> HADOOP-11804.11.patch, HADOOP-11804.12.patch, HADOOP-11804.13.patch,
> HADOOP-11804.14.patch, HADOOP-11804.2.patch, HADOOP-11804.3.patch,
> HADOOP-11804.4.patch, HADOOP-11804.5.patch, HADOOP-11804.6.patch,
> HADOOP-11804.7.patch, HADOOP-11804.8.patch, HADOOP-11804.9.patch,
> hadoop-11804-client-test.tar.gz
>
>
> make a hadoop-client-api and hadoop-client-runtime that i.e. HBase can use to
> talk with a Hadoop cluster without seeing any of the implementation
> dependencies.
> see proposal on parent for details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set
[
https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755651#comment-15755651
]
Joe Pallas commented on HADOOP-13852:
-
Maven is issuing dozens of warnings:
{noformat}
[WARNING] Some problems were encountered while building the effective model for
org.apache.hadoop:hadoop-project:pom:3.0.0-alpha2-SNAPSHOT
[WARNING] The expression ${pom.version} is deprecated. Please use
${project.version} instead.
{noformat}
> hadoop build to allow hadoop version property to be explicitly set
> --
>
> Key: HADOOP-13852
> URL: https://issues.apache.org/jira/browse/HADOOP-13852
> Project: Hadoop Common
> Issue Type: New Feature
> Components: build
>Affects Versions: 3.0.0-alpha1, 3.0.0-alpha2
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13582-003.patch, HADOOP-13852-001.patch,
> HADOOP-13852-002.patch, HADOOP-13852-003.patch
>
>
> Hive (and transitively) Spark, won't start on Hadoop 3.x as the shim layer
> rejects Hadoop v3. As a workaround pending a Hive fix, allow the build to
> have the Hadoop version (currently set to pom.version) to be overridden
> manually.
> This will not affect version names of artifacts, merely the declared Hadoop
> version visible in {{VersionInfo.getVersion()}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-9279) Document the need to build hadoop-maven-plugins for eclipse and separate project builds
[
https://issues.apache.org/jira/browse/HADOOP-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313203#comment-14313203
]
Joe Pallas commented on HADOOP-9279:
Is the current documentation still misleading? It seems that doing a top-level
{{mvn compile}} starting with an empty local repository will fail; and a {{mvn
install}} that includes {{hadoop-maven-plugins}} *must* be done first.
Document the need to build hadoop-maven-plugins for eclipse and separate
project builds
---
Key: HADOOP-9279
URL: https://issues.apache.org/jira/browse/HADOOP-9279
Project: Hadoop Common
Issue Type: Improvement
Components: build, documentation
Affects Versions: 3.0.0
Environment: hadoop-maven-plugins-3.0.0-SNAPSHOT.jar doesn't exist in
local repository or at maven central repository.
Reporter: Tsuyoshi OZAWA
Assignee: Tsuyoshi OZAWA
Fix For: 2.1.0-beta
Attachments: HADOOP-9279.2.patch, HADOOP-9279.3.patch,
HADOOP-9279.patch
In current hadoop-trunk, compile fails when
hadoop-maven-plugins-3.0.0-SNAPSHOT.jar doesn't exist in local repository or
at maven central repository.
The affected components are:
./hadoop-common-project/hadoop-common/pom.xml
./hadoop-maven-plugins/pom.xml
./hadoop-project/pom.xml
./hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/pom.xml
The error log is as follows
{quote}
[ERROR] Plugin org.apache.hadoop.maven.plugin:hadoop-maven-plugins:1.0 or one
of its dependencies could not be resolved: Failed to read artifact descriptor
for org.apache.hadoop.maven.plugin:hadoop-maven-plugins:jar:1.0: Could not
find artifact org.apache.hadoop.maven.plugin:hadoop-maven-plugins:pom:1.0 in
central (http://repo.maven.apache.org/maven2) - [Help 1]
{quote}
This can be avoidable if hadoop-maven-plugins is installed before packaging.
This is undocumented, so this should get documented.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
