[jira] [Created] (HADOOP-17965) Fix documentation build failure using create-release on branch-2.10
Masatake Iwasaki created HADOOP-17965:
-
Summary: Fix documentation build failure using create-release on
branch-2.10
Key: HADOOP-17965
URL: https://issues.apache.org/jira/browse/HADOOP-17965
Project: Hadoop Common
Issue Type: Bug
Components: build
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-site-plugin:3.5:site (default-site) on project
hadoop-yarn-project: Execution default-site of goal
org.apache.maven.plugins:maven-site-plugin:3.5:site failed: An API
incompatibility was encountered while executing
org.apache.maven.plugins:maven-site-plugin:3.5:site:
java.lang.UnsupportedClassVersionError:
org/codehaus/mojo/spotbugs/SpotbugsViolationCheckMojo : Unsupported major.minor
version 52.0
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17964) Increase Java heap size for running Maven in Dockerfile of branch-2.10
[
https://issues.apache.org/jira/browse/HADOOP-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427757#comment-17427757
]
Masatake Iwasaki commented on HADOOP-17964:
---
I got a bit different stack trace on another run.
{noformat}
$ tail -n 14 patchprocess/mvn_install.log
---
Exception in thread "main" java.lang.OutOfMemoryError: PermGen space
at
java.util.concurrent.CopyOnWriteArrayList.iterator(CopyOnWriteArrayList.java:961)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:877)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:607)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
{noformat}
> Increase Java heap size for running Maven in Dockerfile of branch-2.10
> --
>
> Key: HADOOP-17964
> URL: https://issues.apache.org/jira/browse/HADOOP-17964
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> I got OOM on running create-release script in branch-2.10.
> {noformat}
> $ ./dev-support/bin/create-release --docker --dockercache --native
> $ tail -n 5 patchprocess/mvn_install.log
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 07:06 min
> Exception in thread "main"
> Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "main"
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17964) Increase Java heap size for running Maven in Dockerfile of branch-2.10
Masatake Iwasaki created HADOOP-17964:
-
Summary: Increase Java heap size for running Maven in Dockerfile
of branch-2.10
Key: HADOOP-17964
URL: https://issues.apache.org/jira/browse/HADOOP-17964
Project: Hadoop Common
Issue Type: Bug
Components: build
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
I got OOM on running create-release script in branch-2.10.
{noformat}
$ ./dev-support/bin/create-release --docker --dockercache --native
$ tail -n 5 patchprocess/mvn_install.log
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 07:06 min
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler
in thread "main"
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17964) Increase Java heap size for running Maven in Dockerfile of branch-2.10
[
https://issues.apache.org/jira/browse/HADOOP-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427750#comment-17427750
]
Masatake Iwasaki commented on HADOOP-17964:
---
I got no issue when I build the RC of 2.10.1 using the Dockerfile. JDK
migration to Zulu by HADOOP-17572 might be related.
> Increase Java heap size for running Maven in Dockerfile of branch-2.10
> --
>
> Key: HADOOP-17964
> URL: https://issues.apache.org/jira/browse/HADOOP-17964
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> I got OOM on running create-release script in branch-2.10.
> {noformat}
> $ ./dev-support/bin/create-release --docker --dockercache --native
> $ tail -n 5 patchprocess/mvn_install.log
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 07:06 min
> Exception in thread "main"
> Exception: java.lang.OutOfMemoryError thrown from the
> UncaughtExceptionHandler in thread "main"
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17880) Build 2.10.x with docker
[
https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427567#comment-17427567
]
Masatake Iwasaki commented on HADOOP-17880:
---
[~baizhendong] [The dockerfile of
branch-2.10|https://github.com/apache/hadoop/blob/branch-2.10/dev-support/docker/Dockerfile]
(instead of the one for 2.10.0) does not have issues you mentioned. It just
works. You should update the motivation if you still want to push this change.
{quote}
1. currently, we build the hadoop 2.10.0 with docker machine, and must install
Virtual Box, and for hadoop 3.x, just build with docker only.
2. besides this, the docker image dependency is out of date, and some of them
is unavaialble, for example – jdk7
{quote}
Dockerfile of branch-2.10 just works without Virtual Box. It leverages OpenJDK
7 of Zulu which is still available.
{quote}
3. but just building hadoop 2.10.0 with hadoop 3.x build script without
modification is not working, for the protocol buffer version is not 2.5.0, and
it's not work for native build.
{quote}
Since building requirement are changing as Hadoop evolves, Dockerfile for
upstrem is not expected to work for previous major version.
> Build 2.10.x with docker
>
>
> Key: HADOOP-17880
> URL: https://issues.apache.org/jira/browse/HADOOP-17880
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 2.10.0
> Environment: mac os x86_64
>Reporter: baizhendong
>Priority: Major
> Labels: pull-request-available
> Time Spent: 8h 50m
> Remaining Estimate: 0h
>
> 1. currently, we build the hadoop 2.10.0 with docker machine, and must
> install Virtual Box, and for hadoop 3.x, just build with docker only.
> 2. besides this, the docker image dependency is out of date, and some of them
> is unavaialble, for example – jdk7
> 3. but just building hadoop 2.10.0 with hadoop 3.x build script without
> modification is not working, for the protocol buffer version is not 2.5.0,
> and it's not work for native build.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17424) Replace HTrace with No-Op tracer
[ https://issues.apache.org/jira/browse/HADOOP-17424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17424: -- Fix Version/s: 3.3.2 > Replace HTrace with No-Op tracer > > > Key: HADOOP-17424 > URL: https://issues.apache.org/jira/browse/HADOOP-17424 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Siyao Meng >Assignee: Siyao Meng >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0, 3.3.2 > > Time Spent: 10.5h > Remaining Estimate: 0h > > Remove HTrace dependency as it is depending on old jackson jars. Use a no-op > tracer for now to eliminate potential security issues. > The plan is to move part of the code in > [PR#1846|https://github.com/apache/hadoop/pull/1846] out here for faster > review. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17925) BUILDING.txt should not encourage to activate docs profile on building binary artifacts
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17925:
--
Fix Version/s: 3.2.4
3.3.2
3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Status: Resolved (was: Patch Available)
> BUILDING.txt should not encourage to activate docs profile on building binary
> artifacts
> ---
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.2, 3.2.4
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425002#comment-17425002 ] Masatake Iwasaki commented on HADOOP-17254: --- I cherry-picked YARN-8936 to branch-3.2.3 too. > Upgrade hbase to 1.4.13 on branch-2.10 > -- > > Key: HADOOP-17254 > URL: https://issues.apache.org/jira/browse/HADOOP-17254 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Fix For: 2.10.1 > > Time Spent: 50m > Remaining Estimate: 0h > > hbase.version must be updated to address CVE-2018-8025 on branch-2.10. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10
[
https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424953#comment-17424953
]
Masatake Iwasaki commented on HADOOP-17254:
---
I pushed the cherry-picking of YARN-8936 to branch-3.2 since I got no issue on
{{mvn test}} and {{mvn test -Dhbase.profile=2.0}} under
hadoop-yarn-server-timelineservice-hbase.
[~brahmareddy] Are you OK to push it to branch-3.2.3 too?
> Upgrade hbase to 1.4.13 on branch-2.10
> --
>
> Key: HADOOP-17254
> URL: https://issues.apache.org/jira/browse/HADOOP-17254
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 2.10.1
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> hbase.version must be updated to address CVE-2018-8025 on branch-2.10.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424950#comment-17424950 ] Masatake Iwasaki commented on HADOOP-17254: --- [~ananysin] [~brahmareddy] This issue was filed in the release process of 2.10.1 since YARN-8936 was not applicable to branch-2.10. I did not care about branch-3.2 at that time. I think we should cherry-pick YARN-8936 to branch-3.2 rather than this (HADOOP-17254) if applicable. > Upgrade hbase to 1.4.13 on branch-2.10 > -- > > Key: HADOOP-17254 > URL: https://issues.apache.org/jira/browse/HADOOP-17254 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Fix For: 2.10.1 > > Time Spent: 50m > Remaining Estimate: 0h > > hbase.version must be updated to address CVE-2018-8025 on branch-2.10. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-17424) Replace HTrace with No-Op tracer
[ https://issues.apache.org/jira/browse/HADOOP-17424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424396#comment-17424396 ] Masatake Iwasaki edited comment on HADOOP-17424 at 10/5/21, 9:49 AM: - [~ste...@apache.org] I submitted [#3520|https://github.com/apache/hadoop/pull/3520] for branch-3.3. was (Author: iwasakims): I submitted [#3520|https://github.com/apache/hadoop/pull/3520] for branch-3.3. > Replace HTrace with No-Op tracer > > > Key: HADOOP-17424 > URL: https://issues.apache.org/jira/browse/HADOOP-17424 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Siyao Meng >Assignee: Siyao Meng >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 9h 10m > Remaining Estimate: 0h > > Remove HTrace dependency as it is depending on old jackson jars. Use a no-op > tracer for now to eliminate potential security issues. > The plan is to move part of the code in > [PR#1846|https://github.com/apache/hadoop/pull/1846] out here for faster > review. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17424) Replace HTrace with No-Op tracer
[ https://issues.apache.org/jira/browse/HADOOP-17424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424396#comment-17424396 ] Masatake Iwasaki commented on HADOOP-17424: --- I submitted [#3520|https://github.com/apache/hadoop/pull/3520] for branch-3.3. > Replace HTrace with No-Op tracer > > > Key: HADOOP-17424 > URL: https://issues.apache.org/jira/browse/HADOOP-17424 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Siyao Meng >Assignee: Siyao Meng >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 9h 10m > Remaining Estimate: 0h > > Remove HTrace dependency as it is depending on old jackson jars. Use a no-op > tracer for now to eliminate potential security issues. > The plan is to move part of the code in > [PR#1846|https://github.com/apache/hadoop/pull/1846] out here for faster > review. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17925) BUILDING.txt should not encourage to activate docs profile on building binary artifacts
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17925:
--
Labels: (was: pull-request-available)
Status: Patch Available (was: Open)
> BUILDING.txt should not encourage to activate docs profile on building binary
> artifacts
> ---
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17925) BUILDING.txt should not encourage to activate docs profile on building binary artifacts
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17925:
--
Summary: BUILDING.txt should not encourage to activate docs profile on
building binary artifacts (was: Some command examples in BUILDING.txt fail due
to the class duplication.)
> BUILDING.txt should not encourage to activate docs profile on building binary
> artifacts
> ---
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17925) Some command examples in BUILDING.txt fail due to the class duplication.
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423223#comment-17423223
]
Masatake Iwasaki commented on HADOOP-17925:
---
If -Pdocs is enabled, hadoop-client depends on xerces. Since the dependency
comes from the parent (hadoop-project-dist), it is not trivial to exclude it. I
think the BUILDING.txt just should not encourage to activate -Pdocs on building
binary artifacts.
Given HBase is avoiding build binary and docs in one pass for different reason,
separating build of binary and docs could be safe practice.
*
https://lists.apache.org/thread.html/0c39364a2949fab134107eaf164723e09d895b3eb2c16610b841e033%40%3Cuser.hbase.apache.org%3E
* https://github.com/apache/hbase/blob/rel/2.4.6/dev-support/make_rc.sh#L78-L84
> Some command examples in BUILDING.txt fail due to the class duplication.
>
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-17925) Some command examples in BUILDING.txt fail due to the class duplication.
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423160#comment-17423160
]
Masatake Iwasaki edited comment on HADOOP-17925 at 10/1/21, 7:43 AM:
-
Thanks for reporting this, [~RIkeda].
The error message indicate that ensure-jars-have-correct-contents.sh of
hadoop-client-check-invariants find unexpected contents in the jars.
The unexpected files come from Xerces added to dependency if -Pdocs is enabled.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-project-dist/pom.xml#L131-L149]
The dependency on xerces was added by HADOOP-14835 as fix for jdiff related
error. The same issue was [reported
there|https://issues.apache.org/jira/browse/HADOOP-14835?focusedCommentId=1614=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-1614].
We are addressing the error by building documentations alone in the second pass
after building binary artifacts.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/dev-support/bin/create-release#L568-L606]
was (Author: iwasakims):
Thanks for reporting this, [~RIkeda].
The error message indicate that ensure-jars-have-correct-contents.sh of
hadoop-client-check-invariants find unexpected contents in the jars.
The unexpected files come from Xerces added to dependency if -Pdocs is enabled.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-project-dist/pom.xml#L131-L149]
The dependency on xerces was added by HADOOP-14835 as fix for jdiff related
error. The same issue was reported there.
We are addressing the error by building documentations alone in the second pass
after building binary artifacts.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/dev-support/bin/create-release#L568-L606]
> Some command examples in BUILDING.txt fail due to the class duplication.
>
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-17925) Some command examples in BUILDING.txt fail due to the class duplication.
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423160#comment-17423160
]
Masatake Iwasaki edited comment on HADOOP-17925 at 10/1/21, 7:40 AM:
-
Thanks for reporting this, [~RIkeda].
The error message indicate that ensure-jars-have-correct-contents.sh of
hadoop-client-check-invariants find unexpected contents in the jars.
The unexpected files come from Xerces added to dependency if -Pdocs is enabled.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-project-dist/pom.xml#L131-L149]
The dependency on xerces was added by HADOOP-14835 as fix for jdiff related
error. The same issue was reported there.
We are addressing the error by building documentations alone in the second pass
after building binary artifacts.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/dev-support/bin/create-release#L568-L606]
was (Author: iwasakims):
Thanks for reporting this, [~RIkeda].
The error message indicate that ensure-jars-have-correct-contents.sh of
hadoop-client-check-invariants find unexpected contents in the jars.
The unexpected files come from Xerces added to dependency if -Pdocs is enabled.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-project-dist/pom.xml#L131-L149]
The dependency on xerces was added by HADOOP-14835 as fix for jdiff related
error. The same issue was reported there.
We are addressing the error by separating build between binary aftifacts and
documentations now.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/dev-support/bin/create-release#L568-L606]
> Some command examples in BUILDING.txt fail due to the class duplication.
>
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17925) Some command examples in BUILDING.txt fail due to the class duplication.
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423160#comment-17423160
]
Masatake Iwasaki commented on HADOOP-17925:
---
Thanks for reporting this, [~RIkeda].
The error message indicate that ensure-jars-have-correct-contents.sh of
hadoop-client-check-invariants find unexpected contents in the jars.
The unexpected files come from Xerces added to dependency if -Pdocs is enabled.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/hadoop-project-dist/pom.xml#L131-L149]
The dependency on xerces was added by HADOOP-14835 as fix for jdiff related
error. The same issue was reported there.
We are addressing the error by separating build between binary aftifacts and
documentations now.
[https://github.com/apache/hadoop/blob/rel/release-3.3.1/dev-support/bin/create-release#L568-L606]
> Some command examples in BUILDING.txt fail due to the class duplication.
>
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-17925) Some command examples in BUILDING.txt fail due to the class duplication.
[
https://issues.apache.org/jira/browse/HADOOP-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki reassigned HADOOP-17925:
-
Assignee: Masatake Iwasaki
> Some command examples in BUILDING.txt fail due to the class duplication.
>
>
> Key: HADOOP-17925
> URL: https://issues.apache.org/jira/browse/HADOOP-17925
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> BUILDING.txt in
> trunk([https://github.com/apache/hadoop/blob/4d21655d04d1b488fe37e908d75f833c1aa66b01/BUILDING.txt#L350])
> explains how to create binary distribution with documentation and shows the
> following command line examples.
> {noformat}
> `$ mvn package -Pdist,native,docs -DskipTests -Dtar`
> `$ mvn package -Pdist,native,docs,src -DskipTests -Dtar`
> {noformat}
> But, they output errors as follows. Class duplication causes this problem.
> Results:
> {noformat}
> [INFO] ---< org.apache.hadoop:hadoop-client-check-test-invariants
> >
> [INFO] Building Apache Hadoop Client Packaging Invariants for Test
> 3.4.0-SNAPSHOT [105/112]
> [INFO] [ pom
> ]-
> ...
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) @ hadoop-client-check-test-invariants ---
> [INFO] Adding ignorable dependency: org.apache.hadoop:hadoop-annotations:null
> [INFO] Adding ignore: *
> [WARNING] Rule 1: org.apache.maven.plugins.enforcer.BanDuplicateClasses
> failed with message:
> Duplicate classes found:
> Found in:
> org.apache.hadoop:hadoop-client-minicluster:jar:3.4.0-SNAPSHOT:compile
> org.apache.hadoop:hadoop-client-runtime:jar:3.4.0-SNAPSHOT:compile
> Duplicate classes:
>
> org/apache/hadoop/shaded/org/apache/xerces/impl/dv/dtd/NMTOKENDatatypeValidator.class
>
> org/apache/hadoop/shaded/org/apache/xerces/dom/DOMImplementationListImpl.class
> ...
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce
> (enforce-banned-dependencies) on project hadoop-client-check-test-invariants:
> Some Enforcer rules have failed. Look above for specific messages explaining
> why the rule failed. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17926) Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself.
[
https://issues.apache.org/jira/browse/HADOOP-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17926:
--
Fix Version/s: 3.2.4
3.3.2
2.10.2
3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Maven-eclipse-plugin is no longer needed since Eclipse can import Maven
> projects by itself.
> ---
>
> Key: HADOOP-17926
> URL: https://issues.apache.org/jira/browse/HADOOP-17926
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Rintaro Ikeda
>Priority: Minor
> Labels: pull-request-available
> Fix For: 3.4.0, 2.10.2, 3.3.2, 3.2.4
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> BUILDING.txt explains the way to import projects to eclipse. However, when
> you follow the instruction, you can't import the entire source tree (e.g.,
> hadoop-project directory). In addition to this, maven-eclipse-plugin has
> already retired. There is a simpler way to import it without
> maven-eclipse-plugin.
> {noformat}
> Importing projects to eclipse
> When you import the project to eclipse, install hadoop-maven-plugins at first.
> $ cd hadoop-maven-plugins
> $ mvn install
> Then, generate eclipse project files.
> $ mvn eclipse:eclipse -DskipTests
> At last, import to eclipse by specifying the root directory of the project via
> [File] > [Import] > [Existing Projects into Workspace].
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17926) Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself.
[
https://issues.apache.org/jira/browse/HADOOP-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17926:
--
Issue Type: Improvement (was: Bug)
> Maven-eclipse-plugin is no longer needed since Eclipse can import Maven
> projects by itself.
> ---
>
> Key: HADOOP-17926
> URL: https://issues.apache.org/jira/browse/HADOOP-17926
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
> Environment: AWS workspaces Amazon Linux 2
>Reporter: Rintaro Ikeda
>Assignee: Rintaro Ikeda
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> BUILDING.txt explains the way to import projects to eclipse. However, when
> you follow the instruction, you can't import the entire source tree (e.g.,
> hadoop-project directory). In addition to this, maven-eclipse-plugin has
> already retired. There is a simpler way to import it without
> maven-eclipse-plugin.
> {noformat}
> Importing projects to eclipse
> When you import the project to eclipse, install hadoop-maven-plugins at first.
> $ cd hadoop-maven-plugins
> $ mvn install
> Then, generate eclipse project files.
> $ mvn eclipse:eclipse -DskipTests
> At last, import to eclipse by specifying the root directory of the project via
> [File] > [Import] > [Existing Projects into Workspace].
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-17924) Upgrade OpenSSL to 1.1.1l for vulnerability fix
[
https://issues.apache.org/jira/browse/HADOOP-17924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418001#comment-17418001
]
Masatake Iwasaki edited comment on HADOOP-17924 at 9/21/21, 9:24 AM:
-
I tried openssl-1.1.1l on CentOS 8. The native code of hadoop-common did not
have compilation issues.
I got following error on hadoop-pipe. The cause seems to be that
/lib64/libk5crypto.so (of krb5-libs) built against OS provided openssl does not
work with locally built openssl-1.1.1l. This looks like kind of build
environment issue mentioned by [~aajisaka] .
{noformat}
$ wget https://www.openssl.org/source/openssl-1.1.1l.tar.gz
$ tar zxf openssl-1.1.1l.tar.gz
$ cd openssl-1.1.1l
$ ./config --prefix=/usr/local -Wl,-rpath=/usr/local/lib64
$ make
$ sudo make install
$ openssl version
OpenSSL 1.1.1l 24 Aug 2021
$ cd path/to/hadoop
$ mvn clean install -Pdist -Pnative -Dopenssl.prefix=/usr/local -DskipTests
-DskipShade
...
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/c++ -g -O2 -Wall -pthread
-D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -rdynamic
CMakeFiles/wordcount-simple.dir/main/native/examples/impl/wordcount-simple.cc.o
-o examples/wordcount-simple -Wl,-rpath,/usr/local/lib64 libhadooppipes.a
libhadooputils.a /usr/local/lib64/libssl.so /usr/local/lib64/libcrypto.so -ldl
-ltirpc
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[1]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_derive@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_ctrl@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_new_id@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_free@OPENSSL_1_1_1b'
[WARNING] collect2: error: ld returned 1 exit status
[WARNING] make[2]: *** [CMakeFiles/pipes-sort.dir/build.make:107:
examples/pipes-sort] Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:134:
CMakeFiles/pipes-sort.dir/all] Error 2
[WARNING] make[1]: *** Waiting for unfinished jobs
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_derive@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_ctrl@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_new_id@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_free@OPENSSL_1_1_1b'
[WARNING] collect2: error: ld returned 1 exit status
[WARNING] make[2]: *** [CMakeFiles/wordcount-simple.dir/build.make:107:
examples/wordcount-simple] Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:106:
CMakeFiles/wordcount-simple.dir/all] Error 2
[WARNING] make: *** [Makefile:103: all] Error 2
{noformat}
was (Author: iwasakims):
I tried openssl-1.1.1l on CentOS 8. The native code of hadoop-common did not
have compilation issues.
I got following error on hadoop-pipe. The cause seems to be that
/lib64/libk5crypto.so built against OS provided krb5-libs does not work with
locally built openssl-1.1.1l. This looks like kind of build environment issue
mentioned by [~aajisaka] .
{noformat}
$ wget https://www.openssl.org/source/openssl-1.1.1l.tar.gz
$ tar zxf openssl-1.1.1l.tar.gz
$ cd openssl-1.1.1l
$ ./config --prefix=/usr/local -Wl,-rpath=/usr/local/lib64
$ make
$ sudo make install
$ openssl version
OpenSSL 1.1.1l 24 Aug 2021
$ cd path/to/hadoop
$ mvn clean install -Pdist -Pnative -Dopenssl.prefix=/usr/local -DskipTests
-DskipShade
...
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/c++ -g -O2 -Wall -pthread
-D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -rdynamic
CMakeFiles/wordcount-simple.dir/main/native/examples/impl/wordcount-simple.cc.o
-o examples/wordcount-simple -Wl,-rpath,/usr/local/lib64 libhadooppipes.a
libhadooputils.a /usr/local/lib64/libssl.so /usr/local/lib64/libcrypto.so -ldl
-ltirpc
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[1]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_derive@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld:
[jira] [Commented] (HADOOP-17924) Upgrade OpenSSL to 1.1.1l for vulnerability fix
[
https://issues.apache.org/jira/browse/HADOOP-17924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418001#comment-17418001
]
Masatake Iwasaki commented on HADOOP-17924:
---
I tried openssl-1.1.1l on CentOS 8. The native code of hadoop-common did not
have compilation issues.
I got following error on hadoop-pipe. The cause seems to be that
/lib64/libk5crypto.so built against OS provided krb5-libs does not work with
locally built openssl-1.1.1l. This looks like kind of build environment issue
mentioned by [~aajisaka] .
{noformat}
$ wget https://www.openssl.org/source/openssl-1.1.1l.tar.gz
$ tar zxf openssl-1.1.1l.tar.gz
$ cd openssl-1.1.1l
$ ./config --prefix=/usr/local -Wl,-rpath=/usr/local/lib64
$ make
$ sudo make install
$ openssl version
OpenSSL 1.1.1l 24 Aug 2021
$ cd path/to/hadoop
$ mvn clean install -Pdist -Pnative -Dopenssl.prefix=/usr/local -DskipTests
-DskipShade
...
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/c++ -g -O2 -Wall -pthread
-D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -rdynamic
CMakeFiles/wordcount-simple.dir/main/native/examples/impl/wordcount-simple.cc.o
-o examples/wordcount-simple -Wl,-rpath,/usr/local/lib64 libhadooppipes.a
libhadooputils.a /usr/local/lib64/libssl.so /usr/local/lib64/libcrypto.so -ldl
-ltirpc
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[2]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] make[1]: Leaving directory
'/home/centos/srcs/hadoop/hadoop-tools/hadoop-pipes/target/native'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_derive@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_ctrl@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_new_id@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_free@OPENSSL_1_1_1b'
[WARNING] collect2: error: ld returned 1 exit status
[WARNING] make[2]: *** [CMakeFiles/pipes-sort.dir/build.make:107:
examples/pipes-sort] Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:134:
CMakeFiles/pipes-sort.dir/all] Error 2
[WARNING] make[1]: *** Waiting for unfinished jobs
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_derive@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_ctrl@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_new_id@OPENSSL_1_1_1b'
[WARNING] /opt/rh/gcc-toolset-9/root/usr/bin/ld: /lib64/libk5crypto.so.3:
undefined reference to `EVP_KDF_CTX_free@OPENSSL_1_1_1b'
[WARNING] collect2: error: ld returned 1 exit status
[WARNING] make[2]: *** [CMakeFiles/wordcount-simple.dir/build.make:107:
examples/wordcount-simple] Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:106:
CMakeFiles/wordcount-simple.dir/all] Error 2
[WARNING] make: *** [Makefile:103: all] Error 2
{noformat}
> Upgrade OpenSSL to 1.1.1l for vulnerability fix
> ---
>
> Key: HADOOP-17924
> URL: https://issues.apache.org/jira/browse/HADOOP-17924
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Rajshree Mishra
>Priority: Major
>
> A vulnerability scan reported the following CVEs in openSSL 1.1.1k in Hadoop:
> CVE-2021-3711
> CVE-2021-3712
> Affects jars :
> libssl.so.1.1
> libcrypto.so.1.1
> libcrypto.a
> libssl.a
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation
[
https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17919:
--
Fix Version/s: 3.2.4
3.3.2
3.4.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
I pushed this to trunk, branch-3.3 and branch-3.2. Thanks for the contribution,
[~RIkeda].
> Fix command line example in Hadoop Cluster Setup documentation
> --
>
> Key: HADOOP-17919
> URL: https://issues.apache.org/jira/browse/HADOOP-17919
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
>Reporter: Rintaro Ikeda
>Assignee: Rintaro Ikeda
>Priority: Minor
> Labels: docuentation, pull-request-available
> Fix For: 3.4.0, 3.3.2, 3.2.4
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> About Hdoop cluster setup documentation
> ([https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/ClusterSetup.html])
> The option is specified in the following example, but HDFS
> command ignores it.
> {noformat}
> `[hdfs]$ $HADOOP_HOME/bin/hdfs namenode -format `
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation
[
https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17919:
--
Summary: Fix command line example in Hadoop Cluster Setup documentation
(was: Modify command line example in Hadoop Cluster Setup documentation)
> Fix command line example in Hadoop Cluster Setup documentation
> --
>
> Key: HADOOP-17919
> URL: https://issues.apache.org/jira/browse/HADOOP-17919
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 3.3.1, 3.4.0
>Reporter: Rintaro Ikeda
>Assignee: Rintaro Ikeda
>Priority: Minor
> Labels: docuentation, pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> About Hdoop cluster setup documentation
> ([https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/ClusterSetup.html])
> The option is specified in the following example, but HDFS
> command ignores it.
> {noformat}
> `[hdfs]$ $HADOOP_HOME/bin/hdfs namenode -format `
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17916) Fix compilation error of ITUseHadoopCodecs with -DskipShade
[
https://issues.apache.org/jira/browse/HADOOP-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17916:
--
Resolution: Duplicate
Status: Resolved (was: Patch Available)
closing this as duplicate of *addendum of* HADOOP-17891.
> Fix compilation error of ITUseHadoopCodecs with -DskipShade
> ---
>
> Key: HADOOP-17916
> URL: https://issues.apache.org/jira/browse/HADOOP-17916
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> {noformat}
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
> (default-testCompile) on project hadoop-client-integration-tests: Compilation
> failure: Compilation failure:
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[34,28]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: package org.apache.hadoop.io
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,16]
> package RandomDatum does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,54]
> package RandomDatum does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[103,7]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[104,7]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17916) Fix compilation error of ITUseHadoopCodecs with -DskipShade
[
https://issues.apache.org/jira/browse/HADOOP-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17916:
--
Status: Patch Available (was: Open)
> Fix compilation error of ITUseHadoopCodecs with -DskipShade
> ---
>
> Key: HADOOP-17916
> URL: https://issues.apache.org/jira/browse/HADOOP-17916
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {noformat}
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
> (default-testCompile) on project hadoop-client-integration-tests: Compilation
> failure: Compilation failure:
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[34,28]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: package org.apache.hadoop.io
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,16]
> package RandomDatum does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,54]
> package RandomDatum does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[103,7]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[104,7]
> cannot find symbol
> [ERROR] symbol: class RandomDatum
> [ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17916) Fix compilation error of ITUseHadoopCodecs with -DskipShade
Masatake Iwasaki created HADOOP-17916:
-
Summary: Fix compilation error of ITUseHadoopCodecs with
-DskipShade
Key: HADOOP-17916
URL: https://issues.apache.org/jira/browse/HADOOP-17916
Project: Hadoop Common
Issue Type: Bug
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hadoop-client-integration-tests: Compilation
failure: Compilation failure:
[ERROR]
/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[34,28]
cannot find symbol
[ERROR] symbol: class RandomDatum
[ERROR] location: package org.apache.hadoop.io
[ERROR]
/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,16]
package RandomDatum does not exist
[ERROR]
/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[100,54]
package RandomDatum does not exist
[ERROR]
/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[103,7]
cannot find symbol
[ERROR] symbol: class RandomDatum
[ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
[ERROR]
/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-integration-tests/src/test/java/org/apache/hadoop/example/ITUseHadoopCodecs.java:[104,7]
cannot find symbol
[ERROR] symbol: class RandomDatum
[ERROR] location: class org.apache.hadoop.example.ITUseHadoopCodecs
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17908) Add missing RELEASENOTES and CHANGELOG to upstream
[ https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17908: -- Status: Patch Available (was: Open) > Add missing RELEASENOTES and CHANGELOG to upstream > -- > > Key: HADOOP-17908 > URL: https://issues.apache.org/jira/browse/HADOOP-17908 > Project: Hadoop Common > Issue Type: Bug > Components: documentation >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > RELEASENOTES and CHANGELOG of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17908) Add missing RELEASENOTES and CHANGELOG to upstream
[ https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17908: -- Component/s: documentation > Add missing RELEASENOTES and CHANGELOG to upstream > -- > > Key: HADOOP-17908 > URL: https://issues.apache.org/jira/browse/HADOOP-17908 > Project: Hadoop Common > Issue Type: Bug > Components: documentation >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > > RELEASENOTES and CHANGELOG of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17908) Add missing RELEASENOTES and CHANGELOG to upstream
[
https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414747#comment-17414747
]
Masatake Iwasaki commented on HADOOP-17908:
---
There are some files left as CHANGES instead of CHANGELOG.
{format}
$ find . -name 'CHANGES*'
./hadoop-common-project/hadoop-common/src/site/markdown/release/2.10.0/CHANGES.2.10.0.md
./hadoop-common-project/hadoop-common/src/site/markdown/release/3.1.2/CHANGES.3.1.2.md
./hadoop-common-project/hadoop-common/src/site/markdown/release/3.1.3/CHANGES.3.1.3.md
{format}
While HTML files under "Changelog and Release Notes" pages
(hadoop-project/hadoop-project-dist/hadoop-common/release/*) are generated
regardless of the file name by {{mvn site}}, I would like to rename those to
CHNAGELOG here for consistency.
> Add missing RELEASENOTES and CHANGELOG to upstream
> --
>
> Key: HADOOP-17908
> URL: https://issues.apache.org/jira/browse/HADOOP-17908
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> RELEASENOTES and CHANGELOG of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17908) Add missing RELEASENOTES and CHANGELOG to upstream
[ https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17908: -- Description: RELEASENOTES and CHANGELOG of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. (was: RELEASENOTES and CHANGES of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk.) > Add missing RELEASENOTES and CHANGELOG to upstream > -- > > Key: HADOOP-17908 > URL: https://issues.apache.org/jira/browse/HADOOP-17908 > Project: Hadoop Common > Issue Type: Bug >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > > RELEASENOTES and CHANGELOG of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17908) Add missing RELEASENOTES and CHANGELOG to upstream
[ https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17908: -- Summary: Add missing RELEASENOTES and CHANGELOG to upstream (was: Add missing RELEASENOTES and CHANGES to upstream) > Add missing RELEASENOTES and CHANGELOG to upstream > -- > > Key: HADOOP-17908 > URL: https://issues.apache.org/jira/browse/HADOOP-17908 > Project: Hadoop Common > Issue Type: Bug >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > > RELEASENOTES and CHANGES of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17908) Add missing RELEASENOTES and CHANGES to upstream
[ https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414741#comment-17414741 ] Masatake Iwasaki commented on HADOOP-17908: --- CHANGES was renamed to CHANGELOG by HADOOP-14671. > Add missing RELEASENOTES and CHANGES to upstream > > > Key: HADOOP-17908 > URL: https://issues.apache.org/jira/browse/HADOOP-17908 > Project: Hadoop Common > Issue Type: Bug >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > > RELEASENOTES and CHANGES of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17908) Add missing RELEASENOTES and CHANGES to upstream
[
https://issues.apache.org/jira/browse/HADOOP-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414740#comment-17414740
]
Masatake Iwasaki commented on HADOOP-17908:
---
The procedure is described in [HowToRelease
wiki|https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease#HowToRelease-Publishing].
{quote}
5. Update upstream branches to make them aware of this new release:
a. Copy and commit the CHANGES.md and RELEASENOTES.md:
{quote}
For example of 2.10.1, I did this to branch-2.10 but missed trunk.
> Add missing RELEASENOTES and CHANGES to upstream
>
>
> Key: HADOOP-17908
> URL: https://issues.apache.org/jira/browse/HADOOP-17908
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> RELEASENOTES and CHANGES of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17908) Add missing RELEASENOTES and CHANGES to upstream
Masatake Iwasaki created HADOOP-17908: - Summary: Add missing RELEASENOTES and CHANGES to upstream Key: HADOOP-17908 URL: https://issues.apache.org/jira/browse/HADOOP-17908 Project: Hadoop Common Issue Type: Bug Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki RELEASENOTES and CHANGES of 2.10.1, 3.1.4 and 3.3.0 are missing in trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Fix Version/s: 3.3.2
3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
>Affects Versions: 3.4.0, 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.2
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Compilation of branch-3.3 fails due to lack of transitive dependency existing
> in trunk.
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings
[ https://issues.apache.org/jira/browse/HADOOP-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17897: -- Fix Version/s: 3.2.4 3.3.2 2.10.2 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) > Allow nested blocks in switch case in checkstyle settings > - > > Key: HADOOP-17897 > URL: https://issues.apache.org/jira/browse/HADOOP-17897 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Labels: pull-request-available > Fix For: 3.4.0, 2.10.2, 3.3.2, 3.2.4 > > Time Spent: 1h > Remaining Estimate: 0h > > Nested blocks in switch case are used in existing code and checkstyle warning > are just ignored. It should be allowed in project checkstyle settings. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Status: Patch Available (was: Open)
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
>Affects Versions: 3.4.0, 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Compilation of branch-3.3 fails due to lack of transitive dependency existing
> in trunk.
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Affects Version/s: 3.4.0
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
>Affects Versions: 3.4.0, 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Compilation of branch-3.3 fails due to lack of transitive dependency existing
> in trunk.
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Description:
Compilation of branch-3.3 fails due to lack of transitive dependency existing
in trunk.
{noformat}
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
package org.junit.jupiter.api does not exist
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
cannot find symbol
symbol: class BeforeEach
location: class org.apache.hadoop.fs.http.TestHttpFileSystem
[INFO] 2 errors
{noformat}
was:
{noformat}
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
package org.junit.jupiter.api does not exist
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
cannot find symbol
symbol: class BeforeEach
location: class org.apache.hadoop.fs.http.TestHttpFileSystem
[INFO] 2 errors
{noformat}
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
>Affects Versions: 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Compilation of branch-3.3 fails due to lack of transitive dependency existing
> in trunk.
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()
[
https://issues.apache.org/jira/browse/HADOOP-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HADOOP-17870.
---
Fix Version/s: 3.3.2
3.4.0
Resolution: Fixed
> HTTP Filesystem to qualify paths in open()/getFileStatus()
> --
>
> Key: HADOOP-17870
> URL: https://issues.apache.org/jira/browse/HADOOP-17870
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
>Affects Versions: 3.3.1
>Reporter: VinothKumar Raman
>Assignee: VinothKumar Raman
>Priority: Minor
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.2
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> HTTP filesystem is inconsistent with other filesystem (eg: S3AFilesystem) in
> that they don't accept Path which is relative to the URL that the filesystem
> is instantiated with.
>
> As in
> {code:java}
> FileSystem.get("http://www.example.com;).open(new Path("/test")){code}
> will fail with URI not absolute. But it should infact fetch
> {{http://www.example.com/test}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Component/s: test
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
>Affects Versions: 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17899) Avoid using implicit dependency on junit-jupiter-api
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17899:
--
Summary: Avoid using implicit dependency on junit-jupiter-api (was: Fix
compilation error of TestHttpFileSystem)
> Avoid using implicit dependency on junit-jupiter-api
>
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17899) Fix compilation error of TestHttpFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411697#comment-17411697
]
Masatake Iwasaki commented on HADOOP-17899:
---
Existing tests of Hadoop are using JUnit 4. hadoop-common should avoid using
implicit dependency on junit-jupiter-api until migration to JUnit 5 is done.
> Fix compilation error of TestHttpFileSystem
> ---
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17899) Fix compilation error of TestHttpFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411694#comment-17411694
]
Masatake Iwasaki commented on HADOOP-17899:
---
junit-jupiter-api is used in hadoop-common and hadoop-yarn-api. hadoop-yarn-api
has explicit test scope dependency on it.
{noformat}
$ grep -r org.junit.jupiter.api
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:import
org.junit.jupiter.api.BeforeEach;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestApplicationEntity.java:import
static org.junit.jupiter.api.Assertions.assertTrue;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestApplicationEntity.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestApplicationEntity.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestTimelineMetric.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestTimelineMetric.java:import
static org.junit.jupiter.api.Assertions.fail;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/timelineservice/TestTimelineMetric.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/TestResource.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/TestResource.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/TestURL.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/records/TestURL.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraints.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraints.java:import
static org.junit.jupiter.api.Assertions.assertNotNull;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraints.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraintParser.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraintParser.java:import
static org.junit.jupiter.api.Assertions.assertTrue;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraintParser.java:import
static org.junit.jupiter.api.Assertions.fail;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/api/resource/TestPlacementConstraintParser.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/conf/TestResourceInformation.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/conf/TestResourceInformation.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/conf/TestResourceInformation.java:import
static org.junit.jupiter.api.Assertions.assertNotEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/conf/TestResourceInformation.java:import
static org.junit.jupiter.api.Assertions.fail;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/util/TestUnitsConversionUtil.java:import
org.junit.jupiter.api.Test;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/util/TestUnitsConversionUtil.java:import
static org.junit.jupiter.api.Assertions.assertEquals;
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/test/java/org/apache/hadoop/yarn/util/TestUnitsConversionUtil.java:import
static org.junit.jupiter.api.Assertions.fail;
{noformat}
{noformat}
$ grep -B2 -A2 junit-jupiter-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/pom.xml
org.junit.jupiter
[jira] [Commented] (HADOOP-17899) Fix compilation error of TestHttpFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411691#comment-17411691
]
Masatake Iwasaki commented on HADOOP-17899:
---
junit-jupiter-api is transitive dependency of curator-test-5.2.0 in trunk.
{noformat}
[INFO] org.apache.hadoop:hadoop-common:jar:3.4.0-SNAPSHOT
...
[INFO] +- org.apache.curator:curator-test:jar:5.2.0:test
[INFO] | \- org.junit.jupiter:junit-jupiter-api:jar:5.5.1:test
{noformat}
branch-3.3 uses curator-test-4.2.0 not dependeng on junit-jupiter-api.
{noformat}
[INFO] org.apache.hadoop:hadoop-common:jar:3.3.2-SNAPSHOT
...
[INFO] +- org.apache.curator:curator-test:jar:4.2.0:test
[INFO] +- org.apache.curator:curator-client:jar:4.2.0:compile
{noformat}
> Fix compilation error of TestHttpFileSystem
> ---
>
> Key: HADOOP-17899
> URL: https://issues.apache.org/jira/browse/HADOOP-17899
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 3.3.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> {noformat}
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
> package org.junit.jupiter.api does not exist
> [ERROR]
> /home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
> cannot find symbol
> symbol: class BeforeEach
> location: class org.apache.hadoop.fs.http.TestHttpFileSystem
> [INFO] 2 errors
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17899) Fix compilation error of TestHttpFileSystem
Masatake Iwasaki created HADOOP-17899:
-
Summary: Fix compilation error of TestHttpFileSystem
Key: HADOOP-17899
URL: https://issues.apache.org/jira/browse/HADOOP-17899
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 3.3.2
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[29,29]
package org.junit.jupiter.api does not exist
[ERROR]
/home/centos/srcs/hadoop/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java:[47,4]
cannot find symbol
symbol: class BeforeEach
location: class org.apache.hadoop.fs.http.TestHttpFileSystem
[INFO] 2 errors
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings
[ https://issues.apache.org/jira/browse/HADOOP-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17897: -- Status: Patch Available (was: Open) > Allow nested blocks in switch case in checkstyle settings > - > > Key: HADOOP-17897 > URL: https://issues.apache.org/jira/browse/HADOOP-17897 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Nested blocks in switch case are used in existing code and checkstyle warning > are just ignored. It should be allowed in project checkstyle settings. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings
[
https://issues.apache.org/jira/browse/HADOOP-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411072#comment-17411072
]
Masatake Iwasaki edited comment on HADOOP-17897 at 9/7/21, 9:49 AM:
{noformat}
$ git branch -v | grep trunk
* trunk4e4d4fcc7c9 HDFS-16204. Improve FSDirEncryptionZoneOp related
parameter comments. (#3368)
$ mvn checkstyle:checkstyle
$ find . -name checkstyle-errors.xml | xargs grep AvoidNestedBlock | wc -l
628
{noformat}
was (Author: iwasakims):
{noformat}
$ mvn checkstyle:checkstyle
$ find . -name checkstyle-errors.xml | xargs grep AvoidNestedBlock | wc -l
629
{noformat}
> Allow nested blocks in switch case in checkstyle settings
> -
>
> Key: HADOOP-17897
> URL: https://issues.apache.org/jira/browse/HADOOP-17897
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> Nested blocks in switch case are used in existing code and checkstyle warning
> are just ignored. It should be allowed in project checkstyle settings.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings
[
https://issues.apache.org/jira/browse/HADOOP-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411072#comment-17411072
]
Masatake Iwasaki commented on HADOOP-17897:
---
{noformat}
$ mvn checkstyle:checkstyle
$ find . -name checkstyle-errors.xml | xargs grep AvoidNestedBlock | wc -l
629
{noformat}
> Allow nested blocks in switch case in checkstyle settings
> -
>
> Key: HADOOP-17897
> URL: https://issues.apache.org/jira/browse/HADOOP-17897
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> Nested blocks in switch case are used in existing code and checkstyle warning
> are just ignored. It should be allowed in project checkstyle settings.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17897) Allow nested blocks in switch case in checkstyle settings
Masatake Iwasaki created HADOOP-17897: - Summary: Allow nested blocks in switch case in checkstyle settings Key: HADOOP-17897 URL: https://issues.apache.org/jira/browse/HADOOP-17897 Project: Hadoop Common Issue Type: Improvement Components: build Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Nested blocks in switch case are used in existing code and checkstyle warning are just ignored. It should be allowed in project checkstyle settings. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-14922: -- Fix Version/s: 3.3.2 3.2.3 > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Assignee: Anup Halarnkar >Priority: Major > Fix For: 3.4.0, 3.2.3, 3.3.2 > > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404142#comment-17404142 ] Masatake Iwasaki commented on HADOOP-14922: --- pushed this to branch-3.3, branch-3.2 and branch-3.2.3. > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Assignee: Anup Halarnkar >Priority: Major > Fix For: 3.4.0, 3.2.3, 3.3.2 > > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404121#comment-17404121 ] Masatake Iwasaki commented on HADOOP-14922: --- [~brahmareddy] Yeah. I'm going to cherry-pick this to branch-3.3, branch-3.2 and branch-3.2.3. > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Assignee: Anup Halarnkar >Priority: Major > Fix For: 3.4.0 > > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-17849. --- Fix Version/s: 3.2.3 Hadoop Flags: Reviewed Resolution: Fixed > Exclude spotbugs-annotations from transitive dependencies on branch-3.2 > --- > > Key: HADOOP-17849 > URL: https://issues.apache.org/jira/browse/HADOOP-17849 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 3.2.2 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Fix For: 3.2.3 > > Time Spent: 40m > Remaining Estimate: 0h > > Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on > hadoop-client-check-test-invariants. Excluding > com.github.spotbugs:spotbugs-annotation from transitive dependencies should > fix this for users needing zookeeer-3.4.14. Since the dependency is > provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1749#comment-1749 ] Masatake Iwasaki commented on HADOOP-17849: --- [~brahmareddy] I cherry-picked the commit to branch-3.2.3. > Exclude spotbugs-annotations from transitive dependencies on branch-3.2 > --- > > Key: HADOOP-17849 > URL: https://issues.apache.org/jira/browse/HADOOP-17849 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 3.2.2 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on > hadoop-client-check-test-invariants. Excluding > com.github.spotbugs:spotbugs-annotation from transitive dependencies should > fix this for users needing zookeeer-3.4.14. Since the dependency is > provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17850) Upgrade ZooKeeper to 3.4.14 in branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17850: -- Status: Patch Available (was: Open) > Upgrade ZooKeeper to 3.4.14 in branch-3.2 > - > > Key: HADOOP-17850 > URL: https://issues.apache.org/jira/browse/HADOOP-17850 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.2.2 >Reporter: Akira Ajisaka >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Upgrade ZooKeeper 3.4.14 to fix CVE-2019-0201 > (https://zookeeper.apache.org/security.html). That way the ZooKeeper version > will be consistent with BigTop 3.0.0 (BIGTOP-3471). -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17850) Upgrade ZooKeeper to 3.4.14 in branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17850: -- Status: Open (was: Patch Available) > Upgrade ZooKeeper to 3.4.14 in branch-3.2 > - > > Key: HADOOP-17850 > URL: https://issues.apache.org/jira/browse/HADOOP-17850 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.2.2 >Reporter: Akira Ajisaka >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Upgrade ZooKeeper 3.4.14 to fix CVE-2019-0201 > (https://zookeeper.apache.org/security.html). That way the ZooKeeper version > will be consistent with BigTop 3.0.0 (BIGTOP-3471). -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399682#comment-17399682 ] Masatake Iwasaki commented on HADOOP-17849: --- Thanks, [~aajisaka]. I submitted PR there (instead of updating #3305). > Exclude spotbugs-annotations from transitive dependencies on branch-3.2 > --- > > Key: HADOOP-17849 > URL: https://issues.apache.org/jira/browse/HADOOP-17849 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 3.2.2 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on > hadoop-client-check-test-invariants. Excluding > com.github.spotbugs:spotbugs-annotation from transitive dependencies should > fix this for users needing zookeeer-3.4.14. Since the dependency is > provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17850) Upgrade ZooKeeper to 3.4.14 in branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17850: -- Status: Patch Available (was: Open) > Upgrade ZooKeeper to 3.4.14 in branch-3.2 > - > > Key: HADOOP-17850 > URL: https://issues.apache.org/jira/browse/HADOOP-17850 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.2.2 >Reporter: Akira Ajisaka >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Upgrade ZooKeeper 3.4.14 to fix CVE-2019-0201 > (https://zookeeper.apache.org/security.html). That way the ZooKeeper version > will be consistent with BigTop 3.0.0 (BIGTOP-3471). -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-17850) Upgrade ZooKeeper to 3.4.14 in branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-17850: - Assignee: Masatake Iwasaki > Upgrade ZooKeeper to 3.4.14 in branch-3.2 > - > > Key: HADOOP-17850 > URL: https://issues.apache.org/jira/browse/HADOOP-17850 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.2.2 >Reporter: Akira Ajisaka >Assignee: Masatake Iwasaki >Priority: Major > > Upgrade ZooKeeper 3.4.14 to fix CVE-2019-0201 > (https://zookeeper.apache.org/security.html). That way the ZooKeeper version > will be consistent with BigTop 3.0.0 (BIGTOP-3471). -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
[ https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399649#comment-17399649 ] Masatake Iwasaki commented on HADOOP-17849: --- [~brahmareddy] This is for users or downstream products using the combination of hadoop-3.2.x and zookeeper-3.4.14 since ZooKeeper 3.4.14 newly introduced the dependency on com.github.spotbugs:spotbugs-annotations. > Exclude spotbugs-annotations from transitive dependencies on branch-3.2 > --- > > Key: HADOOP-17849 > URL: https://issues.apache.org/jira/browse/HADOOP-17849 > Project: Hadoop Common > Issue Type: Improvement >Affects Versions: 3.2.2 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on > hadoop-client-check-test-invariants. Excluding > com.github.spotbugs:spotbugs-annotation from transitive dependencies should > fix this for users needing zookeeer-3.4.14. Since the dependency is > provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
[
https://issues.apache.org/jira/browse/HADOOP-17849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399585#comment-17399585
]
Masatake Iwasaki commented on HADOOP-17849:
---
{noformat}
$ mvn clean install -Dzookeeper.version=3.4.14 -Pdist -DskipTests
...
[INFO] --- exec-maven-plugin:1.3.1:exec (check-jar-contents) @
hadoop-client-check-test-invariants ---
[ERROR] Found artifact with unexpected contents:
'/home/centos/srcs/hadoop/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.4-SNAPSHOT.jar'
Please check the following and either correct the build or update
the allowed list with reasoning.
edu/
edu/umd/
edu/umd/cs/
edu/umd/cs/findbugs/
edu/umd/cs/findbugs/annotations/
edu/umd/cs/findbugs/annotations/NonNull.class
edu/umd/cs/findbugs/annotations/CheckForNull.class
edu/umd/cs/findbugs/annotations/DefaultAnnotationForFields.class
edu/umd/cs/findbugs/annotations/PossiblyNull.class
edu/umd/cs/findbugs/annotations/OverrideMustInvoke.class
edu/umd/cs/findbugs/annotations/DesireNoWarning.class
edu/umd/cs/findbugs/annotations/DischargesObligation.class
edu/umd/cs/findbugs/annotations/DefaultAnnotationForMethods.class
edu/umd/cs/findbugs/annotations/CreatesObligation.class
edu/umd/cs/findbugs/annotations/DefaultAnnotationForParameters.class
edu/umd/cs/findbugs/annotations/ExpectWarning.class
edu/umd/cs/findbugs/annotations/NoWarning.class
edu/umd/cs/findbugs/annotations/ReturnValuesAreNonnullByDefault.class
edu/umd/cs/findbugs/annotations/CleanupObligation.class
edu/umd/cs/findbugs/annotations/SuppressWarnings.class
edu/umd/cs/findbugs/annotations/CheckReturnValue.class
edu/umd/cs/findbugs/annotations/DesireWarning.class
edu/umd/cs/findbugs/annotations/SuppressFBWarnings.class
edu/umd/cs/findbugs/annotations/When.class
edu/umd/cs/findbugs/annotations/DefaultAnnotation.class
edu/umd/cs/findbugs/annotations/UnknownNullness.class
edu/umd/cs/findbugs/annotations/Priority.class
edu/umd/cs/findbugs/annotations/Confidence.class
edu/umd/cs/findbugs/annotations/Nullable.class
{noformat}
> Exclude spotbugs-annotations from transitive dependencies on branch-3.2
> ---
>
> Key: HADOOP-17849
> URL: https://issues.apache.org/jira/browse/HADOOP-17849
> Project: Hadoop Common
> Issue Type: Improvement
>Affects Versions: 3.2.2
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on
> hadoop-client-check-test-invariants. Excluding
> com.github.spotbugs:spotbugs-annotation from transitive dependencies should
> fix this for users needing zookeeer-3.4.14. Since the dependency is
> provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17849) Exclude spotbugs-annotations from transitive dependencies on branch-3.2
Masatake Iwasaki created HADOOP-17849: - Summary: Exclude spotbugs-annotations from transitive dependencies on branch-3.2 Key: HADOOP-17849 URL: https://issues.apache.org/jira/browse/HADOOP-17849 Project: Hadoop Common Issue Type: Improvement Affects Versions: 3.2.2 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Building Hadoop in dist profile with ZooKeeper 3.4.14 fails on hadoop-client-check-test-invariants. Excluding com.github.spotbugs:spotbugs-annotation from transitive dependencies should fix this for users needing zookeeer-3.4.14. Since the dependency is provided/optional on ZooKeeper 3.5.x, branch-3.3 and above are not affected. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17775) Remove JavaScript package from Docker environment
[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376273#comment-17376273 ] Masatake Iwasaki commented on HADOOP-17775: --- [~aajisaka] Sure. I submitted [#3182|https://github.com/apache/hadoop/pull/3182], [#3183|https://github.com/apache/hadoop/pull/3183] and [#3184|https://github.com/apache/hadoop/pull/3184]. > Remove JavaScript package from Docker environment > - > > Key: HADOOP-17775 > URL: https://issues.apache.org/jira/browse/HADOOP-17775 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > > As described in the [README of > yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], > required javascript modules are automatically pulled by > frontend-maven-plugin. We can leverage them for local testing too. > While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using > node.js, the version of node.js does not match. JavaScript related packages > of the docker environment is not sure to work. > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-17782) mvn install -DskipTests failed about hadoop@3.3.1
[
https://issues.apache.org/jira/browse/HADOOP-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HADOOP-17782.
---
Resolution: Cannot Reproduce
> mvn install -DskipTests failed about hadoop@3.3.1
> -
>
> Key: HADOOP-17782
> URL: https://issues.apache.org/jira/browse/HADOOP-17782
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 3.3.1
>Reporter: shixijun
>Priority: Major
>
> {panel:title=mvn install -DskipTests failed about hadoop@3.3.1}
> mvn install -DskipTests failed
> {panel}
> [root@centos8 spack-src]# mvn -version
> Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
> Maven home:
> /home/spack/spack/opt/spack/linux-centos8-aarch64/gcc-8.4.1/maven-3.6.3-bnannw7m3zq6axy7nmovnlhjawdy6pzt
> Java version: 1.8.0_191, vendor: AdoptOpenJdk, runtime:
> /home/spack/spack/opt/spack/linux-centos8-aarch64/gcc-8.4.1/openjdk-1.8.0_191-b12-fidptihybskgklbjoo4lagkacm6n6lod/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.18.0-240.22.1.el8_3.aarch64", arch: "aarch64",
> family: "unix"
> [root@centos8 spack-src]# java -version
> openjdk version "1.8.0_191"
> OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_191-b12)
> OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.191-b12, mixed mode)
> [root@centos8 spack-src]#mvn install -DskipTests
> ……
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Executing tasks
> main:
> [mkdir] Created dir:
> /root/6/hadoop-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/test-dir
> [INFO] Executed tasks
> [INFO]
> [INFO] --- maven-dependency-plugin:3.0.2:copy (default) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO]
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (banned-illegal-imports) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-generated-sources) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Skipping
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-sources) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Skipping
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-guava) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Replacement run on 22 files.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:install-node-and-yarn (install node
> and yarn) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-arm64.tar.gz to
> /root/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-arm64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> Jun 30, 2021 4:56:30 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: I/O exception (java.net.SocketException) caught when processing request
> to {s}->https://nodejs.org:443: Network is unreachable (connect failed)
> Jun 30, 2021 4:56:30 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: Retrying request to {s}->https://nodejs.org:443
> Jun 30, 2021 5:00:56 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: I/O exception (java.net.SocketException) caught when processing request
> to {s}->https://nodejs.org:443: Network is unreachable (connect failed)
> Jun 30, 2021 5:00:56 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: Retrying request to {s}->https://nodejs.org:443
> Jun 30, 2021 5:05:22 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: I/O exception (java.net.SocketException) caught when processing request
> to {s}->https://nodejs.org:443: Network is unreachable (connect failed)
> Jun 30, 2021 5:05:22 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: Retrying request to {s}->https://nodejs.org:443
> [INFO]
>
> [INFO] Reactor Summary for Apache Hadoop Main 3.4.0-SNAPSHOT:
> [INFO]
> [INFO] Apache Hadoop Main . SUCCESS [ 1.394
> s]
> [INFO] Apache Hadoop Build Tools .. SUCCESS [ 1.139
> s]
> [INFO] Apache Hadoop Project POM .. SUCCESS [ 1.138
> s]
> [INFO] Apache Hadoop Annotations .. SUCCESS [ 1.608
> s]
> [INFO] Apache Hadoop Project Dist POM . SUCCESS [ 0.117
> s]
> [INFO] Apache Hadoop Assemblies ... SUCCESS [ 0.144
> s]
> [INFO] Apache Hadoop Maven Plugins SUCCESS [ 3.554
> s]
> [INFO] Apache Hadoop MiniKDC .. SUCCESS [ 0.875
> s]
> [INFO] Apache Hadoop Auth
[jira] [Commented] (HADOOP-17782) mvn install -DskipTests failed about hadoop@3.3.1
[
https://issues.apache.org/jira/browse/HADOOP-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372296#comment-17372296
]
Masatake Iwasaki commented on HADOOP-17782:
---
[~Tom2021] I could not reproduce the issue on CentOS 7 (aarch64).
{noformat}
$ uname -a
Linux ip-172-33-0-128.ap-northeast-1.compute.internal
4.18.0-147.8.1.el7.aarch64 #1 SMP Wed Apr 15 18:13:44 UTC 2020 aarch64 aarch64
aarch64 GNU/Linux
$ checkout rel/release-3.3.1
$ mvn clean install -DskipTests -DskipShade 2>&1 | tee /tmp/build.log
...
[INFO] Apache Hadoop Cloud Storage Project SUCCESS [ 0.055 s]
[INFO]
[INFO] BUILD SUCCESS
[INFO]
[INFO] Total time: 06:48 min
[INFO] Finished at: 2021-07-01T01:02:56Z
[INFO]
$ grep node-8.11.3-linux-arm64 /tmp/build.log
[INFO] Unpacking
/home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-arm64.tar.gz
into
/home/centos/srcs/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
{noformat}
It looks like temporary server failure or networking issue.
{noformat}
[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.11.2:install-node-and-yarn (install
node and yarn) on project hadoop-yarn-applications-catalog-webapp: Could not
download Node.js: Could not download
https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-arm64.tar.gz: Network is
unreachable (connect failed) -> [Help 1]
{noformat}
> mvn install -DskipTests failed about hadoop@3.3.1
> -
>
> Key: HADOOP-17782
> URL: https://issues.apache.org/jira/browse/HADOOP-17782
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 3.3.1
>Reporter: shixijun
>Priority: Major
>
> {panel:title=mvn install -DskipTests failed about hadoop@3.3.1}
> mvn install -DskipTests failed
> {panel}
> [root@centos8 spack-src]# mvn -version
> Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
> Maven home:
> /home/spack/spack/opt/spack/linux-centos8-aarch64/gcc-8.4.1/maven-3.6.3-bnannw7m3zq6axy7nmovnlhjawdy6pzt
> Java version: 1.8.0_191, vendor: AdoptOpenJdk, runtime:
> /home/spack/spack/opt/spack/linux-centos8-aarch64/gcc-8.4.1/openjdk-1.8.0_191-b12-fidptihybskgklbjoo4lagkacm6n6lod/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.18.0-240.22.1.el8_3.aarch64", arch: "aarch64",
> family: "unix"
> [root@centos8 spack-src]# java -version
> openjdk version "1.8.0_191"
> OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_191-b12)
> OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.191-b12, mixed mode)
> [root@centos8 spack-src]#mvn install -DskipTests
> ……
> [INFO]
> [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Executing tasks
> main:
> [mkdir] Created dir:
> /root/6/hadoop-trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/test-dir
> [INFO] Executed tasks
> [INFO]
> [INFO] --- maven-dependency-plugin:3.0.2:copy (default) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO]
> [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (banned-illegal-imports) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-generated-sources) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Skipping
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-sources) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Skipping
> [INFO]
> [INFO] --- replacer:1.5.3:replace (replace-guava) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] Replacement run on 22 files.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:install-node-and-yarn (install node
> and yarn) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-arm64.tar.gz to
> /root/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-arm64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> Jun 30, 2021 4:56:30 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: I/O exception (java.net.SocketException) caught when processing request
> to {s}->https://nodejs.org:443: Network is unreachable (connect failed)
> Jun 30, 2021 4:56:30 PM org.apache.http.impl.execchain.RetryExec execute
> INFO: Retrying request to {s}->https://nodejs.org:443
> Jun 30, 2021 5:00:56 PM
[jira] [Updated] (HADOOP-17719) DistCp with snapshot diff should support file systems supporting getSnapshotDiffReport
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17719:
--
Status: Patch Available (was: Reopened)
I reopened this as a follow-up of HDFS-13916. The [PR
#3157|https://github.com/apache/hadoop/pull/3157] is intended to be
intermediate fix before moving snapshot related classes to hadoop-common as
part of FileSystem specification.
> DistCp with snapshot diff should support file systems supporting
> getSnapshotDiffReport
> ---
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem and
> WebHdfsFileSystem. Other file system could be used if getSnapshotDiffReport
> is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17719) DistCp with snapshot diff should support file systems supporting getSnapshotDiffReport
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17719:
--
Summary: DistCp with snapshot diff should support file systems supporting
getSnapshotDiffReport (was: DistCp with snapshot diff should support file
systems other than DistributedFileSystem)
> DistCp with snapshot diff should support file systems supporting
> getSnapshotDiffReport
> ---
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem and
> WebHdfsFileSystem. Other file system could be used if getSnapshotDiffReport
> is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Reopened] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki reopened HADOOP-17719:
---
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem and
> WebHdfsFileSystem. Other file system could be used if getSnapshotDiffReport
> is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17719:
--
Description: {{distcp -diff}} currently supports only DistributedFileSystem
and WebHdfsFileSystem. Other file system could be used if getSnapshotDiffReport
is supported. (was: {{distcp -diff}} currently supports only
DistributedFileSystem. Other file system could be used if getSnapshotDiffReport
is supported.)
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem and
> WebHdfsFileSystem. Other file system could be used if getSnapshotDiffReport
> is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-15777) Add support of getSnapshotDiff for all the FS inherit from FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-15777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-15777: - Assignee: (was: Masatake Iwasaki) > Add support of getSnapshotDiff for all the FS inherit from FileSystem > - > > Key: HADOOP-15777 > URL: https://issues.apache.org/jira/browse/HADOOP-15777 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 3.3.0 >Reporter: Xun REN >Priority: Major > > As proposed by [~jojochuang] in the Jira HDFS-13916, I create this Jira which > depends on HADOOP-15691 in order to add support of getSnapshotDiff for all > the File Systems inherit from the parent class FileSystem. > This method is used to get difference between two snapshots, which is mostly > used to do DistCP with "-diff" option. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-15777) Add support of getSnapshotDiff for all the FS inherit from FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-15777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-15777: - Assignee: Masatake Iwasaki > Add support of getSnapshotDiff for all the FS inherit from FileSystem > - > > Key: HADOOP-15777 > URL: https://issues.apache.org/jira/browse/HADOOP-15777 > Project: Hadoop Common > Issue Type: New Feature > Components: fs >Affects Versions: 3.3.0 >Reporter: Xun REN >Assignee: Masatake Iwasaki >Priority: Major > > As proposed by [~jojochuang] in the Jira HDFS-13916, I create this Jira which > depends on HADOOP-15691 in order to add support of getSnapshotDiff for all > the File Systems inherit from the parent class FileSystem. > This method is used to get difference between two snapshots, which is mostly > used to do DistCP with "-diff" option. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HADOOP-17719.
---
Resolution: Duplicate
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem. Other file
> system could be used if getSnapshotDiffReport is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17719:
--
Status: Open (was: Patch Available)
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem. Other file
> system could be used if getSnapshotDiffReport is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17775) Remove JavaScript package from Docker environment
[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17775: -- Status: Patch Available (was: Open) > Remove JavaScript package from Docker environment > - > > Key: HADOOP-17775 > URL: https://issues.apache.org/jira/browse/HADOOP-17775 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > As described in the [README of > yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], > required javascript modules are automatically pulled by > frontend-maven-plugin. We can leverage them for local testing too. > While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using > node.js, the version of node.js does not match. JavaScript related packages > of the docker environment is not sure to work. > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17775) Remove JavaScript package from Docker environment
[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17775: -- Description: As described in the [README of yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], required javascript modules are automatically pulled by frontend-maven-plugin. We can leverage them for local testing too. While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using node.js, the version of node.js does not match. JavaScript related packages of the docker environment is not sure to work. * https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 * https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 was: As described in the [README of yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], required javascript modules are automatically pulled by frontend-maven-plugin. We can leverage them for local testing too. While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using node.js, the version of node.js does not match. JavaScript related packages of the docker environment is not sure to work. * https://github.com/apache/hadoop/blob/538ce9c35403f0c8b595f42e835cc70c91c66621/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 * https://github.com/apache/hadoop/blob/538ce9c35403f0c8b595f42e835cc70c91c66621/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 > Remove JavaScript package from Docker environment > - > > Key: HADOOP-17775 > URL: https://issues.apache.org/jira/browse/HADOOP-17775 > Project: Hadoop Common > Issue Type: Improvement > Components: build >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > > As described in the [README of > yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], > required javascript modules are automatically pulled by > frontend-maven-plugin. We can leverage them for local testing too. > While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using > node.js, the version of node.js does not match. JavaScript related packages > of the docker environment is not sure to work. > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 > * > https://github.com/apache/hadoop/blob/fdef2b4ccacb8753aac0f5625505181c9b4dc154/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17775) Remove JavaScript package from Docker environment
Masatake Iwasaki created HADOOP-17775: - Summary: Remove JavaScript package from Docker environment Key: HADOOP-17775 URL: https://issues.apache.org/jira/browse/HADOOP-17775 Project: Hadoop Common Issue Type: Improvement Components: build Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki As described in the [README of yarn-ui|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/README.md], required javascript modules are automatically pulled by frontend-maven-plugin. We can leverage them for local testing too. While hadoop-yarn-ui and hadoop-yarn-applications-catalog-webapp is using node.js, the version of node.js does not match. JavaScript related packages of the docker environment is not sure to work. * https://github.com/apache/hadoop/blob/538ce9c35403f0c8b595f42e835cc70c91c66621/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/pom.xml#L170-L212 * https://github.com/apache/hadoop/blob/538ce9c35403f0c8b595f42e835cc70c91c66621/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml#L264-L290 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-11758) Add options to filter out too much granular tracing spans
[ https://issues.apache.org/jira/browse/HADOOP-11758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HADOOP-11758. --- Resolution: Won't Fix > Add options to filter out too much granular tracing spans > - > > Key: HADOOP-11758 > URL: https://issues.apache.org/jira/browse/HADOOP-11758 > Project: Hadoop Common > Issue Type: Improvement > Components: tracing >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Attachments: testWriteTraceHooks-HDFS-8026.html, > testWriteTraceHooks.html > > > in order to avoid queue in span receiver spills -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-11967) Prefix of configuration properties given to "hadoop trace" command should be omittable
[
https://issues.apache.org/jira/browse/HADOOP-11967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-11967:
--
Resolution: Won't Fix
Status: Resolved (was: Patch Available)
HADOOP-17387 obsoleted this.
> Prefix of configuration properties given to "hadoop trace" command should be
> omittable
> --
>
> Key: HADOOP-11967
> URL: https://issues.apache.org/jira/browse/HADOOP-11967
> Project: Hadoop Common
> Issue Type: Improvement
> Components: tracing
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
> Attachments: HADOOP-11967.001.patch, HADOOP-11967.002.patch,
> HADOOP-11967.002.patch, HADOOP-11967.003.patch
>
>
> Configuration properties for tracing must be properly prefixed based on
> context in configuration files such as core-site.xml or hdfs-site.xml. When
> users run {{hadoop trace}} command, the context and prefix is obvious from
> the target server host and could be omittable to reduce typing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17746: -- Status: Patch Available (was: Open) > compatibility table in directory_markers.md doesn't render right > > > Key: HADOOP-17746 > URL: https://issues.apache.org/jira/browse/HADOOP-17746 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3, site >Affects Versions: 3.3.1 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Minor > Attachments: Screenshot 2021-06-03 at 20.44.19.png > > > The compatibility table in the directory markers doc doesn't render right; > looks like what is meant to be the top and bottom of the table are being > interpreted as horizontal lines, which confuses the maven site code > Renders ~OK on github > https://github.com/apache/hadoop/blob/branch-3.3.1/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/directory_markers.md -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17708) Fail to build hadoop-common from source on Fedora
[
https://issues.apache.org/jira/browse/HADOOP-17708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350720#comment-17350720
]
Masatake Iwasaki commented on HADOOP-17708:
---
[~bioinfornatics] The fix version/s of HADOOP-17569 is 3.2.3, 3.3.1 and 3.4.0.
If you want to build 3.2.2 on Fedora 33 or above, you need to apply [the patch
of #2886|https://github.com/apache/hadoop/pull/2886.patch].
> Fail to build hadoop-common from source on Fedora
> -
>
> Key: HADOOP-17708
> URL: https://issues.apache.org/jira/browse/HADOOP-17708
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Jonathan mercier
>Priority: Major
>
> Dear I tried to build hadoop from source with a vanilla fedora 34
> {code:bash}
> dnf group install -y "Development Tools" \
> && dnf install -y java-1.8.0-openjdk-devel fuse-devel snappy-java
> snappy-devel jansson-devel protobuf zlib-devel libzstd-devel \
>maven-1:3.6.3 cmake gcc-c++ ant protobuf-compiler
> protobuf-java slf4j
> export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/
> export MAVEN_OPTS="-Xms2048M -Xmx4096M"
> export
> PATH="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/bin/:$PATH"
> export CC=/usr/bin/gcc
> export CXX=/usr/bin/g++
> curl -LO
> https://apache.mediamirrors.org/hadoop/common/hadoop-3.2.2/hadoop-3.2.2-src.tar.gz
> tar xf hadoop-3.2.2-src.tar.gz && cd hadoop-3.2.2-src
> mvn package -Pdist,native -Drequire.snappy=true -DskipTests -Dtar
> {code}
> But I have this error
> {code:java}
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.runMake
> (CompileMojo.java:229)
>
>
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.execute
> (CompileMojo.java:98)
>
>
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
> (DefaultBuildPluginManager.java:137)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:210)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:156)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:148)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:117)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:81)
>
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
> (SingleThreadedBuilder.java:56)
>
>
> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
> (LifecycleStarter.java:128)
>
>
> at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>
>
>
[jira] [Commented] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348948#comment-17348948
]
Masatake Iwasaki commented on HADOOP-17719:
---
It looks quite similar. I'm going to ask the author to rebase the patch of
HDFS-13916.
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem. Other file
> system could be used if getSnapshotDiffReport is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-14922: -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) I committed this to trunk after testing my local environment. Thanks for the contribution, [~anuphal]. > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Assignee: Anup Halarnkar >Priority: Major > Fix For: 3.4.0 > > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-14922: - Assignee: Anup Halarnkar > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Assignee: Anup Halarnkar >Priority: Major > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17719:
--
Status: Patch Available (was: Open)
> DistCp with snapshot diff should support file systems other than
> DistributedFileSystem
> --
>
> Key: HADOOP-17719
> URL: https://issues.apache.org/jira/browse/HADOOP-17719
> Project: Hadoop Common
> Issue Type: Improvement
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {{distcp -diff}} currently supports only DistributedFileSystem. Other file
> system could be used if getSnapshotDiffReport is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17719) DistCp with snapshot diff should support file systems other than DistributedFileSystem
Masatake Iwasaki created HADOOP-17719:
-
Summary: DistCp with snapshot diff should support file systems
other than DistributedFileSystem
Key: HADOOP-17719
URL: https://issues.apache.org/jira/browse/HADOOP-17719
Project: Hadoop Common
Issue Type: Improvement
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{{distcp -diff}} currently supports only DistributedFileSystem. Other file
system could be used if getSnapshotDiffReport is supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348209#comment-17348209 ] Masatake Iwasaki commented on HADOOP-14922: --- The attached patch worked for 3.2.2 while testing on BIGTOP-3542. Unit tests of hadoop-mapreduce-client-nativetask succeeded with the patch applied. I'm +1 and going to commit this after checking this does not affect other platforms. > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Priority: Major > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14922) Build of Mapreduce Native Task module fails with unknown opcode "bswap"
[ https://issues.apache.org/jira/browse/HADOOP-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-14922: -- Status: Patch Available (was: Open) > Build of Mapreduce Native Task module fails with unknown opcode "bswap" > --- > > Key: HADOOP-14922 > URL: https://issues.apache.org/jira/browse/HADOOP-14922 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 > Environment: OS: Ubuntu 14.04 > Arch: PPC64LE >Reporter: Anup Halarnkar >Priority: Major > Attachments: HADOOP-14922.01.patch > > > [WARNING] /tmp/cckBBdQp.s: Assembler messages: > [WARNING] /tmp/cckBBdQp.s:3127: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cckBBdQp.s:3152: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/BlockCodec.cc.o] Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccqRfBZp.s: Assembler messages: > [WARNING] /tmp/ccqRfBZp.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccqRfBZp.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/cc50B5Mp.s: Assembler messages: > [WARNING] /tmp/cc50B5Mp.s:3112: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/cc50B5Mp.s:3137: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/BlockCodec.cc.o] > Error 1 > [WARNING] make[2]: *** Waiting for unfinished jobs > [WARNING] /tmp/ccobJqOY.s: Assembler messages: > [WARNING] /tmp/ccobJqOY.s:2098: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccobJqOY.s:2123: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/Lz4Codec.cc.o] Error 1 > [WARNING] /tmp/ccdaQ1CY.s: Assembler messages: > [WARNING] /tmp/ccdaQ1CY.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccdaQ1CY.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s: Assembler messages: > [WARNING] /tmp/ccRwHt5X.s:2235: Error: unrecognized opcode: `bswap' > [WARNING] /tmp/ccRwHt5X.s:2249: Error: unrecognized opcode: `bswap' > [WARNING] make[2]: *** > [CMakeFiles/nativetask.dir/main/native/src/codec/SnappyCodec.cc.o] Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask.dir/all] Error 2 > [WARNING] make[1]: *** Waiting for unfinished jobs > [WARNING] make[2]: *** > [CMakeFiles/nativetask_static.dir/main/native/src/codec/SnappyCodec.cc.o] > Error 1 > [WARNING] make[1]: *** [CMakeFiles/nativetask_static.dir/all] Error 2 > [WARNING] make: *** [all] Error 2 -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17609) Make SM4 support optional for OpenSSL native code
[ https://issues.apache.org/jira/browse/HADOOP-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17609: -- Status: Patch Available (was: Open) I opened [#3013|https://github.com/apache/hadoop/pull/3019] replacing [#2847|https://github.com/apache/hadoop/pull/2847] with simple fix. > Make SM4 support optional for OpenSSL native code > - > > Key: HADOOP-17609 > URL: https://issues.apache.org/jira/browse/HADOOP-17609 > Project: Hadoop Common > Issue Type: Improvement > Components: native >Affects Versions: 3.4.0 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 1h 40m > Remaining Estimate: 0h > > openssl-devel-1.1.1g provided by CentOS 8 does not work after HDFS-15098 > because the SM4 is not enabled on the openssl package. We should not force > users to install OpenSSL from source code even if they do not use SM4 feature. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17609) Make SM4 support optional for OpenSSL native code
[ https://issues.apache.org/jira/browse/HADOOP-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17609: -- Status: Open (was: Patch Available) > Make SM4 support optional for OpenSSL native code > - > > Key: HADOOP-17609 > URL: https://issues.apache.org/jira/browse/HADOOP-17609 > Project: Hadoop Common > Issue Type: Improvement > Components: native >Affects Versions: 3.4.0 >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > openssl-devel-1.1.1g provided by CentOS 8 does not work after HDFS-15098 > because the SM4 is not enabled on the openssl package. We should not force > users to install OpenSSL from source code even if they do not use SM4 feature. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17635) Update the ubuntu version in the build instruction
[
https://issues.apache.org/jira/browse/HADOOP-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17635:
--
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Update the ubuntu version in the build instruction
> --
>
> Key: HADOOP-17635
> URL: https://issues.apache.org/jira/browse/HADOOP-17635
> Project: Hadoop Common
> Issue Type: Bug
> Components: build, documentation
>Reporter: Akira Ajisaka
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> In BUILDING.txt
> {noformat}
> Installing required packages for clean install of Ubuntu 14.04 LTS Desktop:
> {noformat}
> Ubuntu 14 is already EoL, should be updated to 18 or 20.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17635) Update the ubuntu version in the build instruction
[
https://issues.apache.org/jira/browse/HADOOP-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17635:
--
Status: Patch Available (was: Open)
> Update the ubuntu version in the build instruction
> --
>
> Key: HADOOP-17635
> URL: https://issues.apache.org/jira/browse/HADOOP-17635
> Project: Hadoop Common
> Issue Type: Bug
> Components: build, documentation
>Reporter: Akira Ajisaka
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In BUILDING.txt
> {noformat}
> Installing required packages for clean install of Ubuntu 14.04 LTS Desktop:
> {noformat}
> Ubuntu 14 is already EoL, should be updated to 18 or 20.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-17635) Update the ubuntu version in the build instruction
[
https://issues.apache.org/jira/browse/HADOOP-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki reassigned HADOOP-17635:
-
Assignee: Masatake Iwasaki
> Update the ubuntu version in the build instruction
> --
>
> Key: HADOOP-17635
> URL: https://issues.apache.org/jira/browse/HADOOP-17635
> Project: Hadoop Common
> Issue Type: Bug
> Components: build, documentation
>Reporter: Akira Ajisaka
>Assignee: Masatake Iwasaki
>Priority: Major
>
> In BUILDING.txt
> {noformat}
> Installing required packages for clean install of Ubuntu 14.04 LTS Desktop:
> {noformat}
> Ubuntu 14 is already EoL, should be updated to 18 or 20.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17635) Update the ubuntu version in the build instruction
[
https://issues.apache.org/jira/browse/HADOOP-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324634#comment-17324634
]
Masatake Iwasaki commented on HADOOP-17635:
---
The setup procedure on Ubuntu 18.04 is different from 20.04. Uses of Ubuntu
18.04 need to install gcc-9 from supplemental repository and cmake >= 3.19 from
source code (after HDFS-15740). Leaving current instruction for Ubuntu 18.04
could be useful until majority of users move to 20.04.
> Update the ubuntu version in the build instruction
> --
>
> Key: HADOOP-17635
> URL: https://issues.apache.org/jira/browse/HADOOP-17635
> Project: Hadoop Common
> Issue Type: Bug
> Components: build, documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> In BUILDING.txt
> {noformat}
> Installing required packages for clean install of Ubuntu 14.04 LTS Desktop:
> {noformat}
> Ubuntu 14 is already EoL, should be updated to 18 or 20.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33
[
https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17569:
--
Fix Version/s: 3.2.3
> Building native code fails on Fedora 33
> ---
>
> Key: HADOOP-17569
> URL: https://issues.apache.org/jira/browse/HADOOP-17569
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, common
>Reporter: Kengo Seki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.3.1, 3.4.0, 3.2.3
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I tried to build native code on Fedora 33, in which glibc 2.32 is installed
> by default, but it failed with the following error.
> {code:java}
> $ cat /etc/redhat-release
> Fedora release 33 (Thirty Three)
> $ sudo dnf info --installed glibc
> Installed Packages
> Name : glibc
> Version : 2.32
> Release : 1.fc33
> Architecture : x86_64
> Size : 17 M
> Source : glibc-2.32-1.fc33.src.rpm
> Repository : @System
> From repo: anaconda
> Summary : The GNU libc libraries
> URL : http://www.gnu.org/software/glibc/
> License : LGPLv2+ and LGPLv2+ with exceptions and GPLv2+ and GPLv2+ with
> exceptions and BSD and Inner-Net and ISC and Public Domain and GFDL
> Description : The glibc package contains standard libraries which are used by
> : multiple programs on the system. In order to save disk space
> and
> : memory, as well as to make upgrading easier, common system
> code is
> : kept in one place and shared between programs. This particular
> package
> : contains the most important sets of shared libraries: the
> standard C
> : library and the standard math library. Without these two
> libraries, a
> : Linux system will not function.
> $ mvn clean compile -Pnative
> ...
> [INFO] Running make -j 1 VERBOSE=1
> [WARNING] /usr/bin/cmake
> -S/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -B/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> --check-build-system CMakeFiles/Makefile.cmake 0
> [WARNING] /usr/bin/cmake -E cmake_progress_start
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles
>
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native//CMakeFiles/progress.marks
> [WARNING] make -f CMakeFiles/Makefile2 all
> [WARNING] make[1]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/depend
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] cd
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native &&
> /usr/bin/cmake -E cmake_depends "Unix Makefiles"
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake
> --color=
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/CMakeDirectoryInformation.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Scanning dependencies of target hadoop_static
> [WARNING] make[2]: Leaving directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/build
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] [ 2%] Building C object
> CMakeFiles/hadoop_static.dir/main/native/src/exception.c.o
> [WARNING] /usr/bin/cc
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/javah
>
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/main/native/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/src
>
[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33
[
https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17569:
--
Fix Version/s: 3.3.1
> Building native code fails on Fedora 33
> ---
>
> Key: HADOOP-17569
> URL: https://issues.apache.org/jira/browse/HADOOP-17569
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, common
>Reporter: Kengo Seki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.3.1, 3.4.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I tried to build native code on Fedora 33, in which glibc 2.32 is installed
> by default, but it failed with the following error.
> {code:java}
> $ cat /etc/redhat-release
> Fedora release 33 (Thirty Three)
> $ sudo dnf info --installed glibc
> Installed Packages
> Name : glibc
> Version : 2.32
> Release : 1.fc33
> Architecture : x86_64
> Size : 17 M
> Source : glibc-2.32-1.fc33.src.rpm
> Repository : @System
> From repo: anaconda
> Summary : The GNU libc libraries
> URL : http://www.gnu.org/software/glibc/
> License : LGPLv2+ and LGPLv2+ with exceptions and GPLv2+ and GPLv2+ with
> exceptions and BSD and Inner-Net and ISC and Public Domain and GFDL
> Description : The glibc package contains standard libraries which are used by
> : multiple programs on the system. In order to save disk space
> and
> : memory, as well as to make upgrading easier, common system
> code is
> : kept in one place and shared between programs. This particular
> package
> : contains the most important sets of shared libraries: the
> standard C
> : library and the standard math library. Without these two
> libraries, a
> : Linux system will not function.
> $ mvn clean compile -Pnative
> ...
> [INFO] Running make -j 1 VERBOSE=1
> [WARNING] /usr/bin/cmake
> -S/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -B/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> --check-build-system CMakeFiles/Makefile.cmake 0
> [WARNING] /usr/bin/cmake -E cmake_progress_start
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles
>
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native//CMakeFiles/progress.marks
> [WARNING] make -f CMakeFiles/Makefile2 all
> [WARNING] make[1]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/depend
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] cd
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native &&
> /usr/bin/cmake -E cmake_depends "Unix Makefiles"
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake
> --color=
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/CMakeDirectoryInformation.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Scanning dependencies of target hadoop_static
> [WARNING] make[2]: Leaving directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/build
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] [ 2%] Building C object
> CMakeFiles/hadoop_static.dir/main/native/src/exception.c.o
> [WARNING] /usr/bin/cc
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/javah
>
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/main/native/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/src
>
[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33
[
https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17569:
--
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Building native code fails on Fedora 33
> ---
>
> Key: HADOOP-17569
> URL: https://issues.apache.org/jira/browse/HADOOP-17569
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, common
>Reporter: Kengo Seki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I tried to build native code on Fedora 33, in which glibc 2.32 is installed
> by default, but it failed with the following error.
> {code:java}
> $ cat /etc/redhat-release
> Fedora release 33 (Thirty Three)
> $ sudo dnf info --installed glibc
> Installed Packages
> Name : glibc
> Version : 2.32
> Release : 1.fc33
> Architecture : x86_64
> Size : 17 M
> Source : glibc-2.32-1.fc33.src.rpm
> Repository : @System
> From repo: anaconda
> Summary : The GNU libc libraries
> URL : http://www.gnu.org/software/glibc/
> License : LGPLv2+ and LGPLv2+ with exceptions and GPLv2+ and GPLv2+ with
> exceptions and BSD and Inner-Net and ISC and Public Domain and GFDL
> Description : The glibc package contains standard libraries which are used by
> : multiple programs on the system. In order to save disk space
> and
> : memory, as well as to make upgrading easier, common system
> code is
> : kept in one place and shared between programs. This particular
> package
> : contains the most important sets of shared libraries: the
> standard C
> : library and the standard math library. Without these two
> libraries, a
> : Linux system will not function.
> $ mvn clean compile -Pnative
> ...
> [INFO] Running make -j 1 VERBOSE=1
> [WARNING] /usr/bin/cmake
> -S/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -B/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> --check-build-system CMakeFiles/Makefile.cmake 0
> [WARNING] /usr/bin/cmake -E cmake_progress_start
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles
>
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native//CMakeFiles/progress.marks
> [WARNING] make -f CMakeFiles/Makefile2 all
> [WARNING] make[1]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/depend
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] cd
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native &&
> /usr/bin/cmake -E cmake_depends "Unix Makefiles"
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake
> --color=
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/CMakeDirectoryInformation.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Scanning dependencies of target hadoop_static
> [WARNING] make[2]: Leaving directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/build
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] [ 2%] Building C object
> CMakeFiles/hadoop_static.dir/main/native/src/exception.c.o
> [WARNING] /usr/bin/cc
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/javah
>
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/main/native/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
>
[jira] [Updated] (HADOOP-17569) Building native code fails on Fedora 33
[
https://issues.apache.org/jira/browse/HADOOP-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HADOOP-17569:
--
Status: Patch Available (was: Open)
> Building native code fails on Fedora 33
> ---
>
> Key: HADOOP-17569
> URL: https://issues.apache.org/jira/browse/HADOOP-17569
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, common
>Reporter: Kengo Seki
>Assignee: Masatake Iwasaki
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> I tried to build native code on Fedora 33, in which glibc 2.32 is installed
> by default, but it failed with the following error.
> {code:java}
> $ cat /etc/redhat-release
> Fedora release 33 (Thirty Three)
> $ sudo dnf info --installed glibc
> Installed Packages
> Name : glibc
> Version : 2.32
> Release : 1.fc33
> Architecture : x86_64
> Size : 17 M
> Source : glibc-2.32-1.fc33.src.rpm
> Repository : @System
> From repo: anaconda
> Summary : The GNU libc libraries
> URL : http://www.gnu.org/software/glibc/
> License : LGPLv2+ and LGPLv2+ with exceptions and GPLv2+ and GPLv2+ with
> exceptions and BSD and Inner-Net and ISC and Public Domain and GFDL
> Description : The glibc package contains standard libraries which are used by
> : multiple programs on the system. In order to save disk space
> and
> : memory, as well as to make upgrading easier, common system
> code is
> : kept in one place and shared between programs. This particular
> package
> : contains the most important sets of shared libraries: the
> standard C
> : library and the standard math library. Without these two
> libraries, a
> : Linux system will not function.
> $ mvn clean compile -Pnative
> ...
> [INFO] Running make -j 1 VERBOSE=1
> [WARNING] /usr/bin/cmake
> -S/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -B/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> --check-build-system CMakeFiles/Makefile.cmake 0
> [WARNING] /usr/bin/cmake -E cmake_progress_start
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles
>
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native//CMakeFiles/progress.marks
> [WARNING] make -f CMakeFiles/Makefile2 all
> [WARNING] make[1]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/depend
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] cd
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native &&
> /usr/bin/cmake -E cmake_depends "Unix Makefiles"
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
> /home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake
> --color=
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/DependInfo.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Dependee
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/CMakeDirectoryInformation.cmake"
> is newer than depender
> "/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/CMakeFiles/hadoop_static.dir/depend.internal".
> [WARNING] Scanning dependencies of target hadoop_static
> [WARNING] make[2]: Leaving directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] make -f CMakeFiles/hadoop_static.dir/build.make
> CMakeFiles/hadoop_static.dir/build
> [WARNING] make[2]: Entering directory
> '/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native'
> [WARNING] [ 2%] Building C object
> CMakeFiles/hadoop_static.dir/main/native/src/exception.c.o
> [WARNING] /usr/bin/cc
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native/javah
>
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/main/native/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/src/src
> -I/home/vagrant/hadoop/hadoop-common-project/hadoop-common/target/native
>
