[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899888#comment-16899888
]
Yuqi Gu commented on HADOOP-9320:
-
We build the hadoop native in our AArch64 platform:
Environment:
{code:java}
builder@yq-hadoop:~/hadoop$ arch
aarch64
builder@yq-hadoop:~/hadoop$ cat /etc/os-release
NAME="Ubuntu"
VERSION="18.04 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04 LTS"
VERSION_ID="18.04"
{code}
# Install protobuf 2.5.0 for Arm64.
# Set JAVA_HOME:
{code:java}
export JAVA_HOME=`readlink -f /usr/bin/java | sed "s:jre/bin/java::"`
{code}
# Install openssl: libssl1.0-dev (Replace libssl1.0-dev with libssl-dev)
# Set BUNDLE_SNAPPY:
{code:java}
[ -f /usr/lib/libsnappy.so ] && BUNDLE_SNAPPY="-Dsnappy.prefix=x
-Dbundle.snappy=true -Dsnappy.lib=/usr/lib"
[ -f /usr/lib64/libsnappy.so ] && BUNDLE_SNAPPY="-Dsnappy.prefix=x
-Dbundle.snappy=true -Dsnappy.lib=/usr/lib64"
[ -f /usr/lib/aarch64-linux-gnu/libsnappy.so ] &&
BUNDLE_SNAPPY="-Dsnappy.prefix=x -Dbundle.snappy=true
-Dsnappy.lib=/usr/lib/aarch64-linux-gnu"
{code}
Native build:
{code:java}
mvn clean install package $BUNDLE_SNAPPY -DskipTests -DskipITs -Pdist,native
-Dtar -Dtar -Dmaven.javadoc.skip=true
{code}
We could successfully navie build Hadoop on 2.8:
{code:java}
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-dist ---
[INFO] Skipping javadoc generation
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-dist ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-dist ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-dist ---
[INFO]
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @
hadoop-dist ---
[INFO]
[INFO] Reactor Summary for Apache Hadoop Main 2.8.5:
[INFO]
[INFO] Apache Hadoop Main . SUCCESS [ 1.334 s]
[INFO] Apache Hadoop Build Tools .. SUCCESS [ 0.849 s]
[INFO] Apache Hadoop Project POM .. SUCCESS [ 1.211 s]
[INFO] Apache Hadoop Annotations .. SUCCESS [ 1.571 s]
[INFO] Apache Hadoop Assemblies ... SUCCESS [ 0.250 s]
[INFO] Apache Hadoop Project Dist POM . SUCCESS [ 2.230 s]
[INFO] Apache Hadoop Maven Plugins SUCCESS [ 2.473 s]
[INFO] Apache Hadoop MiniKDC .. SUCCESS [ 4.845 s]
[INFO] Apache Hadoop Auth . SUCCESS [ 4.866 s]
[INFO] Apache Hadoop Auth Examples SUCCESS [ 2.068 s]
[INFO] Apache Hadoop Common ... SUCCESS [01:13 min]
[INFO] Apache Hadoop NFS .. SUCCESS [ 1.560 s]
[INFO] Apache Hadoop KMS .. SUCCESS [ 22.003 s]
[INFO] Apache Hadoop Common Project ... SUCCESS [ 0.087 s]
[INFO] Apache Hadoop HDFS Client .. SUCCESS [01:14 min]
[INFO] Apache Hadoop HDFS . SUCCESS [ 36.665 s]
[INFO] Apache Hadoop HDFS Native Client ... SUCCESS [ 26.192 s]
[INFO] Apache Hadoop HttpFS ... SUCCESS [ 29.175 s]
[INFO] Apache Hadoop HDFS BookKeeper Journal .. SUCCESS [ 21.165 s]
[INFO] Apache Hadoop HDFS-NFS . SUCCESS [ 1.609 s]
[INFO] Apache Hadoop HDFS Project . SUCCESS [ 0.080 s]
[INFO] Apache Hadoop YARN . SUCCESS [ 0.079 s]
[INFO] Apache Hadoop YARN API . SUCCESS [ 7.357 s]
[INFO] Apache Hadoop YARN Common .. SUCCESS [01:00 min]
[INFO] Apache Hadoop YARN Server .. SUCCESS [ 0.078 s]
[INFO] Apache Hadoop YARN Server Common ... SUCCESS [ 2.653 s]
[INFO] Apache Hadoop YARN NodeManager . SUCCESS [ 16.461 s]
[INFO] Apache Hadoop YARN Web Proxy ... SUCCESS [ 1.155 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ... SUCCESS [ 17.939 s]
[INFO] Apache Hadoop YARN ResourceManager . SUCCESS [ 10.252 s]
[INFO] Apache Hadoop YARN Server Tests SUCCESS [ 1.800 s]
[INFO] Apache Hadoop YARN Client .. SUCCESS [ 1.973 s]
[INFO] Apache Hadoop YARN SharedCacheManager .. SUCCESS [ 1.713 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage . SUCCESS [ 1.534 s]
[INFO] Apache Hadoop YARN Applications SUCCESS [ 0.074 s]
[INFO] Apache Hadoop YARN DistributedShell SUCCESS [ 1.320 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ... SUCCESS [ 0.794 s]
[INFO] Apache Hadoop
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889188#comment-16889188
]
Hadoop QA commented on HADOOP-9320:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 10s{color}
| {color:red} HADOOP-9320 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-9320 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12570212/HADOOP-9320.patch |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/16394/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Hadoop native build failure on ARM hard-float
> -
>
> Key: HADOOP-9320
> URL: https://issues.apache.org/jira/browse/HADOOP-9320
> Project: Hadoop Common
> Issue Type: Bug
> Components: native
>Affects Versions: 2.0.3-alpha
> Environment: $ uname -a
> Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
> armv7l armv7l GNU/Linux
> $ java -version
> java version "1.8.0-ea"
> Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
> Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
>Reporter: Trevor Robinson
>Assignee: Trevor Robinson
>Priority: Major
> Labels: BB2015-05-TBR, build-failure
> Attachments: HADOOP-9320.patch
>
>
> ARM JVM float ABI detection is failing in JNIFlags.cmake because
> JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
> to assume a soft-float JVM. This causes the build to fail with hard-float
> OpenJDK (but don't use that) and [Oracle Java 8 Preview for
> ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
> Java 7 will support hard-float as well.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018928#comment-16018928
]
Hadoop QA commented on HADOOP-9320:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 14m
28s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 14m
59s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
8s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
21s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 12m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} cc {color} | {color:green} 12m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 12m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 7m
29s{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
36s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 54m 48s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:14b5c93 |
| JIRA Issue | HADOOP-9320 |
| GITHUB PR | https://github.com/apache/hadoop/pull/224 |
| Optional Tests | asflicense compile cc mvnsite javac unit |
| uname | Linux fa57587d6636 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6
15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 46d9c4c |
| Default Java | 1.8.0_131 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12368/testReport/ |
| modules | C: hadoop-common-project/hadoop-common U:
hadoop-common-project/hadoop-common |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12368/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Hadoop native build failure on ARM hard-float
> -
>
> Key: HADOOP-9320
> URL: https://issues.apache.org/jira/browse/HADOOP-9320
> Project: Hadoop Common
> Issue Type: Bug
> Components: native
>Affects Versions: 2.0.3-alpha
> Environment: $ uname -a
> Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
> armv7l armv7l GNU/Linux
> $ java -version
> java version "1.8.0-ea"
> Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
> Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
>Reporter: Trevor Robinson
>Assignee: Trevor Robinson
> Labels: BB2015-05-TBR, build-failure
> Attachments: HADOOP-9320.patch
>
>
> ARM JVM float ABI detection is failing in JNIFlags.cmake because
> JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
> to assume a soft-float JVM. This causes the build to fail with hard-float
> OpenJDK (but don't use that) and [Oracle Java 8 Preview for
> ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
> Java 7 will support hard-float as well.
--
This message was sent by Atlassian JIRA
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018869#comment-16018869
]
ASF GitHub Bot commented on HADOOP-9320:
GitHub user amuttsch opened a pull request:
https://github.com/apache/hadoop/pull/224
HADOOP-9320 Fix Hadoop native build failure on ARM hard-float
Moved the ARM JVM float ABI detection from `HadoopCommon.cmake` to
`HadoopJNI.cmake`, because `${JAVA_JVM_LIBRARY}` is not available in
`HadoopCommon.cmake` yet and therefore the build fails.
This commit fixes this issue.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/amuttsch/hadoop HADOOP-9320
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hadoop/pull/224.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #224
commit f40c8db28b382c21efa97bd892f778a1e51fedf7
Author: Andreas Muttscheller
Date: 2017-05-21T15:45:41Z
HADOOP-9320 Fix Hadoop native build failure on ARM hard-float
> Hadoop native build failure on ARM hard-float
> -
>
> Key: HADOOP-9320
> URL: https://issues.apache.org/jira/browse/HADOOP-9320
> Project: Hadoop Common
> Issue Type: Bug
> Components: native
>Affects Versions: 2.0.3-alpha
> Environment: $ uname -a
> Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
> armv7l armv7l GNU/Linux
> $ java -version
> java version "1.8.0-ea"
> Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
> Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
>Reporter: Trevor Robinson
>Assignee: Trevor Robinson
> Labels: BB2015-05-TBR, build-failure
> Attachments: HADOOP-9320.patch
>
>
> ARM JVM float ABI detection is failing in JNIFlags.cmake because
> JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
> to assume a soft-float JVM. This causes the build to fail with hard-float
> OpenJDK (but don't use that) and [Oracle Java 8 Preview for
> ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
> Java 7 will support hard-float as well.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018862#comment-16018862
]
Andreas Muttscheller commented on HADOOP-9320:
--
This problem still exist with Hadoop 2.8. Unfortunatelly, the patch doesn't
work for this version. I updated the patch to work with Hadoop 2.8:
{code:title=HADOOP-9320-v2.8.patch|borderStyle=solid}
diff -Naur a/hadoop-common-project/hadoop-common/HadoopCommon.cmake
b/hadoop-common-project/hadoop-common/HadoopCommon.cmake
--- a/hadoop-common-project/hadoop-common/HadoopCommon.cmake2017-03-16
19:43:23.0 +
+++ b/hadoop-common-project/hadoop-common/HadoopCommon.cmake2017-05-21
15:22:32.832162322 +
@@ -154,35 +154,6 @@
endif()
endif()
-# Determine float ABI of JVM on ARM.
-if(CMAKE_SYSTEM_PROCESSOR MATCHES "^arm")
-find_program(READELF readelf)
-if(READELF MATCHES "NOTFOUND")
-message(WARNING "readelf not found; JVM float ABI detection
disabled")
-else(READELF MATCHES "NOTFOUND")
-execute_process(
-COMMAND ${READELF} -A ${JAVA_JVM_LIBRARY}
-OUTPUT_VARIABLE JVM_ELF_ARCH
-ERROR_QUIET)
-if(NOT JVM_ELF_ARCH MATCHES "Tag_ABI_VFP_args: VFP registers")
-# Test compilation with -mfloat-abi=softfp using an arbitrary
libc function
-# (typically fails with "fatal error: bits/predefs.h: No such
file or directory"
-# if soft-float dev libraries are not installed)
-message("Soft-float JVM detected")
-include(CMakePushCheckState)
-cmake_push_check_state()
-set(CMAKE_REQUIRED_FLAGS "${CMAKE_REQUIRED_FLAGS}
-mfloat-abi=softfp")
-include(CheckSymbolExists)
-check_symbol_exists(exit stdlib.h SOFTFP_AVAILABLE)
-if(NOT SOFTFP_AVAILABLE)
-message(FATAL_ERROR "Soft-float dev libraries required
(e.g. 'apt-get install libc6-dev-armel' on Debian/Ubuntu)")
-endif()
-cmake_pop_check_state()
-hadoop_add_compiler_flags("-mfloat-abi=softfp")
-endif()
-endif()
-endif()
-
#
# Solaris-specific configuration.
#
diff -Naur a/hadoop-common-project/hadoop-common/HadoopJNI.cmake
b/hadoop-common-project/hadoop-common/HadoopJNI.cmake
--- a/hadoop-common-project/hadoop-common/HadoopJNI.cmake 2017-01-11
19:33:37.0 +
+++ b/hadoop-common-project/hadoop-common/HadoopJNI.cmake 2017-05-21
15:23:01.612140922 +
@@ -95,3 +95,38 @@
else()
find_package(JNI REQUIRED)
endif()
+
+# Determine float ABI of JVM on ARM Linux
+if (CMAKE_SYSTEM_PROCESSOR MATCHES "^arm" AND CMAKE_SYSTEM_NAME STREQUAL
"Linux")
+find_program(READELF readelf)
+if (READELF MATCHES "NOTFOUND")
+message(WARNING "readelf not found; JVM float ABI detection disabled")
+else (READELF MATCHES "NOTFOUND")
+message(STATUS "Checking float ABI of ${JAVA_JVM_LIBRARY}")
+execute_process(
+COMMAND ${READELF} -A ${JAVA_JVM_LIBRARY}
+OUTPUT_VARIABLE JVM_ELF_ARCH
+ERROR_QUIET)
+if (JVM_ELF_ARCH MATCHES "Tag_ABI_VFP_args: VFP registers")
+ message(STATUS "Hard-float JVM detected")
+else ()
+message(STATUS "Soft-float JVM detected")
+
+# Test compilation with -mfloat-abi=softfp using an arbitrary libc
function
+# (typically fails with "fatal error: bits/predefs.h: No such file
or directory"
+# if soft-float dev libraries are not installed)
+include(CMakePushCheckState)
+cmake_push_check_state()
+set(CMAKE_REQUIRED_FLAGS "${CMAKE_REQUIRED_FLAGS}
-mfloat-abi=softfp")
+include(CheckSymbolExists)
+check_symbol_exists(exit stdlib.h SOFTFP_AVAILABLE)
+if (NOT SOFTFP_AVAILABLE)
+message(FATAL_ERROR "Soft-float dev libraries required (e.g.
'apt-get install libc6-dev-armel' on Debian/Ubuntu)")
+endif (NOT SOFTFP_AVAILABLE)
+cmake_pop_check_state()
+
+set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfloat-abi=softfp")
+endif ()
+endif (READELF MATCHES "NOTFOUND")
+endif (CMAKE_SYSTEM_PROCESSOR MATCHES "^arm" AND CMAKE_SYSTEM_NAME STREQUAL
"Linux")
+
{code}
> Hadoop native build failure on ARM hard-float
> -
>
> Key: HADOOP-9320
> URL: https://issues.apache.org/jira/browse/HADOOP-9320
> Project: Hadoop Common
> Issue Type: Bug
> Components: native
>Affects Versions: 2.0.3-alpha
> Environment: $ uname -a
> Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
> armv7l armv7l GNU/Linux
> $ java -version
> java
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[ https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021406#comment-15021406 ] Haohui Mai commented on HADOOP-9320: Hi [~scurrilous], can you please rebase the patch? Thanks. > Hadoop native build failure on ARM hard-float > - > > Key: HADOOP-9320 > URL: https://issues.apache.org/jira/browse/HADOOP-9320 > Project: Hadoop Common > Issue Type: Bug > Components: native >Affects Versions: 2.0.3-alpha > Environment: $ uname -a > Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l > armv7l armv7l GNU/Linux > $ java -version > java version "1.8.0-ea" > Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e) > Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode) >Reporter: Trevor Robinson >Assignee: Trevor Robinson > Labels: BB2015-05-TBR, build-failure > Attachments: HADOOP-9320.patch > > > ARM JVM float ABI detection is failing in JNIFlags.cmake because > JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake > to assume a soft-float JVM. This causes the build to fail with hard-float > OpenJDK (but don't use that) and [Oracle Java 8 Preview for > ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle > Java 7 will support hard-float as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[ https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021434#comment-15021434 ] Trevor Robinson commented on HADOOP-9320: - I no longer have the ability to test this patch, as I have no access to an ARM Linux environment. I don't really work on Hadoop anymore either, for that matter, so I'm not sure of the status of this issue. > Hadoop native build failure on ARM hard-float > - > > Key: HADOOP-9320 > URL: https://issues.apache.org/jira/browse/HADOOP-9320 > Project: Hadoop Common > Issue Type: Bug > Components: native >Affects Versions: 2.0.3-alpha > Environment: $ uname -a > Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l > armv7l armv7l GNU/Linux > $ java -version > java version "1.8.0-ea" > Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e) > Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode) >Reporter: Trevor Robinson >Assignee: Trevor Robinson > Labels: BB2015-05-TBR, build-failure > Attachments: HADOOP-9320.patch > > > ARM JVM float ABI detection is failing in JNIFlags.cmake because > JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake > to assume a soft-float JVM. This causes the build to fail with hard-float > OpenJDK (but don't use that) and [Oracle Java 8 Preview for > ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle > Java 7 will support hard-float as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525413#comment-14525413
]
Hadoop QA commented on HADOOP-9320:
---
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 5m 11s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 28s | There were no new javac warning
messages. |
| {color:green}+1{color} | release audit | 0m 19s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 30s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | common tests | 22m 34s | Tests passed in
hadoop-common. |
| | | 37m 39s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12570212/HADOOP-9320.patch |
| Optional Tests | javac unit |
| git revision | trunk / 6ae2a0d |
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6409/artifact/patchprocess/testrun_hadoop-common.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6409/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6409/console |
This message was automatically generated.
Hadoop native build failure on ARM hard-float
-
Key: HADOOP-9320
URL: https://issues.apache.org/jira/browse/HADOOP-9320
Project: Hadoop Common
Issue Type: Bug
Components: native
Affects Versions: 2.0.3-alpha
Environment: $ uname -a
Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
armv7l armv7l GNU/Linux
$ java -version
java version 1.8.0-ea
Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
Reporter: Trevor Robinson
Assignee: Trevor Robinson
Labels: build-failure
Attachments: HADOOP-9320.patch
ARM JVM float ABI detection is failing in JNIFlags.cmake because
JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
to assume a soft-float JVM. This causes the build to fail with hard-float
OpenJDK (but don't use that) and [Oracle Java 8 Preview for
ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
Java 7 will support hard-float as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[ https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843661#comment-13843661 ] Trevor Robinson commented on HADOOP-9320: - Could someone please commit this patch? The build is broken for ARM hard-float systems, which are now the default. (Oracle 7u40 supports armhf.) This fix trivially reorders two chunks of JNIFlags.cmake so that JAVA_JVM_LIBRARY is defined before it is used, and it has no effect on other platforms. Thanks. Hadoop native build failure on ARM hard-float - Key: HADOOP-9320 URL: https://issues.apache.org/jira/browse/HADOOP-9320 Project: Hadoop Common Issue Type: Bug Components: native Affects Versions: 2.0.3-alpha Environment: $ uname -a Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l armv7l armv7l GNU/Linux $ java -version java version 1.8.0-ea Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e) Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode) Reporter: Trevor Robinson Assignee: Trevor Robinson Labels: build-failure Attachments: HADOOP-9320.patch ARM JVM float ABI detection is failing in JNIFlags.cmake because JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake to assume a soft-float JVM. This causes the build to fail with hard-float OpenJDK (but don't use that) and [Oracle Java 8 Preview for ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle Java 7 will support hard-float as well. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843736#comment-13843736
]
Hadoop QA commented on HADOOP-9320:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12570212/HADOOP-9320.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3349//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3349//console
This message is automatically generated.
Hadoop native build failure on ARM hard-float
-
Key: HADOOP-9320
URL: https://issues.apache.org/jira/browse/HADOOP-9320
Project: Hadoop Common
Issue Type: Bug
Components: native
Affects Versions: 2.0.3-alpha
Environment: $ uname -a
Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
armv7l armv7l GNU/Linux
$ java -version
java version 1.8.0-ea
Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
Reporter: Trevor Robinson
Assignee: Trevor Robinson
Labels: build-failure
Attachments: HADOOP-9320.patch
ARM JVM float ABI detection is failing in JNIFlags.cmake because
JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
to assume a soft-float JVM. This causes the build to fail with hard-float
OpenJDK (but don't use that) and [Oracle Java 8 Preview for
ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
Java 7 will support hard-float as well.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
[jira] [Commented] (HADOOP-9320) Hadoop native build failure on ARM hard-float
[
https://issues.apache.org/jira/browse/HADOOP-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13582739#comment-13582739
]
Hadoop QA commented on HADOOP-9320:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12570212/HADOOP-9320.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/2216//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/2216//console
This message is automatically generated.
Hadoop native build failure on ARM hard-float
-
Key: HADOOP-9320
URL: https://issues.apache.org/jira/browse/HADOOP-9320
Project: Hadoop Common
Issue Type: Bug
Components: native
Affects Versions: 2.0.3-alpha
Environment: $ uname -a
Linux 3.5.0-1000-highbank #154-Ubuntu SMP Thu Jan 10 09:13:40 UTC 2013 armv7l
armv7l armv7l GNU/Linux
$ java -version
java version 1.8.0-ea
Java(TM) SE Runtime Environment (build 1.8.0-ea-b36e)
Java HotSpot(TM) Client VM (build 25.0-b04, mixed mode)
Reporter: Trevor Robinson
Assignee: Trevor Robinson
Attachments: HADOOP-9320.patch
ARM JVM float ABI detection is failing in JNIFlags.cmake because
JAVA_JVM_LIBRARY is not set at that point. The failure currently causes CMake
to assume a soft-float JVM. This causes the build to fail with hard-float
OpenJDK (but don't use that) and [Oracle Java 8 Preview for
ARM|http://jdk8.java.net/fxarmpreview/]. Hopefully the April update of Oracle
Java 7 will support hard-float as well.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
