[
https://issues.apache.org/jira/browse/TEZ-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960211#comment-14960211
]
Karam Singh edited comment on TEZ-2849 at 10/16/15 5:49 AM:
------------------------------------------------------------
Ran terasort on small scale cluster against OracleJDK8 and OpenJDK8, Did not
faced any problems with that.
OracleJDK8 version (cluster was by default running with version):
Used Teragen to ran generate 2G of data
The ran terasort on it
/usr/jdk64/jdk1.8.0_45/bin/java -version
java version "1.8.0_45"
Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)
THEN
ran default JAVA_HOME and JDK_HOME in hadoop-env.sh to OpenJDK8:
/usr/lib/jvm/java-1.8.0-openjdk
ran reran terasort again.
Also user tergen to generate 6G of data again ran terasort on it successfully.
OpenJDK8 version is:
openjdk version "1.8.0_60"
OpenJDK Runtime Environment (build 1.8.0_60-b27)
OpenJDK 64-Bit Server VM (build 25.60-b23, mixed mode)
While changing to OpenJDK8: I restarted all Hadoop daemons.sh to OpenJDK8 and
verified containers ran with OpenJDK8 version by checking launch-container.sh
of containers
Will check agains JDK7 version today.
was (Author: karams):
Ran terasort on small scale cluster against OracleJDK8 and OpenJDK8, Did not
faced any problems with that.
OracleJDK8 version (cluster was by defualt running with version):
Used Teragen to ran genetar 2G of data
The ran terasort on it
/usr/jdk64/jdk1.8.0_45/bin/java -version
java version "1.8.0_45"
Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)
THEN
ran default JAVA_HOME and JDK_HOME in hadoop-env.sh to OpenJDK8:
/usr/lib/jvm/java-1.8.0-openjdk
ran reran terasort again.
Also user tergen to generate 6G of data again ran terasort on it successfully.
OpenJDK8 version is:
openjdk version "1.8.0_60"
OpenJDK Runtime Environment (build 1.8.0_60-b27)
OpenJDK 64-Bit Server VM (build 25.60-b23, mixed mode)
While changing to OpenJDK8: I restarted all Hadoop daemons.sh to OpenJDK8 and
verified containers ran with OpenJDK8 version by checking launch-container.sh
of contaiers
Will check agains JDK7 version today.
> Implement Specific Workaround for JDK-8026049 & JDK-8073093
> ------------------------------------------------------------
>
> Key: TEZ-2849
> URL: https://issues.apache.org/jira/browse/TEZ-2849
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.8.1-alpha
> Reporter: Gopal V
> Assignee: Gopal V
> Attachments: TEZ-2849.1.patch, TEZ-2849.2.patch
>
>
> The CPU performance overhead of the sort operation is tied to the JIT
> handling of the aliased byte buffers without an explicit alignment (i.e a
> byte[] buffer referenced as an IntBuffer).
> https://bugs.openjdk.java.net/browse/JDK-8026049
> +
> https://bugs.openjdk.java.net/browse/JDK-8073093
> Workaround that JIT limitation while keeping in mind the modern CPU
> micro-code optimizations around alignment.
> http://lemire.me/blog/archives/2012/05/31/data-alignment-for-speed-myth-or-reality/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
