[
https://issues.apache.org/jira/browse/SPARK-29282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940191#comment-16940191
]
Dongjoon Hyun commented on SPARK-29282:
---------------------------------------
If JDK11 is really slower than JDK8 and there is no workaround in terms of
configuration, we need to mark this and SPARK-29173 as known issues and
document it.
> Investigate the performance regression in `core` module on JDK11 benchmark
> --------------------------------------------------------------------------
>
> Key: SPARK-29282
> URL: https://issues.apache.org/jira/browse/SPARK-29282
> Project: Spark
> Issue Type: Sub-task
> Components: Tests
> Affects Versions: 3.0.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
> JDK11 versions are slower than JDK8.
> {code}
> #!/bin/bash
> git clean -fdx
> export
> JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk8u222-b10/Contents/Home
> SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain
> org.apache.spark.serializer.KryoSerializerBenchmark"
> cp core/benchmarks/KryoSerializerBenchmark-results.txt
> ~/KryoSerializerBenchmark-jdk8-results.txt
> git clean -fdx
> export
> JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.2+9/Contents/Home
> SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain
> org.apache.spark.serializer.KryoSerializerBenchmark"
> cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt
> ~/KryoSerializerBenchmark-jdk11.0.2-results.txt
> git clean -fdx
> export
> JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.3+7/Contents/Home
> SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain
> org.apache.spark.serializer.KryoSerializerBenchmark"
> cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt
> ~/KryoSerializerBenchmark-jdk11.0.3-results.txt
> git clean -fdx
> export
> JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.4+11/Contents/Home
> SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain
> org.apache.spark.serializer.KryoSerializerBenchmark"
> cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt
> ~/KryoSerializerBenchmark-jdk11.0.4-results.txt
> {code}
> {code}
> ================================================================================================
> Benchmark KryoPool vs old"pool of 1" implementation
> ================================================================================================
> OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Mac OS X 10.14.6
> Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
> Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg
> Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> KryoPool:true 2015 2647
> 710 0.0 4029936.9 1.0X
> KryoPool:false 3526 4230
> 639 0.0 7052045.1 0.6X
> ================================================================================================
> Benchmark KryoPool vs old"pool of 1" implementation
> ================================================================================================
> OpenJDK 64-Bit Server VM 11.0.2+9 on Mac OS X 10.14.6
> Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
> Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg
> Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> KryoPool:true 2694 3402
> 955 0.0 5387690.7 1.0X
> KryoPool:false 4050 4927
> 761 0.0 8099091.3 0.7X
> ================================================================================================
> Benchmark KryoPool vs old"pool of 1" implementation
> ================================================================================================
> OpenJDK 64-Bit Server VM 11.0.3+7 on Mac OS X 10.14.6
> Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
> Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg
> Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> KryoPool:true 2638 3482
> NaN 0.0 5275226.1 1.0X
> KryoPool:false 4165 4954
> 763 0.0 8329580.9 0.6X
> ================================================================================================
> Benchmark KryoPool vs old"pool of 1" implementation
> ================================================================================================
> OpenJDK 64-Bit Server VM 11.0.4+11 on Mac OS X 10.14.6
> Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
> Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg
> Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> KryoPool:true 2613 3523
> NaN 0.0 5225510.3 1.0X
> KryoPool:false 4037 4989
> 927 0.0 8074904.6 0.6X
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
