This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 4a09e74 [SPARK-37143][TESTS] Supplement the missing Java 11 benchmark
result files
4a09e74 is described below
commit 4a09e74f1d6c46f3ca5150e1b4eaff13a9034ab1
Author: yangjie01 <[email protected]>
AuthorDate: Thu Oct 28 11:08:43 2021 -0700
[SPARK-37143][TESTS] Supplement the missing Java 11 benchmark result files
### What changes were proposed in this pull request?
`CharVarcharBenchmark-results.txt`and `UpdateFieldsBenchmark-results.txt`
exist in the project, but `CharVarcharBenchmark-jdk11-results.txt` and
`UpdateFieldsBenchmark-jdk11-results.txt `are missing, so this pr added them.
### Why are the changes needed?
Supplement the missing Java 11 benchmark result files.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
The 2 file was generated from:
- [Run benchmarks: * (JDK
11)](https://github.com/LuciferYang/spark/actions/runs/1392788240)
Closes #34423 from LuciferYang/bench-jdk11.
Authored-by: yangjie01 <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../CharVarcharBenchmark-jdk11-results.txt | 122 +++++++++++++++++++++
.../UpdateFieldsBenchmark-jdk11-results.txt | 26 +++++
2 files changed, 148 insertions(+)
diff --git a/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt
b/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt
new file mode 100644
index 0000000..25740d0
--- /dev/null
+++ b/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt
@@ -0,0 +1,122 @@
+================================================================================================
+Char Varchar Write Side Perf w/o Tailing Spaces
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 5: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 5 11587 11682
133 3.5 289.7 1.0X
+write char with length 5 15479 15566
103 2.6 387.0 0.7X
+write varchar with length 5 12057 12165
122 3.3 301.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 10: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 10 5660 5698
56 3.5 283.0 1.0X
+write char with length 10 9484 9542
60 2.1 474.2 0.6X
+write varchar with length 10 5908 5928
26 3.4 295.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 20: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 20 2968 2981
21 3.4 296.8 1.0X
+write char with length 20 6647 6672
22 1.5 664.7 0.4X
+write varchar with length 20 3064 3070
6 3.3 306.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 40: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 40 1508 1538
31 3.3 301.7 1.0X
+write char with length 40 5218 5233
13 1.0 1043.6 0.3X
+write varchar with length 40 1603 1609
6 3.1 320.7 0.9X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 60: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 60 1066 1097
53 3.1 319.7 1.0X
+write char with length 60 4643 4648
7 0.7 1392.9 0.2X
+write varchar with length 60 1097 1115
26 3.0 329.1 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 80: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 80 824 840
14 3.0 329.5 1.0X
+write char with length 80 4520 4539
27 0.6 1807.8 0.2X
+write varchar with length 80 852 861
11 2.9 340.9 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 100 678 692
19 2.9 339.1 1.0X
+write char with length 100 4384 4390
6 0.5 2191.8 0.2X
+write varchar with length 100 711 716
8 2.8 355.3 1.0X
+
+
+================================================================================================
+Char Varchar Write Side Perf w/ Tailing Spaces
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 5: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 5 18526 18553
32 2.2 463.2 1.0X
+write char with length 5 20668 20674
6 1.9 516.7 0.9X
+write varchar with length 5 20642 20742
169 1.9 516.0 0.9X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 10: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 10 10490 10522
45 1.9 524.5 1.0X
+write char with length 10 12474 12522
59 1.6 623.7 0.8X
+write varchar with length 10 12522 12578
49 1.6 626.1 0.8X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 20: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 20 7087 7089
2 1.4 708.7 1.0X
+write char with length 20 8936 8952
16 1.1 893.6 0.8X
+write varchar with length 20 8985 8988
6 1.1 898.5 0.8X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 40: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 40 5220 5222
4 1.0 1043.9 1.0X
+write char with length 40 7021 7025
4 0.7 1404.2 0.7X
+write varchar with length 40 7025 7027
2 0.7 1405.0 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 60: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 60 4504 4505
0 0.7 1351.3 1.0X
+write char with length 60 6446 6453
7 0.5 1933.7 0.7X
+write varchar with length 60 6315 6322
6 0.5 1894.6 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 80: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 80 4277 4279
2 0.6 1711.0 1.0X
+write char with length 80 6094 6103
9 0.4 2437.6 0.7X
+write varchar with length 80 6098 6099
2 0.4 2439.2 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 100: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 100 4070 4076
9 0.5 2035.1 1.0X
+write char with length 100 5975 5983
10 0.3 2987.7 0.7X
+write varchar with length 100 6034 6041
6 0.3 3017.1 0.7X
+
+
diff --git a/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt
b/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt
new file mode 100644
index 0000000..552f5c9
--- /dev/null
+++ b/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt
@@ -0,0 +1,26 @@
+================================================================================================
+Add 2 columns and drop 2 columns at 3 different depths of nesting
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+Add 2 columns and drop 2 columns at 3 different depths of nesting: Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+-------------------------------------------------------------------------------------------------------------------------------------------------
+To non-nullable StructTypes using performant method
3 5 2 0.0 Infinity 1.0X
+To nullable StructTypes using performant method
3 4 1 0.0 Infinity 1.2X
+To non-nullable StructTypes using non-performant method
56 61 4 0.0 Infinity 0.1X
+To nullable StructTypes using non-performant method
1158 1216 81 0.0 Infinity 0.0X
+
+
+================================================================================================
+Add 50 columns and drop 50 columns at 100 different depths of nesting
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+Add 50 columns and drop 50 columns at 100 different depths of nesting: Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+-----------------------------------------------------------------------------------------------------------------------------------------------------
+To non-nullable StructTypes using performant method
3617 3661 62 0.0 Infinity 1.0X
+To nullable StructTypes using performant method
3566 3606 57 0.0 Infinity 1.0X
+
+
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
