This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9c41bfd [SPARK-27502][SQL][TEST] Update nested schema benchmark
result for Orc V2
9c41bfd is described below
commit 9c41bfd83cddf7bf6314378ca7c3acf2c44e7a9b
Author: Liang-Chi Hsieh <[email protected]>
AuthorDate: Thu Apr 18 08:08:22 2019 -0700
[SPARK-27502][SQL][TEST] Update nested schema benchmark result for Orc V2
## What changes were proposed in this pull request?
We added nested schema pruning support to Orc V2 recently. The benchmark
result should be updated. The benchmark numbers are obtained by running
benchmark on r3.xlarge machine.
## How was this patch tested?
Test only change.
Closes #24399 from viirya/update-orcv2-benchmark.
Authored-by: Liang-Chi Hsieh <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../OrcV2NestedSchemaPruningBenchmark-results.txt | 36 +++++++++++-----------
1 file changed, 18 insertions(+), 18 deletions(-)
diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
index f259e14..1bb8a68 100644
--- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
+++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt
@@ -2,46 +2,46 @@
Nested Schema Pruning Benchmark For ORC v2
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Selection: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 135 169
19 7.4 134.7 1.0X
-Nested column 2131 2216
95 0.5 2131.4 0.1X
+Top-level column 117 144
21 8.5 117.0 1.0X
+Nested column 1114 1138
23 0.9 1114.2 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Limiting: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 147 158
10 6.8 146.9 1.0X
-Nested column 2149 2204
50 0.5 2148.9 0.1X
+Top-level column 134 154
17 7.5 134.0 1.0X
+Nested column 1156 1220
51 0.9 1156.2 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 386 399
16 2.6 385.8 1.0X
-Nested column 2612 2666
57 0.4 2612.2 0.1X
+Top-level column 350 359
6 2.9 350.5 1.0X
+Nested column 1426 1443
13 0.7 1426.5 0.2X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 392 454
119 2.5 392.2 1.0X
-Nested column 4106 4168
79 0.2 4106.1 0.1X
+Top-level column 357 363
5 2.8 356.9 1.0X
+Nested column 4186 4245
71 0.2 4186.3 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sample: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 146 157
13 6.9 145.9 1.0X
-Nested column 2294 2338
44 0.4 2293.6 0.1X
+Top-level column 115 134
13 8.7 114.6 1.0X
+Nested column 1148 1199
59 0.9 1148.3 0.1X
-OpenJDK 64-Bit Server VM 1.8.0_201-b09 on Linux 3.10.0-862.3.2.el7.x86_64
+OpenJDK 64-Bit Server VM 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12 on Linux
4.15.0-1021-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Sorting: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Top-level column 290 294
4 3.5 289.7 1.0X
-Nested column 2914 2997
87 0.3 2913.6 0.1X
+Top-level column 274 279
3 3.6 274.1 1.0X
+Nested column 3133 3254
145 0.3 3132.7 0.1X
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
