dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534999660
##########
sql/core/benchmarks/FilterPushdownBenchmark-jdk21-results.txt:
##########
@@ -2,733 +2,733 @@
Pushdown for many distinct value case
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6598 6767
128 2.4 419.5 1.0X
-Parquet Vectorized (Pushdown) 292 304
14 53.8 18.6 22.6X
-Native ORC Vectorized 7341 7411
88 2.1 466.7 0.9X
-Native ORC Vectorized (Pushdown) 282 291
10 55.7 18.0 23.4X
+Parquet Vectorized 6365 6420
67 2.5 404.7 1.0X
+Parquet Vectorized (Pushdown) 315 341
24 49.9 20.0 20.2X
+Native ORC Vectorized 4984 5073
69 3.2 316.9 1.3X
+Native ORC Vectorized (Pushdown) 311 321
11 50.5 19.8 20.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg
Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6631
6653 20 2.4 421.6 1.0X
-Parquet Vectorized (Pushdown) 288
299 15 54.7 18.3 23.1X
-Native ORC Vectorized 7453
7468 19 2.1 473.8 0.9X
-Native ORC Vectorized (Pushdown) 280
287 9 56.2 17.8 23.7X
+Parquet Vectorized 6261
6292 25 2.5 398.1 1.0X
+Parquet Vectorized (Pushdown) 281
298 12 56.1 17.8 22.3X
+Native ORC Vectorized 5053
5078 22 3.1 321.3 1.2X
+Native ORC Vectorized (Pushdown) 300
328 35 52.4 19.1 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6635 6654
17 2.4 421.9 1.0X
-Parquet Vectorized (Pushdown) 271 282
9 58.1 17.2 24.5X
-Native ORC Vectorized 7482 7512
35 2.1 475.7 0.9X
-Native ORC Vectorized (Pushdown) 268 277
4 58.6 17.1 24.7X
+Parquet Vectorized 6294 6356
90 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 270 283
14 58.3 17.1 23.3X
+Native ORC Vectorized 5057 5086
20 3.1 321.5 1.2X
+Native ORC Vectorized (Pushdown) 289 298
8 54.4 18.4 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6622 6633
10 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 262 270
9 60.1 16.6 25.3X
-Native ORC Vectorized 7413 7429
15 2.1 471.3 0.9X
-Native ORC Vectorized (Pushdown) 261 268
6 60.3 16.6 25.4X
+Parquet Vectorized 6252 6274
17 2.5 397.5 1.0X
+Parquet Vectorized (Pushdown) 256 272
15 61.4 16.3 24.4X
+Native ORC Vectorized 5036 5054
12 3.1 320.2 1.2X
+Native ORC Vectorized (Pushdown) 275 291
8 57.1 17.5 22.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg
Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6597
6632 34 2.4 419.4 1.0X
-Parquet Vectorized (Pushdown) 260
268 7 60.5 16.5 25.4X
-Native ORC Vectorized 7453
7467 11 2.1 473.9 0.9X
-Native ORC Vectorized (Pushdown) 261
270 7 60.3 16.6 25.3X
+Parquet Vectorized 6241
6259 11 2.5 396.8 1.0X
+Parquet Vectorized (Pushdown) 257
266 12 61.3 16.3 24.3X
+Native ORC Vectorized 5038
5055 20 3.1 320.3 1.2X
+Native ORC Vectorized (Pushdown) 277
290 10 56.8 17.6 22.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12805 12872
92 1.2 814.1 1.0X
-Parquet Vectorized (Pushdown) 12833 12851
14 1.2 815.9 1.0X
-Native ORC Vectorized 13594 13615
16 1.2 864.3 0.9X
-Native ORC Vectorized (Pushdown) 13626 13637
11 1.2 866.3 0.9X
+Parquet Vectorized 12335 12564
207 1.3 784.2 1.0X
+Parquet Vectorized (Pushdown) 12561 12587
20 1.3 798.6 1.0X
+Native ORC Vectorized 11278 11295
12 1.4 717.0 1.1X
+Native ORC Vectorized (Pushdown) 11398 11468
98 1.4 724.7 1.1X
Review Comment:
Although the ratio is reversed slightly, the different is too small.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
