dongjoon-hyun commented on code in PR #47743:
URL: https://github.com/apache/spark/pull/47743#discussion_r1715598070
##########
core/benchmarks/MapStatusesSerDeserBenchmark-jdk21-results.txt:
##########
@@ -1,64 +1,64 @@
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1025-azure
AMD EPYC 7763 64-Core Processor
200000 MapOutputs, 10 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 84 88
7 2.4 419.8 1.0X
-Deserialization 140 148
8 1.4 700.9 0.6X
+Serialization 81 85
4 2.5 406.5 1.0X
+Deserialization 147 155
9 1.4 734.2 0.6X
-Compressed Serialized MapStatus sizes: 427.0 B
+Compressed Serialized MapStatus sizes: 426.0 B
Compressed Serialized Broadcast MapStatus sizes: 2.5 MiB
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1025-azure
AMD EPYC 7763 64-Core Processor
200000 MapOutputs, 10 blocks w/o broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Serialization 80 81
2 2.5 400.1 1.0X
-Deserialization 139 146
6 1.4 694.8 0.6X
+Serialization 73 75
3 2.7 365.9 1.0X
+Deserialization 146 153
10 1.4 732.1 0.5X
Compressed Serialized MapStatus sizes: 2.5 MiB
Compressed Serialized Broadcast MapStatus sizes: 0.0 B
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1025-azure
AMD EPYC 7763 64-Core Processor
200000 MapOutputs, 100 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Serialization 153 158
11 1.3 767.3 1.0X
-Deserialization 159 165
5 1.3 794.1 1.0X
+Serialization 152 157
6 1.3 759.6 1.0X
+Deserialization 162 166
4 1.2 811.8 0.9X
Compressed Serialized MapStatus sizes: 442.0 B
Compressed Serialized Broadcast MapStatus sizes: 13.6 MiB
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1025-azure
AMD EPYC 7763 64-Core Processor
200000 MapOutputs, 100 blocks w/o broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
-Serialization 140 143
4 1.4 701.0 1.0X
-Deserialization 154 159
7 1.3 771.3 0.9X
+Serialization 141 142
1 1.4 703.4 1.0X
+Deserialization 161 165
5 1.2 807.0 0.9X
Compressed Serialized MapStatus sizes: 13.6 MiB
Compressed Serialized Broadcast MapStatus sizes: 0.0 B
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1025-azure
AMD EPYC 7763 64-Core Processor
200000 MapOutputs, 1000 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
-Serialization 707 726
21 0.3 3533.4 1.0X
-Deserialization 316 342
17 0.6 1582.2 2.2X
+Serialization 686 714
31 0.3 3431.6 1.0X
+Deserialization 329 346
18 0.6 1645.6 2.1X
-Compressed Serialized MapStatus sizes: 570.0 B
+Compressed Serialized MapStatus sizes: 569.0 B
Review Comment:
This is due the compression library change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]