dongjoon-hyun commented on a change in pull request #29233:
URL: https://github.com/apache/spark/pull/29233#discussion_r460387124
##########
File path: core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt
##########
@@ -1,64 +1,64 @@
-OpenJDK 64-Bit Server VM 11.0.4+11-post-Ubuntu-1ubuntu218.04.3 on Linux
4.15.0-1044-aws
+OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux
4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
200000 MapOutputs, 10 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 170 178
9 1.2 849.7 1.0X
-Deserialization 530 535
9 0.4 2651.1 0.3X
+-------------------------------------------------------------------------------------------------------------------------
+Serialization 175 183
12 1.1 874.1 1.0X
+Deserialization 458 462
6 0.4 2288.6 0.4X
-Compressed Serialized MapStatus sizes: 411 bytes
+Compressed Serialized MapStatus sizes: 410 bytes
Compressed Serialized Broadcast MapStatus sizes: 2 MB
-OpenJDK 64-Bit Server VM 11.0.4+11-post-Ubuntu-1ubuntu218.04.3 on Linux
4.15.0-1044-aws
+OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux
4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
200000 MapOutputs, 10 blocks w/o broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 157 165
7 1.3 785.4 1.0X
-Deserialization 495 588
79 0.4 2476.7 0.3X
+--------------------------------------------------------------------------------------------------------------------------
+Serialization 160 171
8 1.2 801.1 1.0X
+Deserialization 453 484
38 0.4 2263.4 0.4X
Compressed Serialized MapStatus sizes: 2 MB
Compressed Serialized Broadcast MapStatus sizes: 0 bytes
-OpenJDK 64-Bit Server VM 11.0.4+11-post-Ubuntu-1ubuntu218.04.3 on Linux
4.15.0-1044-aws
+OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux
4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
200000 MapOutputs, 100 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 344 351
4 0.6 1720.4 1.0X
-Deserialization 527 579
99 0.4 2635.9 0.7X
+--------------------------------------------------------------------------------------------------------------------------
+Serialization 343 346
2 0.6 1717.1 1.0X
+Deserialization 492 540
59 0.4 2459.6 0.7X
-Compressed Serialized MapStatus sizes: 427 bytes
+Compressed Serialized MapStatus sizes: 426 bytes
Compressed Serialized Broadcast MapStatus sizes: 13 MB
-OpenJDK 64-Bit Server VM 11.0.4+11-post-Ubuntu-1ubuntu218.04.3 on Linux
4.15.0-1044-aws
+OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux
4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
200000 MapOutputs, 100 blocks w/o broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 317 321
4 0.6 1583.8 1.0X
-Deserialization 530 540
15 0.4 2648.3 0.6X
+---------------------------------------------------------------------------------------------------------------------------
+Serialization 297 299
2 0.7 1486.2 1.0X
+Deserialization 489 535
87 0.4 2446.5 0.6X
Compressed Serialized MapStatus sizes: 13 MB
Compressed Serialized Broadcast MapStatus sizes: 0 bytes
-OpenJDK 64-Bit Server VM 11.0.4+11-post-Ubuntu-1ubuntu218.04.3 on Linux
4.15.0-1044-aws
+OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux
4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
200000 MapOutputs, 1000 blocks w/ broadcast: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Serialization 1738 1849
156 0.1 8692.0 1.0X
-Deserialization 946 977
33 0.2 4730.2 1.8X
+---------------------------------------------------------------------------------------------------------------------------
+Serialization 1641 1819
252 0.1 8204.1 1.0X
+Deserialization 844 882
37 0.2 4219.7 1.9X
Review comment:
10% reduction.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
