dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776130803
##########
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##########
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
+OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Parsing quoted values: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-One quoted string 43757 44446
765 0.0 875148.4 1.0X
+One quoted string 51747 52432
599 0.0 1034931.8 1.0X
-OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
+OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Wide rows with 1000 columns: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Select 1000 columns 96330 99161
NaN 0.0 96329.7 1.0X
-Select 100 columns 41414 42672
1556 0.0 41414.1 2.3X
-Select one column 35365 36113
662 0.0 35365.4 2.7X
-count() 18845 18867
26 0.1 18845.0 5.1X
-Select 100 columns, one bad input field 68271 68305
51 0.0 68270.7 1.4X
-Select 100 columns, corrupt record field 77700 78165
803 0.0 77699.7 1.2X
+Select 1000 columns 118598 119530
1380 0.0 118598.1 1.0X
+Select 100 columns 41421 41669
221 0.0 41420.9 2.9X
+Select one column 34304 34521
325 0.0 34304.3 3.5X
+count() 10934 11080
128 0.1 10934.5 10.8X
Review comment:
This looks improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
