MaxGekk commented on a change in pull request #26003: [SPARK-29320][TESTS]
Compare `sql/core` module in JDK8/11 (Part 1)
URL: https://github.com/apache/spark/pull/26003#discussion_r330918526
##########
File path: sql/core/benchmarks/UDFBenchmark-results.txt
##########
@@ -2,58 +2,58 @@
UDF with mixed input types
================================================================================================
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to string: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int/string to string wholestage off 194
248 76 0,5 1941,4 1,0X
-long/nullable int/string to string wholestage on 127 136
8 0,8 1269,5 1,5X
+long/nullable int/string to string wholestage off 242
308 94 0.4 2416.5 1.0X
+long/nullable int/string to string wholestage on 141 179
25 0.7 1410.3 1.7X
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to option: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int/string to option wholestage off 91
97 8 1,1 910,1 1,0X
-long/nullable int/string to option wholestage on 60 79
29 1,7 603,8 1,5X
+long/nullable int/string to option wholestage off 91
97 9 1.1 908.1 1.0X
+long/nullable int/string to option wholestage on 77 91
12 1.3 774.4 1.2X
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int/string to primitive: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int/string to primitive wholestage off 55
63 12 1,8 547,9 1,0X
-long/nullable int/string to primitive wholestage on 43
44 2 2,3 428,0 1,3X
+long/nullable int/string to primitive wholestage off 68
75 9 1.5 684.7 1.0X
+long/nullable int/string to primitive wholestage on 62
64 3 1.6 619.8 1.1X
================================================================================================
UDF with primitive types
================================================================================================
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to string: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int to string wholestage off 46 48
2 2,2 461,2 1,0X
-long/nullable int to string wholestage on 49 56
8 2,0 488,9 0,9X
+long/nullable int to string wholestage off 67 68
0 1.5 672.2 1.0X
+long/nullable int to string wholestage on 66 72
11 1.5 660.5 1.0X
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to option: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int to option wholestage off 41 47
9 2,4 408,2 1,0X
-long/nullable int to option wholestage on 26 28
2 3,9 256,7 1,6X
+long/nullable int to option wholestage off 53 57
5 1.9 528.1 1.0X
+long/nullable int to option wholestage on 41 44
4 2.4 410.2 1.3X
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
long/nullable int to primitive: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-long/nullable int to primitive wholestage off 26 27
0 3,8 263,7 1,0X
-long/nullable int to primitive wholestage on 26 31
5 3,8 262,2 1,0X
+long/nullable int to primitive wholestage off 46 48
4 2.2 459.1 1.0X
+long/nullable int to primitive wholestage on 40 40
0 2.5 398.0 1.2X
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Mac OS X 10.13.6
-Intel(R) Core(TM) i7-4558U CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
+Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
UDF identity overhead: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Baseline 20 22
1 4,9 204,3 1,0X
-With identity UDF 24 26
2 4,1 241,3 0,8X
+Baseline 53 58
4 1.9 525.6 1.0X
+With identity UDF 38 38
0 2.7 376.3 1.4X
Review comment:
Was faster but now it is slower than baseline.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
