andygrove commented on PR #3077:
URL:
https://github.com/apache/datafusion-comet/pull/3077#issuecomment-3750671628
```
Running benchmark: hash_boolean
Running case: Spark
Stopped after 75 iterations, 2024 ms
Running case: Comet (Scan)
Stopped after 62 iterations, 2006 ms
Running case: Comet (Scan + Exec)
Stopped after 54 iterations, 2005 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_boolean: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 25 27
1 41.2 24.3 1.0X
Comet (Scan) 31 32
1 34.2 29.3 0.8X
Comet (Scan + Exec) 35 37
3 30.0 33.3 0.7X
Running benchmark: hash_byte
Running case: Spark
Stopped after 74 iterations, 2012 ms
Running case: Comet (Scan)
Stopped after 71 iterations, 2006 ms
Running case: Comet (Scan + Exec)
Stopped after 68 iterations, 2019 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_byte: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 26 27
1 40.5 24.7 1.0X
Comet (Scan) 26 28
2 39.9 25.0 1.0X
Comet (Scan + Exec) 28 30
1 37.5 26.7 0.9X
Running benchmark: hash_short
Running case: Spark
Stopped after 75 iterations, 2018 ms
Running case: Comet (Scan)
Stopped after 74 iterations, 2026 ms
Running case: Comet (Scan + Exec)
Stopped after 67 iterations, 2005 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_short: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 25 27
1 41.5 24.1 1.0X
Comet (Scan) 26 27
1 40.3 24.8 1.0X
Comet (Scan + Exec) 28 30
1 36.8 27.2 0.9X
Running benchmark: hash_int
Running case: Spark
Stopped after 74 iterations, 2003 ms
Running case: Comet (Scan)
Stopped after 71 iterations, 2023 ms
Running case: Comet (Scan + Exec)
Stopped after 66 iterations, 2002 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_int: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 26 27
2 40.9 24.5 1.0X
Comet (Scan) 27 28
1 39.1 25.6 1.0X
Comet (Scan + Exec) 28 30
5 37.0 27.0 0.9X
Running benchmark: hash_long
Running case: Spark
Stopped after 68 iterations, 2025 ms
Running case: Comet (Scan)
Stopped after 67 iterations, 2000 ms
Running case: Comet (Scan + Exec)
Stopped after 64 iterations, 2019 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_long: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 29 30
1 36.7 27.2 1.0X
Comet (Scan) 28 30
1 36.9 27.1 1.0X
Comet (Scan + Exec) 30 32
1 34.6 28.9 0.9X
Running benchmark: hash_float
Running case: Spark
Stopped after 78 iterations, 2020 ms
Running case: Comet (Scan)
Stopped after 73 iterations, 2025 ms
Running case: Comet (Scan + Exec)
Stopped after 67 iterations, 2008 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_float: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 25 26
1 42.2 23.7 1.0X
Comet (Scan) 26 28
1 39.7 25.2 0.9X
Comet (Scan + Exec) 28 30
1 37.1 27.0 0.9X
Running benchmark: hash_double
Running case: Spark
Stopped after 68 iterations, 2019 ms
Running case: Comet (Scan)
Stopped after 67 iterations, 2004 ms
Running case: Comet (Scan + Exec)
Stopped after 64 iterations, 2005 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_double: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 28 30
3 37.9 26.4 1.0X
Comet (Scan) 28 30
1 36.9 27.1 1.0X
Comet (Scan + Exec) 30 31
1 35.5 28.2 0.9X
Running benchmark: hash_string
Running case: Spark
Stopped after 25 iterations, 2067 ms
Running case: Comet (Scan)
Stopped after 31 iterations, 2055 ms
Running case: Comet (Scan + Exec)
Stopped after 32 iterations, 2020 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_string: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 79 83
4 13.3 75.1 1.0X
Comet (Scan) 64 66
2 16.3 61.3 1.2X
Comet (Scan + Exec) 60 63
2 17.4 57.5 1.3X
Running benchmark: hash_binary
Running case: Spark
Stopped after 24 iterations, 2071 ms
Running case: Comet (Scan)
Stopped after 27 iterations, 2010 ms
Running case: Comet (Scan + Exec)
Stopped after 32 iterations, 2019 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_binary: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 83 86
1 12.6 79.4 1.0X
Comet (Scan) 72 74
1 14.5 69.0 1.2X
Comet (Scan + Exec) 60 63
2 17.4 57.5 1.4X
Running benchmark: hash_date
Running case: Spark
Stopped after 73 iterations, 2003 ms
Running case: Comet (Scan)
Stopped after 75 iterations, 2017 ms
Running case: Comet (Scan + Exec)
Stopped after 70 iterations, 2019 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_date: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 26 27
1 40.7 24.6 1.0X
Comet (Scan) 26 27
1 41.0 24.4 1.0X
Comet (Scan + Exec) 28 29
1 38.1 26.3 0.9X
Running benchmark: hash_decimal
Running case: Spark
Stopped after 99 iterations, 2014 ms
Running case: Comet (Scan)
Stopped after 86 iterations, 2018 ms
Running case: Comet (Scan + Exec)
Stopped after 75 iterations, 2002 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_decimal: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 19 20
1 54.9 18.2 1.0X
Comet (Scan) 22 23
1 47.9 20.9 0.9X
Comet (Scan + Exec) 25 27
2 42.0 23.8 0.8X
Running benchmark: hash_array_int
Running case: Spark
Stopped after 34 iterations, 2003 ms
Running case: Comet (Scan)
Stopped after 37 iterations, 2045 ms
Running case: Comet (Scan + Exec)
Stopped after 13 iterations, 2080 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_array_int: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 57 59
1 18.5 54.0 1.0X
Comet (Scan) 54 55
1 19.5 51.2 1.1X
Comet (Scan + Exec) 153 160
7 6.9 145.6 0.4X
Running benchmark: hash_array_string
Running case: Spark
Stopped after 15 iterations, 2128 ms
Running case: Comet (Scan)
Stopped after 18 iterations, 2084 ms
Running case: Comet (Scan + Exec)
Stopped after 11 iterations, 2008 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_array_string: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 133 142
13 7.9 127.3 1.0X
Comet (Scan) 108 116
10 9.7 103.1 1.2X
Comet (Scan + Exec) 177 183
3 5.9 169.0 0.8X
Running benchmark: hash_array_double
Running case: Spark
Stopped after 35 iterations, 2052 ms
Running case: Comet (Scan)
Stopped after 37 iterations, 2049 ms
Running case: Comet (Scan + Exec)
Stopped after 17 iterations, 2111 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_array_double: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 57 59
1 18.5 54.1 1.0X
Comet (Scan) 52 55
2 20.1 49.9 1.1X
Comet (Scan + Exec) 116 124
8 9.0 110.6 0.5X
Running benchmark: hash_struct
Running case: Spark
Stopped after 22 iterations, 2083 ms
Running case: Comet (Scan)
Stopped after 23 iterations, 2012 ms
Running case: Comet (Scan + Exec)
Stopped after 28 iterations, 2058 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_struct: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 87 95
9 12.0 83.4 1.0X
Comet (Scan) 82 87
8 12.9 77.8 1.1X
Comet (Scan + Exec) 70 74
2 14.9 67.2 1.2X
Running benchmark: hash_struct_multi_fields
Running case: Spark
Stopped after 47 iterations, 2026 ms
Running case: Comet (Scan)
Stopped after 33 iterations, 2047 ms
Running case: Comet (Scan + Exec)
Stopped after 37 iterations, 2005 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_struct_multi_fields: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 42 43
2 25.3 39.6 1.0X
Comet (Scan) 60 62
2 17.6 56.8 0.7X
Comet (Scan + Exec) 52 54
2 20.1 49.6 0.8X
Running benchmark: hash_nested_array
Running case: Spark
Stopped after 26 iterations, 2052 ms
Running case: Comet (Scan)
Stopped after 28 iterations, 2069 ms
Running case: Comet (Scan + Exec)
Stopped after 9 iterations, 2202 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_nested_array: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 77 79
1 13.6 73.4 1.0X
Comet (Scan) 70 74
2 14.9 67.0 1.1X
Comet (Scan + Exec) 238 245
4 4.4 227.3 0.3X
Running benchmark: hash_nested_struct
Running case: Spark
Stopped after 19 iterations, 2087 ms
Running case: Comet (Scan)
Stopped after 20 iterations, 2099 ms
Running case: Comet (Scan + Exec)
Stopped after 25 iterations, 2053 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_nested_struct: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 107 110
2 9.8 102.4 1.0X
Comet (Scan) 101 105
3 10.4 96.6 1.1X
Comet (Scan + Exec) 79 82
3 13.3 75.1 1.4X
Running benchmark: hash_struct_with_array
Running case: Spark
Stopped after 13 iterations, 2083 ms
Running case: Comet (Scan)
Stopped after 16 iterations, 2104 ms
Running case: Comet (Scan + Exec)
Stopped after 11 iterations, 2066 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_struct_with_array: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 157 160
5 6.7 149.6 1.0X
Comet (Scan) 124 132
10 8.4 118.6 1.3X
Comet (Scan + Exec) 183 188
3 5.7 174.7 0.9X
Running benchmark: hash_array_of_struct
Running case: Spark
Stopped after 11 iterations, 2024 ms
Running case: Comet (Scan)
Stopped after 14 iterations, 2045 ms
Running case: Comet (Scan + Exec)
Stopped after 6 iterations, 2199 ms
OpenJDK 64-Bit Server VM 17.0.17+10-Ubuntu-122.04 on Linux 6.8.0-90-generic
AMD Ryzen 9 7950X3D 16-Core Processor
hash_array_of_struct: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 180 184
6 5.8 171.2 1.0X
Comet (Scan) 141 146
5 7.4 134.8 1.3X
Comet (Scan + Exec) 358 367
10 2.9 341.3 0.5X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
