sqlbenchmark commented on PR #2997:
URL:
https://github.com/apache/datafusion-comet/pull/2997#issuecomment-3705910260
## Comet Microbenchmark Results: CometDatetimeExpressionBenchmark
**Commit:** `cddee7b` - feat: Improve performance of date truncate
### Benchmark Results
```
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - YEAR: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 37 40
1 28.0 35.7 1.0X
Comet (Scan) 39 42
2 26.7 37.4 1.0X
Comet (Scan + Exec) 39 41
1 26.9 37.2 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - YYYY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 37 38
1 28.0 35.7 1.0X
Comet (Scan) 37 38
1 28.7 34.8 1.0X
Comet (Scan + Exec) 35 37
1 30.4 32.9 1.1X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - YY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 36 37
1 28.8 34.7 1.0X
Comet (Scan) 37 38
2 28.7 34.9 1.0X
Comet (Scan + Exec) 37 38
1 28.7 34.9 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - MON: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 37 38
1 28.1 35.6 1.0X
Comet (Scan) 36 38
1 28.9 34.5 1.0X
Comet (Scan + Exec) 35 36
1 29.8 33.5 1.1X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - MONTH: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 35 37
1 29.9 33.5 1.0X
Comet (Scan) 36 37
1 29.1 34.4 1.0X
Comet (Scan + Exec) 35 36
1 30.1 33.2 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate - MM: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 35 37
1 29.6 33.8 1.0X
Comet (Scan) 35 37
2 29.8 33.6 1.0X
Comet (Scan + Exec) 34 35
1 30.9 32.4 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - YEAR: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 33 34
1 31.4 31.9 1.0X
Comet (Scan) 34 35
1 30.8 32.5 1.0X
Comet (Scan + Exec) 33 34
1 31.6 31.6 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - YYYY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 33 34
1 31.4 31.8 1.0X
Comet (Scan) 33 35
1 31.5 31.7 1.0X
Comet (Scan + Exec) 32 34
1 32.3 31.0 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - YY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 33 34
1 31.9 31.4 1.0X
Comet (Scan) 34 35
1 31.2 32.1 1.0X
Comet (Scan + Exec) 33 34
2 31.5 31.7 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - MON: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 34 35
1 30.5 32.8 1.0X
Comet (Scan) 35 36
1 30.1 33.2 1.0X
Comet (Scan + Exec) 33 35
1 31.3 31.9 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - MONTH: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 34 35
1 30.6 32.7 1.0X
Comet (Scan) 34 35
1 30.5 32.8 1.0X
Comet (Scan + Exec) 33 34
1 31.9 31.3 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Date Truncate (Dictionary) - MM: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 34 36
1 30.5 32.8 1.0X
Comet (Scan) 35 36
2 30.3 33.0 1.0X
Comet (Scan + Exec) 33 34
1 31.7 31.5 1.0X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - YEAR: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 104 106
1 10.0 99.6 1.0X
Comet (Scan) 102 103
1 10.3 96.9 1.0X
Comet (Scan + Exec) 323 325
1 3.2 308.2 0.3X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - YYYY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 103 105
1 10.2 98.3 1.0X
Comet (Scan) 101 102
1 10.4 96.5 1.0X
Comet (Scan + Exec) 332 334
2 3.2 316.9 0.3X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - YY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 107 108
1 9.8 101.9 1.0X
Comet (Scan) 104 105
1 10.1 99.3 1.0X
Comet (Scan + Exec) 331 332
1 3.2 315.9 0.3X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - MON: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 108 109
1 9.8 102.6 1.0X
Comet (Scan) 105 106
1 10.0 99.7 1.0X
Comet (Scan + Exec) 277 279
2 3.8 264.3 0.4X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - MONTH: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 107 108
1 9.8 102.5 1.0X
Comet (Scan) 105 106
1 10.0 100.0 1.0X
Comet (Scan + Exec) 277 278
1 3.8 263.8 0.4X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - MM: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 107 108
1 9.8 102.3 1.0X
Comet (Scan) 105 105
1 10.0 99.8 1.0X
Comet (Scan + Exec) 277 277
1 3.8 263.8 0.4X
OpenJDK 64-Bit Server VM 17.0.17+10 on Linux 6.8.0-57-generic
AMD Ryzen 9 7950X 16-Core Processor
Timestamp Truncate - DAY: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Spark 96 97
1 10.9 91.7 1.0X
Comet (Scan) 93 95
1 11.2 89.1 1.0X
... (truncated, 38 total benchmarks)
```
---
*Automated benchmark run by dfbench*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
