coderfender commented on PR #2925:
URL:
https://github.com/apache/datafusion-comet/pull/2925#issuecomment-3682866288
Benchmarks after adding further optimizations
```
================================================================================================
Running benchmark DecimalType(2,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(2,2) , ansi mode enabled : false:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(2,2) , ansi mode
enabled : false 106 130 14 9.4
106.3 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(2,2) , ansi mode
enabled : false 94 123 36 10.7
93.5 1.1X
================================================================================================
Running benchmark DecimalType(2,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(2,2) , ansi mode enabled : true:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(2,2) , ansi mode
enabled : true 88 109 18 11.3
88.3 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(2,2) , ansi mode
enabled : true 78 85 9 12.8
78.2 1.1X
================================================================================================
Running benchmark DecimalType(10,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(10,2) , ansi mode enabled : false:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(10,2) , ansi mode
enabled : false 102 132 22 9.8
101.7 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(10,2) , ansi mode
enabled : false 86 104 18 11.7
85.8 1.2X
================================================================================================
Running benchmark DecimalType(10,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(10,2) , ansi mode enabled : true:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(10,2) , ansi mode
enabled : true 118 150 34 8.5
118.1 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(10,2) , ansi mode
enabled : true 86 138 36 11.6
86.1 1.4X
================================================================================================
Running benchmark DecimalType(20,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(20,2) , ansi mode enabled : false:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(20,2) , ansi mode
enabled : false 158 198 40 6.3
157.7 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(20,2) , ansi mode
enabled : false 146 150 4 6.8
146.2 1.1X
================================================================================================
Running benchmark DecimalType(20,2)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(20,2) , ansi mode enabled : true:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(20,2) , ansi mode
enabled : true 160 210 39 6.3
159.6 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(20,2) , ansi mode
enabled : true 145 150 6 6.9
145.0 1.1X
================================================================================================
Running benchmark DecimalType(34,10)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(34,10) , ansi mode enabled : false:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(34,10) , ansi mode
enabled : false 350 365 27 2.9
350.0 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(34,10) , ansi mode
enabled : false 191 203 12 5.2
191.0 1.8X
================================================================================================
Running benchmark DecimalType(34,10)
================================================================================================
OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Mac OS X 16.0
Apple M2 Max
Cast function to : DecimalType(34,10) , ansi mode enabled : true:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per
Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark Cast expr from STRING to : DECIMAL(34,10) , ansi mode
enabled : true 347 354 12 2.9
346.5 1.0X
SQL Parquet - Comet Cast expr from STRING to : DECIMAL(34,10) , ansi mode
enabled : true 192 224 38 5.2
191.6 1.8X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
