Re: [I] Investigate performance of decimal math / aggregation [datafusion-comet]

[via GitHub]

andygrove commented on issue #670:
URL: 
https://github.com/apache/datafusion-comet/issues/670#issuecomment-2241146571

   > 33 iterations of sf=1
   > 
   > ### Pure scan without doing sum(decimals)
   > ![Screenshot 2024-07-19 at 11 57 10 
PM](https://private-user-images.githubusercontent.com/129050/350671310-e04c72dc-02ca-41a9-968e-c108a68b24df.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0ODA4NjIsIm5iZiI6MTcyMTQ4MDU2MiwicGF0aCI6Ii8xMjkwNTAvMzUwNjcxMzEwLWUwNGM3MmRjLTAyY2EtNDFhOS05NjhlLWMxMDhhNjhiMjRkZi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQxMzAyNDJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0yZTQ5MThmN2UxNmE1YzMzZGQ5MzcwMzhlMGE4MWIwOWJmZmZiMTQ5ZGU3ZTBhMGJmMmNiMTFiNzMwNzhlMDVlJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.1a5mJ379yWY8oiQX9bsIdFQPlVn2QYcRytbskDIp-XY)
   > 
   > ### Scan with doing Spark sum(decimals)
   > ![Screenshot 2024-07-19 at 11 57 10 
PM](https://private-user-images.githubusercontent.com/129050/350671325-50280fd7-0bb8-4200-9d6c-603107c1c17c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0ODA4NjIsIm5iZiI6MTcyMTQ4MDU2MiwicGF0aCI6Ii8xMjkwNTAvMzUwNjcxMzI1LTUwMjgwZmQ3LTBiYjgtNDIwMC05ZDZjLTYwMzEwN2MxYzE3Yy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQxMzAyNDJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0wZTk3NDIzOGE3ZGMyYzc1ZWE2NDViOTcwODkwN2ZhMjdiZjBjYjFlN2RkMDFjMTM4MDNhY2VmYjBmYTMzNDVjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.e9NlTy4Em8zh7H5G8M4afeZT9yvbpmuApZ1IIM6VGns)
   > 
   > So somehow once Sum is applied, Comet scan slows down...
   
   I think these two screen shots are identical?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org