GitHub user andygrove closed the discussion with a comment: I tried benchmarking TPC-DS for Spark vs Datafusion Comet on AWS Glue Catalog Iceberg Tables and Spark was faster.
I'd try again with 1.0.0 or later. AWS Labs independent benchmark shows that Comet is significantly faster than Spark now. GitHub link: https://github.com/apache/datafusion-comet/discussions/3199#discussioncomment-18747982 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
