alamb opened a new issue, #14831:
URL: https://github.com/apache/datafusion/issues/14831

   ### Describe the bug
   
   This is a report from @lmwnshn
   
   As part of a series of issues that were discovered at CMU while working on 
DataFusion
   - https://github.com/apache/datafusion/issues/14373
   
   
   Basically they found that DataFusion couldn't run substrait generated by 
Apache Calcite
   
   Quoting the readme: 
https://github.com/lmwnshn/15799-s25-project1-remnants/blob/main/README.md
   
   The idea behind this project was to:
   
   1. Convert SQL to a Substrait plan with Calcite.
   2. Execute the Substrait plan on different systems (e.g., DuckDB, 
DataFusion).
   Students would then experiment with Calcite's different rules. However, this 
project idea didn't quite work for the following reasons:
   
   1. substrait-java does not run optimizations - while in theory this can be 
enabled, I recall running into some issues.
   2. More critically, at the time of writing, both DuckDB and DataFusion have 
limited support for executing the Substrait generated by Calcite.
   
   ### To Reproduce
   
   See the code at https://github.com/lmwnshn/15799-s25-project1-remnants
   
   Note I haven't looked at any of this myself so  I won't be able to help with 
specific questionds
   
   ### Expected behavior
   
   datafusion should work for all the plans
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to