andygrove opened a new issue, #1798: URL: https://github.com/apache/datafusion-comet/issues/1798
### Describe the bug Spark AQE caches exchange query plans using the canonicalized plan as the key. Sometimes a query can contain both a Spark (row-based) and a Comet (columnar) exchange that are equivalent and have the same canonicalized plan, so Spark will only cache one of them. At runtime, there can be errors due to mismatch between the original plan and the cached plan. We currently ignore some Spark SQL tests that show this issue - https://github.com/apache/datafusion-comet/issues/1739 - and we have no tests in Comet that show this issue. Related issue: https://github.com/apache/datafusion-comet/issues/1737 ### Steps to reproduce _No response_ ### Expected behavior _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
