andygrove commented on issue #10744: URL: https://github.com/apache/datafusion/issues/10744#issuecomment-2148095866
@Omega359 so far we have been implementing custom `PhysicalExpr` directly in the `datafusion-comet` project as needed for Spark-specific behavior, with support for Spark's different evaluation modes (legacy, try, ansi) and we are using fuzz testing to ensure compatibilty across multiple Spark versions. I think we need to have the discussion of whether it makes sense to upstream these into the core datafusion project or not, or whether we publich a `datafusion-spark-compat` crate from Comet, or some other option. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
