vaibhawvipul commented on PR #3759: URL: https://github.com/apache/datafusion-comet/pull/3759#issuecomment-4107862340
> I'm tentative how we should proceed considering widening data types coerce support in Spark 4.0. Would it be better just to document that Comet in such cases allows coercion in Spark 3.x? 🤔 This is simpler for sure. We can document that Comet is more permissive than Spark 3.x . However, this PR keeps validation for clarly invalid cases regardless of the spark version. The validation isn't trying to be stricter than Spark 3.x - it's preventing DataFusion from silently producing wrong results for genuinely incompatible types. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
