gstvg commented on PR #3611: URL: https://github.com/apache/datafusion-comet/pull/3611#issuecomment-4221431483
I believe https://github.com/apache/datafusion/issues/21231 will affect this. A CaseWhen/If within a lambda using it's variable will remove it from the batch Calling `array_exists` within a case should be fine because the case projection happens before the lambda variable it's inserted into the batch I think a check can be added here http://github.com/apache/datafusion-comet/blob/main/spark/src/main/scala/org/apache/comet/serde/conditional.scala until this get's fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
