unikdahal opened a new issue, #5992: URL: https://github.com/apache/datafusion-comet/issues/5992
### Describe the bug `CometIcebergNativeScan` can turn residual-expression reflection or conversion failures into `None`. At serde time, native execution has already been selected, so `None` means the task is serialized without that residual predicate. This is fine when a residual is intentionally not pushed and an exact filter above the scan still enforces correctness. It is not fine when reflection unexpectedly fails, because both cases currently look the same. ### Steps to reproduce _No response_ ### Expected behavior Residual conversion should distinguish between: * intentionally unsupported / not pushed; and * reflection or conversion failure. Unexpected failures during native serde should fail the query when correctness may depend on the residual, instead of silently dropping it. ### Additional context Found during review of #5515. Related to the same planning-vs-serde failure boundary tracked in #5257, but the residual-expression path is not covered there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
