peterxcli opened a new pull request, #4976: URL: https://github.com/apache/datafusion-comet/pull/4976
## Which issue does this PR close? Closes #4975. ## Rationale for this change `YearMonthIntervalType` and `DayTimeIntervalType` values fall back to Spark when they cross codegen boundaries as nested values or native-shuffle payloads because their Arrow vectors and getter paths are not dispatched. ## What changes are included in this PR? - Add interval handling across scalar and nested codegen getters. - Support intervals at Comet sink boundaries and in native-shuffle payloads. - Add SQL regressions for both interval types. - Leave interval file scans and JVM shuffle unchanged. ## How are these changes tested? - `make core` - `CometSqlFileTestSuite make_ym_interval` on Spark 4.1 and Spark 3.5 - `CometSqlFileTestSuite make_dt_interval` on Spark 4.1 and Spark 3.5 - Spotless and `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
