YutaLin opened a new pull request, #4997:
URL: https://github.com/apache/datafusion-comet/pull/4997
## Which issue does this PR close?
Closes #4983
## Rationale for this change
Support time extraction (from TimeType to Int/Decimal)
## What changes are included in this PR?
* Adds native Comet support for extracting hour, minute, and second from
Spark TimeType values.
* Adds serde handling for Spark’s DateTimeUtils StaticInvoke expressions
used by TimeType extraction.
* Implements fractional-second extraction as Decimal(8, 6) from Arrow
Time64(Nanosecond) values.
* Registers the new second_with_fraction native scalar function.
* Adds Rust unit tests and Spark SQL coverage for hour, minute, second,
extract(SECOND FROM ...), and date_part('SECOND', ...).
## How are these changes tested?
- Added Rust unit tests for extracting hour, minute, integer second, and
fractional second from `Time64(Nanosecond)`, including multiple precision
values.
- Added Spark SQL tests in `time_extract.sql` covering `hour`, `minute`,
`second`, `extract(SECOND FROM ...)`, and `date_part('SECOND', ...)`.
- Verified the SQL results against Spark while requiring native Comet
execution.
- Ran the SQL test suite with Spark 4.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
