suxiaogang223 opened a new pull request, #61330:
URL: https://github.com/apache/doris/pull/61330
### What problem does this PR solve?
Hive external tables currently apply session time zone day offsets when
decoding ORC/Parquet DATE columns. In west time zones such as -06:00, this
shifts DATE values by one day earlier, while Spark keeps the original logical
date.
This PR removes the incorrect time zone day adjustment from Hive DATE
decoding paths in ORC and Parquet readers. TIMESTAMP-related time zone handling
is unchanged.
It also adds:
- BE unit coverage for west time zone DATE reads in ORC and Parquet
- Hive external regression coverage for UTC and -06:00 reads against the
same DATE data
Local BE build / regression execution was not run on this machine because
the current environment does not support BE compilation or running those tests;
pipeline validation is expected to cover execution.
Issue Number: N/A
Related PR: N/A
Problem Summary:
- Fix CIR-19660: Hive DATE columns read one day earlier in west time zones
- Keep DATE semantics time-zone-independent for ORC/Parquet external reads
- Add unit and regression coverage for UTC vs west time zone consistency
### Release note
Fix Hive external table DATE columns being shifted by one day in west time
zones when reading ORC/Parquet files.
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [x] Regression test
- [x] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [x] Yes. Hive external DATE reads no longer shift by one day in west
time zones.
- Does this need documentation?
- [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should
merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
