Gabriel39 opened a new pull request, #68516:
URL: https://github.com/apache/doris/pull/68516
### What problem does this PR solve?
Related PR: #68441
Ports the complete timestamp-semantics fix, including its regression-profile
follow-up, to master. Parquet INT96 preserves wall-clock values unless an
explicit Hive catalog timezone is configured; INT64 keeps local DATETIME and
TIMESTAMPTZ semantics distinct. Native ORC rounds nanoseconds to microseconds
consistently across decoding, predicates, and statistics.
The port adapts scan routing and Hive writes to master's connector
architecture, preserves existing Azure Thrift fields, and retains master's
additional ORC statistics and Paimon/VARIANT regression coverage. Versioned
plans keep native Parquet scans on the reader that implements this contract,
including hybrid scans and late-arriving splits.
### Release note
Fix Parquet and ORC timestamp interpretation, rounding, and pruning
consistency for external reads and writes.
### Check List (For Author)
- Test
- [x] Regression test
- [x] Unit Test
- [ ] Manual test
- Behavior changed:
- [x] Yes. Versioned native Parquet scans use V2 even when the scanner
preference is disabled; native ORC uses half-up microsecond rounding.
- Does this need documentation?
- [x] No.
Validation:
- 63 focused FE tests passed; FE Checkstyle and connector architecture
checks passed.
- 676 BE ASAN tests passed across all 31 suites in the affected test files
and native Parquet statistics.
- clang-format 16 and build hygiene passed; 10 changed Groovy suites passed
syntax parsing.
- clang-tidy is not clean because master already has an unmatched
`NOLINTEND` in `be/src/core/types.h`.
- External-service regression suites await CI.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
