QuakeWang opened a new pull request, #8704:
URL: https://github.com/apache/paimon/pull/8704
### Purpose
Daft native Parquet routing used current column names and Daft-side casts
without checking the schema that wrote each file. For old-schema files, renamed
fields could be lost, dropped-and-readded fields could expose stale values, and
cast results could differ from PyPaimon.
Validate candidate native files by field ID, physical name, nullability, and
verified type promotions. Keep compatible reads native and fall back to
PyPaimon schema normalization otherwise. This also covers BLOB-table native
projections and normalizes TIME batches for Daft.
### Tests
- Daft test suite: 226 passed
- CI flake8 4.0.1
- License header and diff checks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
