XiaoHongbo-Hope opened a new pull request, #1467: URL: https://github.com/apache/paimon-rust/pull/1467
### Purpose Closes #1466. Intact BLOB files written by Python before apache/paimon#9426 fail Rust reads because their CRC excludes the trailing entry length. ### Brief change log - Accept standard and historical Python CRCs using one payload scan, without additional I/O. - Add `blob.read.verify-crc` (default `true`) to scalar/array/map BLOB reads, including Data Evolution fallback reads. `false` skips CRC calculation only; magic, length and range checks remain enabled. - Keep writers and descriptor-only reads unchanged. ### Tests Historical Python-generated scalar/array/map fixtures, mixed standard/legacy entries, empty/null entries, corruption rejection, option parsing, and disabled verification through format-reader and Data Evolution paths. `cargo test -p paimon --lib blob --locked`: 275 passed. `cargo fmt --all -- --check` and `git diff --check`: passed. Scoped Clippy is still running. ### API and Format New optional read setting; no writer or on-disk format changes. Disabling CRC means payload corruption detectable only by the checksum is no longer rejected. This setting does not control external-object or Python-side descriptor fetching. ### Documentation Added the option and its scope to the Python binding guide. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
