XiaoHongbo-Hope opened a new pull request, #1467:
URL: https://github.com/apache/paimon-rust/pull/1467

   ### Purpose
   
   Closes #1466. Intact BLOB files written by Python before apache/paimon#9426 
fail Rust reads because their CRC excludes the trailing entry length.
   
   ### Brief change log
   
   - Accept standard and historical Python CRCs using one payload scan, without 
additional I/O.
   - Add `blob.read.verify-crc` (default `true`) to scalar/array/map BLOB 
reads, including Data Evolution fallback reads. `false` skips CRC calculation 
only; magic, length and range checks remain enabled.
   - Keep writers and descriptor-only reads unchanged.
   
   ### Tests
   
   Historical Python-generated scalar/array/map fixtures, mixed standard/legacy 
entries, empty/null entries, corruption rejection, option parsing, and disabled 
verification through format-reader and Data Evolution paths.
   
   `cargo test -p paimon --lib blob --locked`: 275 passed.
   `cargo fmt --all -- --check` and `git diff --check`: passed.
   Scoped Clippy is still running.
   
   ### API and Format
   
   New optional read setting; no writer or on-disk format changes. Disabling 
CRC means payload corruption detectable only by the checksum is no longer 
rejected. This setting does not control external-object or Python-side 
descriptor fetching.
   
   ### Documentation
   
   Added the option and its scope to the Python binding guide.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to