JingsongLi opened a new pull request, #874:
URL: https://github.com/apache/paimon-rust/pull/874

   BLOB values can exceed Arrow Binary 32-bit offsets and PyPaimon already 
exposes BLOB as LargeBinary. This change maps scalar and nested BLOB values to 
LargeBinary across format readers/writers, descriptor resolution, data 
evolution, residuals, variant shredding, and DataFusion BLOB functions. BINARY 
and VARBINARY remain Binary.
   
   This is required by apache/paimon#9954 so native reads return the requested 
Python schema directly.
   
   Tests:
   - cargo test -p paimon --lib blob (129 passed; two sandbox-only REST token 
tests excluded)
   - cargo test -p paimon --lib table::data_evolution_reader::tests:: (75 
passed)
   - cargo test -p paimon-datafusion --test blob_tests (25 passed)
   - cargo test -p paimon-datafusion --test blob_descriptor_functions (4 passed)
   - Python binding tests/test_read.py (81 passed)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to