JingsongLi opened a new pull request, #954: URL: https://github.com/apache/paimon-rust/pull/954
## Summary Support managed BLOB values in native primary-key Paimon tables backed by Parquet data files. This covers scalar BLOB, ARRAY<BLOB>, and MAP<X, BLOB> fields. - Externalize payloads into rolling `.managed.blob` packs before the key-value merge buffer and retain descriptors in Parquet. - Write Java-compatible `.blobref` sidecars and register them in `DataFileMeta.extra_files` so each Parquet file records its managed pack dependencies. - Resolve BLOB descriptors after primary-key merge and projection, including null collection parents, with descriptor-only reads when configured. - Align primary-key BLOB schema checks with Java and clean up uncommitted packs on writer abort. ## Verification - `cargo test -p paimon managed_blob_ --lib` (15 passed) - `cargo test -p paimon spec::schema::tests:: --lib` (122 passed) - `cargo test -p paimon table::kv_file_writer::tests:: --lib --quiet` (19 passed) - `cargo test -p paimon table::table_write::tests::test_primary_key_ --lib --quiet` (1 passed) - `cargo clippy --locked --all-targets --workspace --features fulltext,vortex -- -D warnings` - `cargo fmt --all -- --check` The change adds 2,034 lines and removes 13 lines. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
