XiaoHongbo-Hope opened a new pull request, #1404:
URL: https://github.com/apache/paimon-rust/pull/1404

   ## Summary
   - Reuse validated source metadata IDs when rebuilding full shredded Variant 
values instead of rebuilding the dictionary for every row.
   - Borrow validated residual values instead of copying them into temporary 
Variants. Cache parsed metadata within one Arrow batch by exact bytes, with 
8-entry and 8 MiB bounds.
   - Preserve merged-row fallback when a typed key is absent from source 
metadata.
   
   ## Validation
   - Variant and shredding tests: 59 passed, 2 ignored.
   - Core library tests: 4,863 passed, 7 ignored; one unrelated mock HTTP test 
hit a connection reset and passed on isolated rerun.
   - cargo fmt, cargo clippy -p paimon --lib -- -D warnings, and git diff 
--check passed.
   - Synthetic debug-build benchmark (512 rows, 5,362 keys, 200 typed fields, 
27 residuals; three runs): median full rebuild 13.49 s before and 7.63 s after 
(1.77x). This is decode-only, not a production or DataLoader measurement.
   
   The output preserves logical values and source metadata when possible. 
Rebuilt Variant value bytes are not guaranteed to match the original physical 
ordering. Real-table validation remains pending.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to