XiaoHongbo-Hope opened a new pull request, #1405: URL: https://github.com/apache/paimon-rust/pull/1405
## Summary - Validate each residual once at its final nesting depth; avoid validating the rebuilt Variant again. - Borrow field names, order schema fields once, and merge sorted object headers without per-row sorting. - Shift object bodies in place instead of allocating a temporary header buffer. The on-disk format is unchanged. Depends on #1404. This is a stacked draft; review the commit after #1404 until that PR merges. ## Validation - `cargo test --locked -p paimon --lib variant`: 115 passed, 3 ignored. Clippy, formatting, and diff checks passed. - Synthetic in-memory Parquet read, 512 rows × 5,362 keys with 200 shredded fields and about 27 residuals: PR #1404 median 1.095 s, this prototype's first-run median 0.716 s (35% lower). Seven rounds per run; reconstructed value and metadata bytes have the same SHA-256. Runs were not interleaved. These are local decode/rebuild timings, not production OSS or DataLoader throughput. Real-table validation is pending. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
