XiaoHongbo-Hope opened a new pull request, #1405:
URL: https://github.com/apache/paimon-rust/pull/1405

   ## Summary
   
   - Validate each residual once at its final nesting depth; avoid validating 
the rebuilt Variant again.
   - Borrow field names, order schema fields once, and merge sorted object 
headers without per-row sorting.
   - Shift object bodies in place instead of allocating a temporary header 
buffer. The on-disk format is unchanged.
   
   Depends on #1404. This is a stacked draft; review the commit after #1404 
until that PR merges.
   
   ## Validation
   
   - `cargo test --locked -p paimon --lib variant`: 115 passed, 3 ignored. 
Clippy, formatting, and diff checks passed.
   - Synthetic in-memory Parquet read, 512 rows × 5,362 keys with 200 shredded 
fields and about 27 residuals: PR #1404 median 1.095 s, this prototype's 
first-run median 0.716 s (35% lower). Seven rounds per run; reconstructed value 
and metadata bytes have the same SHA-256. Runs were not interleaved.
   
   These are local decode/rebuild timings, not production OSS or DataLoader 
throughput. Real-table validation is pending.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to