jianguotian opened a new pull request, #90: URL: https://github.com/apache/paimon-mosaic/pull/90
## Purpose Build the Writer's sorted-column-to-input-batch mapping in linear time instead of repeatedly searching the Arrow schema during Writer construction. ## Changes - invert `MosaicSchema::original_order` to construct the batch column map in O(N) - remove repeated `Schema::index_of` calls from Writer construction - preserve the existing sorted-column and input-batch mapping semantics - add a focused test with a non-trivial column permutation ## Performance evidence A local 1,000-column benchmark reduced Writer construction from 1,682 us to 218 us, approximately 87%. This result applies to Writer construction in that benchmark scenario, not to every batch write or whole-process execution. ## Compatibility - no Mosaic file-format change - column ordering and written values remain unchanged - no FFI or public API change ## Tests - `cargo fmt --all -- --check` - `cargo clippy --locked --offline --all-targets --workspace -- -D warnings` - `cargo test --locked --offline --workspace` - `cargo build --locked --offline --all-targets` - `cargo deny check licenses` - `python3 tools/dependencies.py check` - `git diff --check HEAD^` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
