JingsongLi opened a new pull request, #484: URL: https://github.com/apache/paimon-rust/pull/484
## Summary Add writer support for dedicated vector storage so tables configured with `vector.file.format` write vector columns into `*.vector.<format>` files instead of ordinary data files. This aligns append and data-evolution partial writes with the existing reader support for `.vector.*` files. ## Changes - Add `vector.file.format` and `vector.target-file-size` option accessors. - Validate dedicated vector storage tables require data evolution, row tracking, and a normal anchor column. - Split append writes so VECTOR columns are written to dedicated vector files while scalar/blob columns keep their existing layout. - Split data-evolution partial writes by normal versus VECTOR columns so updates also produce dedicated vector files. - Add focused coverage for `.vector.parquet`, `.vector.vortex`, option defaults, schema validation, and blob regression. ## Testing - [x] `cargo test -p paimon --lib vector` - [x] `cargo test -p paimon --lib blob_write` - [x] `cargo test -p paimon --features vortex --lib test_vector_write_uses_dedicated_vortex_file` - [x] `git diff --check` ## Notes No migration is required. Existing inline VECTOR writes are unchanged when `vector.file.format` is not configured. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
