XiaoHongbo-Hope opened a new pull request, #659: URL: https://github.com/apache/paimon-rust/pull/659
## Purpose Align Rust batch writes for postpone-bucket primary-key tables with the fixed-bucket behavior proposed in apache/paimon#8985. This extracts the core writer change from #658; Go binding and release changes remain in the draft PR. ## Changes - route batch writes to non-negative fixed buckets by default, while preserving legacy bucket -2 behavior when `postpone.batch-write-fixed-bucket=false` - infer bucket counts for new partitions and reuse persisted per-partition counts on later writes - stream writes for partitions whose bucket counts are already known, avoiding accumulation of every Arrow batch - persist `total_buckets` in commit messages and reject concurrent conflicting bucket-count decisions - reject the unsupported combination with deletion vectors, whose scans skip the level-0 files produced by batch writers - cover visibility, repeated writes, partitioning, conflict detection, option validation, and DataFusion reads ## Verification - `cargo fmt --all -- --check` - `cargo check --locked --offline -p paimon` - `cargo test --locked --offline -p paimon test_postpone_ --lib` - `cargo test --locked --offline -p paimon-datafusion test_postpone_batch_write_uses_visible_fixed_bucket --test pk_tables -- --exact` - DLF regression REST catalog E2E: write, commit, and immediate read from real buckets -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
