JingsongLi opened a new pull request, #958: URL: https://github.com/apache/paimon-rust/pull/958
## Summary - Compare `sequence.field` using typed Arrow rows, including composite and nonnumeric fields, descending order, null ordering, and add/retract ties. Preserve the writer's established sort order when partial-update flush reuses the read-side merge function. - Apply `target-file-row-num` to Paimon Table append, Data Evolution, dedicated BLOB, primary-key data, and changelog writes. Append/DE roll after whole Arrow batches. Preserve file metadata order across background closes so Data Evolution row IDs follow write order. - Normalize equivalent nested Arrow write layouts such as PyArrow `list<item>` to Paimon's `list<element>`, convert fixed-size binary input, and support non-legacy BINARY/VARBINARY partition paths using Java's UTF-8 cast semantics. ## Java parity references - `UserDefinedSeqComparator` and `SortMergeReaderWithMinHeap` for typed sequence ordering and add/retract ties. - `RollingFileWriterImpl.writeBundle` for batch-level row-limit rolling. - `BinaryToStringCastRule` and `InternalRowPartitionComputer` for non-legacy binary partition values. ## Verification - `cargo fmt --all --check` - `cargo clippy --locked -p paimon --all-targets -- -D warnings` - `cargo test --locked -p paimon --lib --quiet` (3308 passed, 6 ignored) - New persisted-table integration suites for typed/composite sequences, partial-update sequence groups, row-limit rolling, binary partitions, and nested Arrow writes. The branch adds 2095 lines across 16 files. Compaction is outside this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
