LuciferYang opened a new pull request, #1323: URL: https://github.com/apache/paimon-rust/pull/1323
### Purpose Linked issue: close #1321 Python users can compact a table only by running `CALL sys.compact` through `SQLContext`. This adds `Table.new_compact_builder()`, a thin wrapper over core `CompactBuilder` with the same plan, execute and commit flow as the procedure. Part of #286. ### Brief change log - `CompactBuilder.with_partition_filter(predicate)` takes the read-filter dict format, and repeated calls combine with AND. `with_commit_user(commit_user)` sets the commit user. Both are validated by the core builder when called, as in `GlobalIndexDropBuilder` and `BatchWriteBuilder`. - `execute()` plans, runs every task and makes one `COMPACT` commit. It returns a dict with `tasks` and the commit's write metrics. Nothing is committed when no task is planned. - When a task fails, the outputs of earlier tasks are deleted. If that deletion fails, the binding emits a `RuntimeWarning` with the deletion error and then raises the task's error. `sys.compact` logs the same message with `log::warn!`, but the Python binding has no logger. - Type stubs for `CompactBuilder` and `Table.new_compact_builder`. ### Tests New `test_compact.py`: - append table: files are merged, rows are unchanged, and a `COMPACT` snapshot is published; - nothing to compact: no commit; - partition filter: `p=a` gets new files and `p=b` is untouched; - the commit user is recorded as `<commit_user>-compact-<suffix>`; - an invalid partition filter or commit user is rejected when set; - write-only primary-key table: two sorted runs are merged into one file; - deletion-vector primary-key table: `ValueError` and no commit without a local cache; with `local-cache.enabled=true`, compaction makes the rows visible. ### API and Format New Python API: `Table.new_compact_builder()` and `CompactBuilder`. No storage format change. ### Documentation New Table Maintenance > Compaction section in `docs/src/python-binding.md`, and a pointer to it from `docs/src/compaction.md`. Generated-by: Claude Opus -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
