JingsongLi opened a new pull request, #10082: URL: https://github.com/apache/paimon/pull/10082
### Purpose Python commits currently merge small manifest files, adding metadata rewrites to the commit path and increasing contention between concurrent writers. Leave manifest compaction to centralized maintenance instead: each Python commit, including retries, preserves the existing manifests from the latest snapshot and writes only its new manifests and manifest lists. Remove the manifest merger, its retry reuse state, and the Python-only accessors for the merge-related options. Existing table properties remain accepted, while `manifest.target-file-size` still controls newly written manifests. Update the writing documentation and retain coverage for reading externally compacted manifests. ### Tests - Regression coverage for preserving manifests with legacy merge options, retries after concurrent appends or external compaction, concurrently attached sidecars, preparation-failure cleanup, and uncertain commit results. - Focused commit, overwrite, writer, callback, changelog, manifest, row-range filtering, and options-table suites: **268 passed, 1 skipped, 73 subtests passed**. - Flake8 for all changed Python files and `git diff --check` passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
