discivigour opened a new pull request, #9083: URL: https://github.com/apache/paimon/pull/9083
### Purpose Extend the `compact_manifest` procedure so manifest sorting can be enabled and tuned for a single invocation without altering persistent table options. This change: - adds optional `manifest_sort_enabled`, `manifest_sort_partition_field`, and `manifest_sort_max_rewrite_size` arguments to the Flink and Spark procedures; - keeps table options when dedicated arguments are omitted, lets `options` override table values, and gives dedicated arguments the highest precedence; - adds a Flink `compact_manifest` action with corresponding command-line options; - reports the manifest file count in each sorted-run level during dry run when manifest sorting is enabled; and - preserves no-op behavior when there is no manifest rewrite to commit. ### Tests - `mvn -pl paimon-core,paimon-flink/paimon-flink-common -Pflink1 -DskipTests -Dmaven.repo.local=/opt/homebrew/opt/maven/repository spotless:check` - `mvn -pl paimon-flink/paimon-flink-common -am -Pfast-build -Pflink1 -DfailIfNoTests=false -DwildcardSuites=none -Dtest=CompactManifestProcedureITCase -Dmaven.repo.local=/opt/homebrew/opt/maven/repository test` - `mvn -pl paimon-spark/paimon-spark-ut -am -Pfast-build -Pspark3 -DfailIfNoTests=false -DwildcardSuites=org.apache.paimon.spark.procedure.CompactManifestProcedureTest -Dtest=none -Dmaven.repo.local=/opt/homebrew/opt/maven/repository test` - `git diff --check origin/master...HEAD` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
