JingsongLi opened a new pull request, #9441: URL: https://github.com/apache/paimon/pull/9441
### Purpose Reduce the row ID reassignment commit-conflict window by rewriting independent data manifests concurrently. ### Changes - rewrite planned data manifests in bounded parallel batches with `ManifestReadThreadPool` - use `scan.manifest.parallelism` to control concurrency - preserve the single atomic `OVERWRITE` snapshot and the sequential path for one manifest or parallelism 1 - propagate worker failures and wait for active tasks before returning ### Tests - `mvn -pl paimon-core -am -Pfast-build -DfailIfNoTests=false -DwildcardSuites=none -Dtest=DataEvolutionRowIdReassignerTest,DataEvolutionDeletionVectorTest test` - `mvn -pl paimon-core -am -DskipTests compile` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
