XiaoHongbo-Hope opened a new pull request, #10882: URL: https://github.com/apache/paimon/pull/10882
Concurrent column updates can make one Data Evolution compaction task conflict and fail the entire batch. With `data-evolution.compaction.discard-conflicting-tasks=true` (default `false`), the commit drops each conflicting task's complete input deletions and output additions, rechecks conflicts, and commits independent tasks. If all tasks conflict, it records an empty Compact snapshot for commit deduplication. Skipped inputs remain live; unreferenced outputs use the existing orphan-file cleanup path. This applies only to independent normal-data compaction tasks without index/changelog changes or row-ID validation baselines. Other conflicts retain the existing failure behavior. Validation: 62 focused tests passed with standard Maven Checkstyle, Spotless, and Enforcer checks. Tests cover real compaction commits, concurrent updates, retries, shared inputs, row-ID reassignment, and exception serialization. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
