fmorillo7694 opened a new pull request, #19043: URL: https://github.com/apache/iceberg/pull/19043
Backport of #17901 to Flink 1.20 and 2.2 (2.1 no longer exists on main). Two committers running for the same sink would each read the table at construction, so once one committed a checkpoint the other held a stale view and committed the same checkpoint again as a second snapshot. The in-commit `MaxCommittedCheckpointIdValidator` now rejects the duplicate, which `IcebergCommitter` catches and skips. `DynamicCommitter` reuses the shared `SinkUtil` validator. The patch applied cleanly to both modules. Test plan: `TestIcebergCommitter` (including the new `staleCommitterDoesNotCommitCheckpointTwice`), `TestIcebergSink`, and `TestDynamicCommitter` pass in both modules. The new test is confirmed to fail with the validator call disabled, in both modules. --- **AI Disclosure** - Model: Claude (Anthropic) - Platform/Tool: Kiro (Kiro Crew) - Human Oversight: partially reviewed - Prompt Summary: Backport the merged #17901 concurrent-commit validator fix from Flink 2.3 to 1.20 and 2.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
