JingsongLi opened a new pull request, #8368: URL: https://github.com/apache/paimon/pull/8368
## Summary Extend Python commit retry handling to apply incremental snapshot changes to the previously read conflict base state, mirroring the generic retry optimization used by Java `FileStoreCommitImpl`. Also advance overwrite change construction through APPEND deltas so retries avoid repeated full scans when possible. Relates to #8359. ## Changes - Reuse conflict-detection base entries across commit retries and apply raw incremental ADD/DELETE changes before rechecking conflicts. - Add commit scanner support for reading raw incremental changes over a snapshot range while preserving DELETE entries and reusing the partition filter/manifest reader. - Advance overwrite cached target state through APPEND delta manifests, including target-partition appends and whole-table overwrite retries. - Add focused unit coverage plus a real table retry test that verifies DELETE+ADD deltas are applied instead of rebuilding base state with another full scan. ## Testing - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/overwrite_changes_cache_test.py -q` - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/partition_predicate_test.py -q` - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/file_store_commit_test.py -q` - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/write/conflict_detection_test.py -q` - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/table_commit_test.py -q` - [x] `PYTHONPATH=paimon-python python -m pytest paimon-python/pypaimon/tests/manifest/manifest_manager_test.py -q` - [x] `PYTHONPATH=paimon-python python -m py_compile paimon-python/pypaimon/write/file_store_commit.py paimon-python/pypaimon/write/commit/commit_scanner.py paimon-python/pypaimon/write/commit/overwrite_changes_provider.py paimon-python/pypaimon/tests/file_store_commit_test.py paimon-python/pypaimon/tests/overwrite_changes_cache_test.py paimon-python/pypaimon/tests/partition_predicate_test.py` - [x] `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
