XiaoHongbo-Hope opened a new pull request, #8979: URL: https://github.com/apache/paimon/pull/8979
Depends on #8826. ### Purpose Add `PaimonOffsetSource` for multi-day `update_by_row_id` jobs. It pins a Paimon source snapshot and commits deterministic source-unit windows with a durable `next_offset`. The checkpoint is bounded: it stores one fixed source plan, one offset, the row count, and a completion marker. It does not accumulate target row-id ranges. Plain Ray Dataset sources keep the #8826 windowed-commit behavior and do not accept `operation_id`. Each window validates the target files used during planning. External target rewrites stop the operation; appends and compactions remain allowed. `delete_update_by_row_id_checkpoint` removes the retained tags after success is acknowledged. ### Tests - Ray update/checkpoint and commit-conflict suites: 83 passed - Ray merge/read suites: 82 passed, 26 skipped - Flake8 and diff checks: passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
