JingsongLi commented on PR #8671: URL: https://github.com/apache/paimon/pull/8671#issuecomment-5083335420
After all subtasks have issued END_INPUT, `handleCommittableEvent` performs the final commit only when checkpoints are disabled; when checkpoints are enabled, it must wait for the subsequent `notifyCheckpointComplete`. It is not guaranteed that another checkpoint will be completed before a bounded task ends, and `close()` only clears the event loop without committing cached END_INPUT committables. Therefore, data after the last checkpoint may remain uncommitted. Existing tests manually trigger subsequent checkpoints and do not cover scenarios where the task ends directly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
