JingsongLi commented on PR #8401:
URL: https://github.com/apache/paimon/pull/8401#issuecomment-4892966590
The coordinator committer currently loses watermarks. The old
`CommitterOperator` updates `currentWatermark` in `processWatermark` and passes
it to `committer.combine`, but `CommittingWriteOperatorCoordinator` always uses
`NO_WATERMARK` and has a TODO for watermark handling. This changes committed
snapshot watermarks and can break watermark-based features such as partition
mark-done. Could we either forward per-subtask watermarks through operator
events and combine them consistently, or explicitly reject watermark-dependent
configurations while coordinator commit is enabled?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
