Maxim Kolchin created BEAM-3696:
Summary: MQTT IO should compute watermark and ack messages outside
of finalizeCheckpoint method
Issue Type: Bug
Affects Versions: 2.2.0, 2.3.0
Environment: - Flink - beam-runners-flink_2.10:2.2.0
- Beam and related jars - 2.2.0
Reporter: Maxim Kolchin
Assignee: Reuven Lax
I'm experiencing a situation when an incoming message isn't acknowledged
(therefore in sometime broker resend it) and the watermark is not updated while
new messages are coming continuously.
After some time I've discovered that this situation is related to the fact that
finalizaCheckpoint is not being called.
I took a look at the Pubsub IO implementation and found that they expect such
situation and do not compute watermark and ack messages in finalizeCheckpoint.
Here is the comment about that:
Should MQTT IO do the same?
This message was sent by Atlassian JIRA