Xinyu Liu created SAMZA-1646:

             Summary: Need to flush producer before sending out watermark
                 Key: SAMZA-1646
             Project: Samza
          Issue Type: Bug
            Reporter: Xinyu Liu
            Assignee: Xinyu Liu

Currently Kafka producer sends out messages asynchronous to different 
partitions, and there is no guarantee that all the messages will be persisted 
once watermark message is persisted. To avoid incorrect behavior, we need to 
put a produder.flush() before sending out the watermark message. This can be 
done in another thread to avoid the waiting for flush in process().

This message was sent by Atlassian JIRA

Reply via email to