Cameron Lee created SAMZA-2121:
----------------------------------

             Summary: Add checkpoint offset field to IncomingMessageEnvelope
                 Key: SAMZA-2121
                 URL: https://issues.apache.org/jira/browse/SAMZA-2121
             Project: Samza
          Issue Type: New Feature
            Reporter: Cameron Lee
            Assignee: Cameron Lee


In some cases, the offset to checkpoint may not match the plain offset 
associated with an individual message.

If large messages are supported in Kafka by segmenting them into smaller 
individual messages, then the plain offset of a message might fall in the 
middle of the segments of a large message. We do not want to checkpoint in the 
middle of a large message.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to