Todd Palino created KAFKA-6559:
----------------------------------

             Summary: Iterate record sets before calling Log.append
                 Key: KAFKA-6559
                 URL: https://issues.apache.org/jira/browse/KAFKA-6559
             Project: Kafka
          Issue Type: Improvement
          Components: core
    Affects Versions: 1.0.0
            Reporter: Todd Palino
            Assignee: Todd Palino


If a Produce request contains multiple record sets for a single 
topic-partition, it is better to iterate these before calling Log.append. This 
is because append will process all the sets together, and therefore will need 
to reassign offsets even if the offsets for an individual record set are 
properly formed. By iterating the record sets before calling append, each set 
can be considered on its own and potentially be appended without reassigning 
offsets.

While the core Java producer client does not current operate this way, it is 
permitted by the protocol and may be used by other clients that aggregate 
multiple batches together to produce them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to