Dhruvil Shah created KAFKA-7385:
-----------------------------------

             Summary: Log compactor crashes when empty headers are retained 
with idempotent / transaction producers
                 Key: KAFKA-7385
                 URL: https://issues.apache.org/jira/browse/KAFKA-7385
             Project: Kafka
          Issue Type: Bug
            Reporter: Dhruvil Shah


During log compaction, we retain an empty header if the batch contains the last 
sequence number for a particular producer. When such headers are the only 
messages retained, we do not update state such as `maxOffset` in 
`MemoryRecords#filterTo` causing us to append these into the cleaned segment 
with `largestOffset` = -1. This throws a `LogSegmentOffsetOverflowException` 
for a segment that does not actually have an overflow. When we attempt to split 
the segment, the log cleaner dies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to