Dhruvil Shah created KAFKA-7385: ----------------------------------- Summary: Log compactor crashes when empty headers are retained with idempotent / transaction producers Key: KAFKA-7385 URL: https://issues.apache.org/jira/browse/KAFKA-7385 Project: Kafka Issue Type: Bug Reporter: Dhruvil Shah
During log compaction, we retain an empty header if the batch contains the last sequence number for a particular producer. When such headers are the only messages retained, we do not update state such as `maxOffset` in `MemoryRecords#filterTo` causing us to append these into the cleaned segment with `largestOffset` = -1. This throws a `LogSegmentOffsetOverflowException` for a segment that does not actually have an overflow. When we attempt to split the segment, the log cleaner dies. -- This message was sent by Atlassian JIRA (v7.6.3#76005)