zhangtongr created KAFKA-19895:
----------------------------------
Summary: __consumer_offsets Partitions Growing to TB Size and Not
Cleaning Until Broker Restart
Key: KAFKA-19895
URL: https://issues.apache.org/jira/browse/KAFKA-19895
Project: Kafka
Issue Type: Bug
Components: log cleaner
Affects Versions: 2.7.1
Reporter: zhangtongr
Description:
We encountered an abnormal situation with the Kafka system topic
`__consumer_offsets` where
two specific partition replicas grew to extremely large sizes and did not
respond to cleanup policies.
Details:
1. Two replicas under `__consumer_offsets` unexpectedly reached extremely large
sizes:
- Partition replica size: **8.4 TB**
- Partition replica size: **3.9 TB**
Other replicas of the same topic are only about **100 MB**, which is normal.
2. We attempted to force cleanup by applying:
--
This message was sent by Atlassian Jira
(v8.20.10#820010)