Jun Rao created KAFKA-4313:

             Summary: ISRs may thrash when replication quota is enabled
                 Key: KAFKA-4313
                 URL: https://issues.apache.org/jira/browse/KAFKA-4313
             Project: Kafka
          Issue Type: Bug
    Affects Versions:
            Reporter: Jun Rao
            Assignee: Jun Rao
             Fix For:

I created a high volume topic and a low volume topic, each with 1000 partitions 
and 2 replicas on 2 brokers. I populated the high volume topic with 4GB of 
data. Added a third broker and ran the rebalance tool with a 2MB/sec 
replication quota. At some point, all replicas for the low volume topic have 
been moved over and the new replicas are all in sync, but the high volume 
replicas are still catching up. Then, I started slowly producing to the low 
volume topic. Once I do that, I started seeing the low volume partitions' ISR 
constantly expanding and shrinking. The observed ISR change rate is ~ 6/sec. 
So, it does seem that ISR thrashing can happen.

This message was sent by Atlassian JIRA

Reply via email to