Jun Rao commented on KAFKA-4313:

One way to fix this is that we avoid throttling those replicas in the throttled 
replica list that are already in sync. Those in-sync replicas traffic will 
still be accounted for the throttled traffic though.

> ISRs may thrash when replication quota is enabled
> -------------------------------------------------
>                 Key: KAFKA-4313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4313
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions:
>            Reporter: Jun Rao
>            Assignee: Jun Rao
>             Fix For:
> I created a high volume topic and a low volume topic, each with 1000 
> partitions and 2 replicas on 2 brokers. I populated the high volume topic 
> with 4GB of data. Added a third broker and ran the rebalance tool with a 
> 2MB/sec replication quota. At some point, all replicas for the low volume 
> topic have been moved over and the new replicas are all in sync, but the high 
> volume replicas are still catching up. Then, I started slowly producing to 
> the low volume topic. Once I do that, I started seeing the low volume 
> partitions' ISR constantly expanding and shrinking. The observed ISR change 
> rate is ~ 6/sec. So, it does seem that ISR thrashing can happen.

This message was sent by Atlassian JIRA

Reply via email to