hello
recently ,our prod environment have a proplem,the kafka leader Shrinking and
Expanding IsR frequently,result in the consumer can not consume the message.do
you have any advice?
thank you.
here is the log related.
[serviceop@SZC-L0046001 kafka]$ ./bin/kafka-topics.sh --describe --zookeeper
30.16.36.181:2181,30.16.36.182:2181,30.16.36.183:2181/ubasKafka --topic
kafkaUbasTopicProd
Topic:kafkaUbasTopicProd PartitionCount:8 ReplicationFactor:3
Configs:
Topic: kafkaUbasTopicProd Partition: 0 Leader: 1
Replicas: 1,7,0 Isr: 1,7,0
Topic: kafkaUbasTopicProd Partition: 1 Leader: 2
Replicas: 2,0,1 Isr: 1,2,0
Topic: kafkaUbasTopicProd Partition: 2 Leader: 3
Replicas: 3,1,2 Isr: 1,2,3
Topic: kafkaUbasTopicProd Partition: 3 Leader: 4
Replicas: 4,2,3 Isr: 2,3,4
Topic: kafkaUbasTopicProd Partition: 4 Leader: 5
Replicas: 5,3,4 Isr: 3,4,5
Topic: kafkaUbasTopicProd Partition: 5 Leader: 6
Replicas: 6,4,5 Isr: 4,5,6
Topic: kafkaUbasTopicProd Partition: 6 Leader: 7
Replicas: 7,5,6 Isr: 5,6,7
Topic: kafkaUbasTopicProd Partition: 7 Leader: 0
Replicas: 0,6,7 Isr: 0
[2017-05-09 18:28:34,533] INFO Partition [kafkaUbasTopicProd,7] on broker 0:
Expanding ISR for partition [kafkaUbasTopicProd,7] from 0 to 0,6
(kafka.cluster.Partition)
[2017-05-09 18:28:53,901] INFO Partition [kafkaUbasTopicProd,7] on broker 0:
Shrinking ISR for partition [kafkaUbasTopicProd,7] from 0,6 to 0
(kafka.cluster.Partition)
[2017-05-09 18:33:03,901] INFO Partition [__consumer_offsets,2] on broker 0:
Shrinking ISR for partition [__consumer_offsets,2] from 0,5,6 to 0,5
(kafka.cluster.Partition)
[2017-05-09 18:33:03,903] INFO Partition [__consumer_offsets,10] on broker 0:
Shrinking ISR for partition [__consumer_offsets,10] from 0,6,7 to 0,7
(kafka.cluster.Partition)
