In order to produce the data , topic should be have min ISR =2 but look like
ISR is out of sync . kafka cluster health is not good .
Topic: FooBar Partition: 0 Leader: 3 Replicas: 2,3,1 Isr: 3
|[root@LoremIpsum kafka]# /usr/lib/kafka/kafka/bin/kafka-topics.sh
--bootstrap-server localhost:9092 --describe --topic FooBar Topic:
FooBar PartitionCount: 1 ReplicationFactor: 3 Configs:
min.insync.replicas=2,cleanup.policy=compact,segment.bytes=1073741824,max.message.bytes=5242880,min.compaction.lag.ms=604800000,message.timestamp.type=LogAppendTime,unclean.leader.election.enable=false
Topic: FooBar Partition: 0 Leader: 3 Replicas: 2,3,1 Isr: 3 |
On 9/26/20, 9:55 PM, "Franz van Betteraey" <[email protected]> wrote:
[External]
Hi all,
<https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fposts%2F64080819%2Ftimeline&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cab4b6e4b451d4f28bd0b08d862a16b39%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637367793205079127&sdata=TF3cCMCFSrsDXEwn3PDBt3gT3PuQxCmc8LOybuJ40Ns%3D&reserved=0>
I have a strange Kafka Server error when mirroring data with the
MirrorMaker 1 in Apache Kafka 2.6.
|org.apache.kafka.common.errors.NotEnoughReplicasException: The size of
the current ISR Set(3) is insufficient to satisfy the min.isr
requirement of 2 for partition FooBar-0 |
The strange thing is, that the |min.isr| setting is 2 and the ISR Set
has 3 nodes. Nevertheless I get the /NotEnoughReplicasException/ Exception.
Also taking a deeper look to the topic does not show any curiosities
|[root@LoremIpsum kafka]# /usr/lib/kafka/kafka/bin/kafka-topics.sh
--bootstrap-server localhost:9092 --describe --topic FooBar Topic:
FooBar PartitionCount: 1 ReplicationFactor: 3 Configs:
min.insync.replicas=2,cleanup.policy=compact,segment.bytes=1073741824,max.message.bytes=5242880,min.compaction.lag.ms=604800000,message.timestamp.type=LogAppendTime,unclean.leader.election.enable=false
Topic: FooBar Partition: 0 Leader: 3 Replicas: 2,3,1 Isr: 3 |
The logs of the 3 nodes look normal (as far as I can judge). Is there
any other reason that could produce this message. What else could be
checked?
Thank you very much for any advice!
I also posted this question on SO here:
https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F64080819%2Fkafka-size-of-isr-set3-insufficient-for-min-isr-2&data=02%7C01%7CManoj.Agrawal2%40cognizant.com%7Cab4b6e4b451d4f28bd0b08d862a16b39%7Cde08c40719b9427d9fe8edf254300ca7%7C0%7C0%7C637367793205079127&sdata=lfIyuovca3xo%2BVNlo57xMj5%2F7Gz0FCXx79hngOpmy0Y%3D&reserved=0
Kind regards,
Franz
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
