Re: Controller sometimes lose ISR

2015-11-03 Thread Gleb Zhukov
Hi, Mayuresh. No, this log before restart 61. But I found some interesting logs about ZK on problem broker: root@kafka3d:~# zgrep 'zookeeper state changed (Expired)' /var/log/kafka/*/* /var/log/kafka/2015-10-30/kafka-2015-10-30.log.gz:[2015-10-30 23:02:31,001] 284371992 [main-EventThread] INFO

Re: Controller sometimes lose ISR

2015-11-02 Thread Mayuresh Gharat
The broker 61 some how falls behind in fetching from the leader brokers and hence falls out of the ISR. [2015-10-30 23:02:34,012] ERROR Controller 61 epoch 2233 initiated state change of replica 61 for partition [test-res-met.server_logs.conv,18] from OnlineReplica to OfflineReplica... means that

Controller sometimes lose ISR

2015-10-31 Thread Gleb Zhukov
Hi, Everybody! Every week on Friday's night I lose ISR for some partitions in my kafka cluster: Topic: test-res-met.server_logs.conv Partition: 18Leader: 45 Replicas: 45,61Isr: 45 Current controller: 45 Partitions with leader #61 are available, I lose broker #61 only as ISR for