Re: zookeeper discnnected every minutes when i am getting bulk data

2016-12-02 Thread AjeetSingh
Hi, Please follow the below Arch for my setup. Logstash (Shipper)+Kafka/Zookeeper Cluster 3 nodes+Logstash (Indexer)+LB+ElasticSearch Cluster(8 nodes)+LB+KIbana This is my Arch for current setup but that would be scale in future but before going to scale need to resolve this issue. Please help

Re: zookeeper discnnected every minutes when i am getting bulk data

2016-12-01 Thread AjeetSingh
Hi Rakesh, I am using 3 Kafka/Zookeepers nodes and that is running cluster mode and i am getting 100 GB data per day in one topics and i have ELK cluster. So i am not getting zookeepers disconnected in each mins and getting lag when zookeepers disconnected and how can i see the jute.maxbuffer