Kafka MirrorMaker issues

2017-02-27 Thread Le Cyberian
Hi Kafka Gurus :) I am facing issues with KafkaMirror, I am using Kafka 0.10.1.1 and trying to use mirroring to create backup of kafka logs or perhaps this might be a great idea to do it, please let me know if its not. my consumer.properties: bootstrap.servers=localhost:9092 group.id=mirror

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
Hi Guys, Thank you very much for you reply. The scenario which i have to implement is that i have 2 sites not datacenters so mirror maker would not work here. There will be 4 nodes in total, like 2 in Site A and 2 in Site B. The idea is to have Active-Active setup along with fault tolerance so

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
Hi Guys, Thank you very much for you reply. The scenario which i have to implement is that i have 2 sites not datacenters so mirror maker would not work here. There will be 4 nodes in total, like 2 in Site A and 2 in Site B. The idea is to have Active-Active setup along with fault tolerance so

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
/** > * Hans Jespersen, Principal Systems Engineer, Confluent Inc. > * h...@confluent.io (650)924-2670 > */ > > On Mon, Mar 6, 2017 at 5:37 AM, Le Cyberian <lecyber...@gmail.com> wrote: > > > Hi Guys, > > > > Thank you very much for you reply. > &g

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
ter will work? That seems wrong. > > -hans > > /** > * Hans Jespersen, Principal Systems Engineer, Confluent Inc. > * h...@confluent.io (650)924-2670 > */ > > On Mon, Mar 6, 2017 at 5:37 AM, Le Cyberian <lecyber...@gmail.com> wrote: > > > Hi Guys, >

Re: Kafka Kerberos Ansible

2017-03-06 Thread Le Cyberian
Hi Mudit, What do you mean by accessing Kafka cluster outside Ansible VM ? It needs to listen to a interface which is available for the network outside of the VM BR, Lee On Mon, Mar 6, 2017 at 7:42 PM, Mudit Agarwal wrote: > Hi, > How we can access the kafka

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
t;> down. >> You will have to configure one addition zookeeper node in each site which >> you will only ever startup if a site goes down because otherwise 2 of 4 >> zookeeper nodes is not a quorum.Again you would be better with 3 nodes >> because then you would only have to do

Re: Having 4 Node Kafka Cluster

2017-03-06 Thread Le Cyberian
the proper failover and recovery procedures. > > -hans > > > > > > On Mar 6, 2017, at 10:44 AM, Le Cyberian <lecyber...@gmail.com> wrote: > > > > Thanks Han and Alexander for taking time out and your responses. > > > > I now understand the risks and the pos

Re: Kafka Kerberos Ansible

2017-03-06 Thread Le Cyberian
ansible script from ansible host which is > outside the kafka cluster. > My kafka cluster is kerberized. > Kafka and ansible are passwordless ssh. > > Thanks, > Mudit > > > -- > *From:* Le Cyberian <lecyber...@gmail.com> > *To:* use

Having 4 Node Kafka Cluster

2017-03-05 Thread Le Cyberian
Hi Guys, I have a scenario where i need to configure a 4 node Kafka Cluster along with Zookeeper having 4 nodes as well. I understand as a rule of them when it comes to cluster its always odd number, however this is the case i need to do it. For zookeeper, i understand with a 4 node cluster i

Having 4 Node Kafka Cluster

2017-03-05 Thread Le Cyberian
Hi Guys, I have a scenario where i need to configure a 4 node Kafka Cluster along with Zookeeper having 4 nodes as well. I understand as a rule of them when it comes to cluster its always odd number, however this is the case i need to do it. For zookeeper, i understand with a 4 node cluster i