Re: Kafka Kerberos Ansible

2017-03-06 Thread Mudit Agarwal
thanks Le.However my cluster is kerberized. From: Le Cyberian <lecyber...@gmail.com> To: Mudit Agarwal <mudit...@yahoo.com> Sent: Monday, 6 March 2017 9:24 PM Subject: Re: Kafka Kerberos Ansible Hi Mudit, I guess its more related to Ansible rather than Kafka itsel

Re: Kafka Kerberos Ansible

2017-03-06 Thread Mudit Agarwal
Mar 6, 2017 at 7:42 PM, Mudit Agarwal <mudit...@yahoo.com.invalid> wrote: Hi, How we can access the kafka cluster from an outside Ansible VM.The kafka is kerberiszed.All linux environment. Thanks,Mudit    

Kafka Kerberos Ansible

2017-03-06 Thread Mudit Agarwal
Hi, How we can access the kafka cluster from an outside Ansible VM.The kafka is kerberiszed.All linux environment. Thanks,Mudit

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
I means 1.The producers in Datacenter A will start writing to Kafka in Datacenter B if Kafka in A is failing? From: "Tauzell, Dave" <dave.tauz...@surescripts.com> To: "users@kafka.apache.org" <users@kafka.apache.org>; Mudit Agarwal <mudit...@yahoo.com

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
Hi Hans, The latency between my two DC is 150ms.And yes I'm looking for synchronous replication.Is that possible? Thanks,Mudit From: Hans Jespersen <h...@confluent.io> To: users@kafka.apache.org; Mudit Agarwal <mudit...@yahoo.com> Sent: Friday, 28 October 2016 4:34 PM

Re: Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
Thanks dave. Any ways for how we can achieve HA/Failover in kafka across two DC? Thanks,Mudit From: "Tauzell, Dave" <dave.tauz...@surescripts.com> To: "users@kafka.apache.org" <users@kafka.apache.org>; Mudit Agarwal <mudit...@yahoo.com> Sent: Friday

Kafka Multi DataCenter HA/Failover

2016-10-28 Thread Mudit Agarwal
Hi, I learned that Confluent Enterprise provides Multi DC failover and HA synchronously and without any lag.I'm looking to learn further information and more detailed documentation on this.I have gone thorugh the white paper and it just talks about Replicator. Any pointers for more information

Kafka Mirrormaker in sync mode

2016-10-27 Thread Mudit Agarwal
Hi, Can we run Kafka MirrorMaker in sync mode where both source producer and consumer both are running in sync node ? Thanks,Mudit

Kafka multitenancy

2016-10-26 Thread Mudit Agarwal
Hi, How we can achieve multi-tenancy in kafka efficiently? Thanks,Mudit

Re: NetFlow metrics to Kafka

2016-07-12 Thread Mudit Agarwal
Hi Ozery, Please try mentioning the kafka broker IP and port in cisco collector config where you will sending your flows. Thanks,Mudit From: OZERAY MATHIEU To: "users@kafka.apache.org" Sent: Tuesday, 12 July 2016 8:20 PM Subject:

Re: kafka unable to send records - scala / spark

2016-07-12 Thread Mudit Agarwal
Sumit,You need to mention arguments as well.You are passing empty list.for ex: props.put("bootstrap.servers", "localhost:9092") From: Sumit Khanna To: users@kafka.apache.org Sent: Tuesday, 12 July 2016 4:49 PM Subject: kafka unable to send records - scala /

Re: Pros and cons of dockerizing kafka brokers?

2016-07-08 Thread Mudit Agarwal
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px #715FFA solid !important; padding-left:1ex !important; background-color:white !important; } i am running 5 broker kafka cluster on docker and using mesos cluster manager and marathon framework  Sent from Yahoo Mail

Re: Delete Message From topic

2016-06-14 Thread Mudit Agarwal
Thanks Tom! From: Todd Palino To: "users@kafka.apache.org" Sent: Tuesday, 14 June 2016 10:01 PM Subject: Re: Delete Message From topic Well, if you have a log compacted topic, you can issue a tombstone message (key with a null message) to

Re: upgrading Kafka

2016-05-26 Thread Mudit Agarwal
Yes,you can use constraints and same volumes.That can be trusted. From: Radoslaw Gruchalski To: "Karnam, Kiran" ; users@kafka.apache.org Sent: Thursday, 26 May 2016 2:31 AM Subject: Re: upgrading Kafka Kiran, If you’re using Docker, you can

Re: Get topic level detail from new consumer group command

2016-05-05 Thread Mudit Agarwal
you need to run describe topic command to get the topic details: ./kafka-topics.sh --zookeeper ":2181" --describe --topic From: ravi singh To: users@kafka.apache.org; d...@kafka.apache.org Sent: Friday, 6 May 2016 1:07 AM Subject: Get topic level detail from new

Re: Adding a broker

2016-05-03 Thread Mudit Agarwal
It will store new messages only,how i think you can migrate your old replicas on new brokers! Thanks,Mudit From: Jens Rantil To: "users@kafka.apache.org" Sent: Tuesday, 3 May 2016 6:21 PM Subject: Adding a broker Hi, When I added a

Best Guide/link for Kafka Ops work

2016-04-21 Thread Mudit Agarwal
Hi, Any recommendations for any online guide/link on managing/Administration of kafka cluster. Thanks,Mudit

Re: Issue with Kafka Broker

2016-04-12 Thread Mudit Agarwal
Can someone help on below issue? > On Apr 11, 2016, at 12:27 AM, Mudit Agarwal <mudit...@yahoo.com.INVALID> > wrote: > > Hi Guys, > I have 3 node kafka setup.Version is 0.9.0.1.I bounced the kafka-server and > zookeeper services on broker 3 node.Post that i

Issue with Kafka Broker

2016-04-10 Thread Mudit Agarwal
Hi Guys, I have 3 node kafka setup.Version is 0.9.0.1.I bounced the kafka-server and zookeeper services on broker 3 node.Post that i am seeing below messages in logs continuosly.Any help will be highly appreciated. [2016-04-11 05:24:56,074] WARN [Replica Manager on Broker 3]: While recording

kafka issue

2016-04-06 Thread Mudit Agarwal
Hi, Seeing below exceptions on broker id 3 node, in my three node kafka cluster.Also looks like this broker id is long under replicated and out of sync. [2016-04-06 04:00:00,720] ERROR [Replica Manager on Broker 3]: Error processing fetch operation on partition [subscribed_product_logs,2] offset

kafka issue

2016-04-06 Thread Mudit Agarwal
Hi, Seeing below exceptions on broker id 3 node, in my three node kafka cluster.Also looks like this broker id is long under replicated and out of sync. [2016-04-06 04:00:00,720] ERROR [Replica Manager on Broker 3]: Error processing fetch operation on partition [subscribed_product_logs,2]