Zookeeper fails to see all the brokers at once

2016-10-28 Thread vivek thakre
Hello All, I have a Kafka Cluster deployed on AWS. I am noticing this issue randomly when none of the brokers are registered with zookeeper ( I have set up a monitor on this by using zk-shell util) During this issue, the cluster continues to operate i.e events can be produced and consumed. But th

Re: KStream-to-KStream Join Example

2016-07-13 Thread vivek thakre
partition for your topics. > On 13 Jul 2016 7:40 p.m., "vivek thakre" wrote: > > > Hello, > > > > I want to join 2 Topics (KStreams) > > > > > > Stream 1 > > Topic : userIdClicks > > Key : userId > > Value : JSON String with eve

KStream-to-KStream Join Example

2016-07-13 Thread vivek thakre
Hello, I want to join 2 Topics (KStreams) Stream 1 Topic : userIdClicks Key : userId Value : JSON String with event details Stream 2 Topic : userIdChannel Key : userId Value : JSON String with event details and has channel value I could not find any examples with KStream-to-KStream Join. H

Re: Kafka Streams : Old Producer

2016-07-07 Thread vivek thakre
ctor > work? > > Ismael > > On Thu, Jul 7, 2016 at 12:29 PM, Matthias J. Sax > wrote: > > > Hi Vivek, > > > > Kafka Streams works only with Kafka 0.10 (but not with 0.9). > > > > I am not aware of any work around to allow for 0.9 usage. > > >

Kafka Streams : Old Producer

2016-07-06 Thread vivek thakre
Can kafka streams library work with the messages produced by 0.9.0.1 producer? I guess not since the old producer would not add timestamp. ( I am getting invalid timestamp exception) As I cannot change our producer application setup, I have to use 0.9.0.1 producer. Is there a workaround that I can

Re: Kafka Producer connection issue on AWS private EC2 instance

2016-06-29 Thread vivek thakre
gt; > In my case, the problem was the firewall that blocked access to zk from > Kafka. > > > On Jun 29, 2016, at 6:56 PM, vivek thakre > wrote: > > > > I have Kafka Cluster setup on AWS Public Subnet with all brokers having > > elastic IPs > > My pr

Kafka Producer connection issue on AWS private EC2 instance

2016-06-29 Thread vivek thakre
I have Kafka Cluster setup on AWS Public Subnet with all brokers having elastic IPs My producers are on private subnet and not able to produce to the kafka on public subnet. Both subnets are in same VPC I added the private ip/cidr of producer ec2 instance to Public Kafka's security group. (I can t

Re: future of Camus?

2015-10-22 Thread vivek thakre
/ Thanks, Vivek Thakre On Thu, Oct 22, 2015 at 2:29 PM, Hawin Jiang wrote: > Very useful information for us. > Thanks Guozhang. > On Oct 22, 2015 2:02 PM, "Guozhang Wang" wrote: > > > Hi Adrian, > > > > Another alternative approach is to use Kafka's