Impact of Zookeeper Unavailability on Running Producers/Consumers

2015-07-30 Thread Mohit Gupta
on the system. For producers, we see no impact where as for consumers just that their offsets are not getting committed. Also, once the zookeeper is up, consumer offsets should get updated to their proper value. It it correct? Thanks -- Best Regards, Mohit Gupta

Re: New Producer API Design

2015-05-14 Thread Mohit Gupta
be ser-/de- by the single producer. Guozhang On Wed, May 13, 2015 at 10:03 AM, Mohit Gupta success.mohit.gu...@gmail.com wrote: Hello, I've a question regarding the design of the new Producer API. As per the design (KafkaProducerK,V), it seems that a separate producer is required

Re: New Producer Async - Metadata Fetch Timeout

2015-05-13 Thread Mohit Gupta
Mohit Gupta success.mohit.gu...@gmail.com : I could not follow the reasoning behind blocking the send method if the metadata is not up-to-date. Though, I see that it as per design, it requires the metadata to batch the message into appropriate topicPartition queue. Also

Re: New Producer Async - Metadata Fetch Timeout

2015-05-13 Thread Mohit Gupta
AM, Mohit Gupta success.mohit.gu...@gmail.com wrote: Thanks Jiangjie. This is helpful. Adding to what you have mentioned, I can think of one more scenario which may not be very rare. Say, the application is rebooted and the Kafka brokers registered in the producer are not reachable

New Producer API Design

2015-05-13 Thread Mohit Gupta
the purpose of using generics in the producer? Specific to our use case, we have multiple types of messages, where each message type can have multiple custom serializers. And, a message can be pushed into mulitple topics with different serialization. -- Best Regards, Mohit Gupta

Re: New Producer Async - Metadata Fetch Timeout

2015-05-12 Thread Mohit Gupta
that 'send' method is blocking. Is new producer fetch metadata not async? Rendy -- -Regards, Mayuresh R. Gharat (862) 250-7125 -- Best Regards, Mohit Gupta

Re: Java Consumer API

2015-05-01 Thread Mohit Gupta
ok. thanks. On Fri, May 1, 2015 at 10:00 AM, Aditya Auradkar aaurad...@linkedin.com.invalid wrote: It'll be officially ready only in version 0.9. Aditya From: Mohit Gupta [success.mohit.gu...@gmail.com] Sent: Thursday, April 30, 2015 8:58 PM

Java Consumer API

2015-04-30 Thread Mohit Gupta
Hello, Kafka documentation ( http://kafka.apache.org/documentation.html#producerapi ) suggests using only Producer from kafka-clients ( 0.8.2.0 ) and to use Consumer from the packaged scala client. I just want to check once if the Consumer API from this client is ready for production use. --