Re: How to achieve Failover or HighAvailable in SimpleConsumer?

2015-07-06 Thread Jiangjie Qin
I guess it is called SimpleConsumer for a reason. Simple consumer is really simple and does not support any failure recovery. You might need to implement you own logic, it is probably not trivial though. As a reference, high level consumer uses Zookeeper ephemeral path to monitor the liveliness of

Sending a list of ProducerRecords

2015-07-06 Thread JIEFU GONG
Hi, Currently attempting to use v 0.8.2 and write my own producer, and I was wondering if it is still possible/beneficial to be able to send a list of ProducerRecords as opposed to only a single one at a time? Examining the API it seems like org.apache.kafka.clients.producer.KafkaProducer does

Re: Origin of product name Kafka

2015-07-06 Thread luo.fucong
I just found the answer in Quora: http://www.quora.com/What-is-the-relation-between-Kafka-the-writer-and-Apache-Kafka-the-distributed-messaging-system 在 2015年7月6日,下午8:30,jakob.vollenwei...@bkw.ch 写道: Hi Admin, I'm just wondering from where the product name Kafka originated, particularly

Re: Origin of product name Kafka

2015-07-06 Thread Gwen Shapira
Nice :) I always thought its a reference to the Kafkaesque process of building data pipelines in a large organization :) On Mon, Jul 6, 2015 at 6:52 PM, luo.fucong bayinam...@gmail.com wrote: I just found the answer in Quora:

Re: Origin of product name Kafka

2015-07-06 Thread Jiangjie Qin
:), Maybe we should put this in to Kafka FAQ? On 7/6/15, 7:25 PM, Gwen Shapira gshap...@cloudera.com wrote: Nice :) I always thought its a reference to the Kafkaesque process of building data pipelines in a large organization :) On Mon, Jul 6, 2015 at 6:52 PM, luo.fucong bayinam...@gmail.com

Re: retention.ms is not respected after upgrade to 0.8.2

2015-07-06 Thread Jaikiran Pai
I can't see anything obvious wrong in those configs or the code (after just a brief look). Are you sure the system on which you are running Kafka has its date/time correctly set? -Jaikiran On Monday 29 June 2015 12:06 PM, Krzysztof Zarzycki wrote: Greetings! I have problem with Kafka. I had a

Origin of product name Kafka

2015-07-06 Thread Jakob.Vollenweider
Hi Admin, I'm just wondering from where the product name Kafka originated, particularly since the general groove in Kafka's famous novels is often marked by a senseless, disorienting, often menacing complexity. Thanks, Jakob