how to get single record from kafka topic+partition @ specified offset

2015-08-07 Thread Padgett, Ben
Does anyone have an example of how to get a single record from a topic+partition given a specific offset? I am interested in this for some retry logic for failed messages. Thanks!

RE: consumer poll returns no records unless called more than once, why?

2015-05-20 Thread Padgett, Ben
using with this consumer client? Guozhang On Wed, May 20, 2015 at 9:03 AM, Padgett, Ben bpadg...@illumina.com wrote: //this code Properties consumerProps = new Properties(); consumerProps.put(bootstrap.servers, localhost:9092); //without deserializer

consumer poll returns no records unless called more than once, why?

2015-05-20 Thread Padgett, Ben
//this code Properties consumerProps = new Properties(); consumerProps.put(bootstrap.servers, localhost:9092); //without deserializer it fails, which makes sense. the documentation however doesn't show this consumerProps.put(key.deserializer,

RE: consumer poll returns no records unless called more than once, why?

2015-05-20 Thread Padgett, Ben
side and see if this issue goes away? Guozhang On Wed, May 20, 2015 at 9:49 AM, Padgett, Ben bpadg...@illumina.com wrote: I am using Kafka v0.8.2.0 From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, May 20, 2015 9:41 AM To: users

RE: KafkaConsumer poll always returns null

2015-05-20 Thread Padgett, Ben
, Padgett, Ben bpadg...@illumina.com wrote: The links below shows the code is definitely in trunk. Does anyone know when the source in trunk might be released? Thanks! https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache /kafka/clients/consumer/KafkaConsumer.java#L634

KafkaConsumer poll always returns null

2015-05-19 Thread Padgett, Ben
I came across this google group conversation that suggests KafkaConsumer will not be complete until the next release. (https://groups.google.com/forum/#!msg/kafka-clients/4VLb-_wI22c/imYRlxogo-kJ) ``` org.apache.kafka.clients.consumer.KafkaConsumerString, String consumer = new

Re: KafkaConsumer poll always returns null

2015-05-19 Thread Padgett, Ben
/clients/src/main/java/org/apache /kafka/clients/consumer/KafkaConsumer.java#L553 On 5/19/15, 2:13 PM, Padgett, Ben bpadg...@illumina.com wrote: I came across this google group conversation that suggests KafkaConsumer will not be complete until the next release. (https://groups.google.com/forum

Re: KafkaConsumer poll always returns null

2015-05-19 Thread Padgett, Ben
). There's not a specific timeline for the next release (i.e. when it's ready). On Tue, May 19, 2015 at 2:26 PM, Padgett, Ben bpadg...@illumina.com wrote: The links below shows the code is definitely in trunk. Does anyone know when the source in trunk might be released? Thanks! https