Re: list of challenges encountered using 0.9.0.1

2016-05-06 Thread Cliff Rhyne
Thanks for the updates, Jason. Let me know if you have questions about use case that brings up any of these scenarios. On Thu, May 5, 2016 at 7:34 PM, Jason Gustafson wrote: > Hey Cliff, > > Thanks for the feedback. A few select comments: > > 1. The new Java KafkaConsumer

Re: list of challenges encountered using 0.9.0.1

2016-05-05 Thread Jason Gustafson
Hey Cliff, Thanks for the feedback. A few select comments: 1. The new Java KafkaConsumer doesn’t have a method to return the high >watermark (last offset in the topic/partition's log. This is currently exposed in fetch responses, so we could add it to the ConsumerRecords object. In general

list of challenges encountered using 0.9.0.1

2016-05-04 Thread Cliff Rhyne
While at the Kafka Summit I was asked to write up a list of challenges and confusions my team encountered using Kafka. We are using 0.9.0.1 and use the new Java KakfaConsumer. 1. The new Java KafkaConsumer doesn’t have a method to return the high watermark (last offset in the