Re: Re-consume messages

2016-11-07 Thread Amit K
Thanks for your reply. Will give it a shot. On Sun, Nov 6, 2016 at 9:38 PM, Becket Qin wrote: > Hi Amit, > > In Kafka 0.9, the closest approach would be use > SimpleConsumer.getOffsetBefore() to search the offset by timestamp. And > then you can consume from the returned

Re: Re-consume messages

2016-11-06 Thread Becket Qin
Hi Amit, In Kafka 0.9, the closest approach would be use SimpleConsumer.getOffsetBefore() to search the offset by timestamp. And then you can consume from the returned biggest offset. Notice that the search is at log segment level and the result may not be accurate if the partition has been

Re-consume messages

2016-11-06 Thread Amit K
Hi All, I am using kafka 0.9.0.1 with high level java producer and consumer. I need to handle a case wherein I need to re-consume the already consumed (and processed) messages say for last 5 days (configurable). Is there any way of achieving the same apart from identifying the offsets for the