Is 0.9 new consumer API compatible with 0.8.x.x broker

2015-11-30 Thread hsy...@gmail.com
Is 0.9 new consumer API compatible with 0.8.x.x broker


Re: Is 0.9 new consumer API compatible with 0.8.x.x broker

2015-11-30 Thread Wang, Howard
Thanks.

I just found the new KafkaConsumer does have two API functions
assignment() and
committed(TopicPartition partition). With these 2 functions, we¹ll be able
to retrieve the timestamp of last offset regardless whether offset storage
is using ZK or offset topic.

Howard



-- 
 Howard Wang
Engineering ­ Big Data and Personalization
Washington Post Media


1150 15th St NW, Washington, DC 20071
p. 202-334-9195 
Email: howard.w...@washpost.com





On 11/30/15, 3:55 PM, "hsy...@gmail.com" <hsy...@gmail.com> wrote:

>Is 0.9 new consumer API compatible with 0.8.x.x broker



Re: Is 0.9 new consumer API compatible with 0.8.x.x broker

2015-11-30 Thread Guozhang Wang
Siyuan,

In general 0.9 new consumer API relies on the group coordinator on the
broker side to manage consumer groups, so you would need to upgrade the
brokers first.

However if you are only using the assign() function to assign partitions,
i.e. no subscribe() which will not need the group coordinator, the consumer
should work with an older broker version.

Guozhang

On Mon, Nov 30, 2015 at 12:58 PM, Wang, Howard <howard.w...@washpost.com>
wrote:

> Thanks.
>
> I just found the new KafkaConsumer does have two API functions
> assignment() and
> committed(TopicPartition partition). With these 2 functions, we¹ll be able
> to retrieve the timestamp of last offset regardless whether offset storage
> is using ZK or offset topic.
>
> Howard
>
>
>
> --
>  Howard Wang
> Engineering ­ Big Data and Personalization
> Washington Post Media
>
>
> 1150 15th St NW, Washington, DC 20071
> p. 202-334-9195
> Email: howard.w...@washpost.com
>
>
>
>
>
> On 11/30/15, 3:55 PM, "hsy...@gmail.com" <hsy...@gmail.com> wrote:
>
> >Is 0.9 new consumer API compatible with 0.8.x.x broker
>
>


-- 
-- Guozhang