Re: TopicFilters and 0.9 Consumer

2015-03-06 Thread Vinoth Chandar
Hi Guozhang, Thanks for confirming. It should be straightforward to make subscribe(TopicFilter) and subscribe(TopicFilter, Partition) work for added/removed topics, since this is mostly regex matching against zookeeper metadata. But any thoughts on how repartitioning would work? (we need to let

Re: TopicFilters and 0.9 Consumer

2015-03-06 Thread Guozhang Wang
1. partition / member changes are caught on the server side, who will notify consumers to re-balance. 2. topic changes are caught on the client side through metadata request, who will then re-join the group with the new topic list to the server to re-balance. Guozhang On Fri, Mar 6, 2015 at 8:49

Re: TopicFilters and 0.9 Consumer

2015-03-05 Thread Guozhang Wang
Vinoth, Yes we do have plans to continue supporting topic filters in 0.9 consumers, the APIs are not there yet though. Guozhang On Thu, Mar 5, 2015 at 8:32 AM, Vinoth Chandar vin...@uber.com wrote: Hi guys, I was wondering what the plan in 0.9, was for the topic filters that are today in

TopicFilters and 0.9 Consumer

2015-03-05 Thread Vinoth Chandar
Hi guys, I was wondering what the plan in 0.9, was for the topic filters that are today in the High level consumer. The new API' http://people.apache.org/~nehanarkhede/kafka-0.9-consumer-javadoc/doc/org/apache/kafka/clients/consumer/KafkaConsumer.htmls subscribe methods, seem to be working with