Re: Question about the need of consumer groups from kafka

2018-02-19 Thread Till Rohrmann
Hi Ricardo, could you please give a bit more details what you mean with "not using its own mechanism"? Flink's Kafka connector uses the Kafka consumer and producer (to some extent) API to talk to Kafka. The consumer groups are a central concept of Kafka and as such, the Flink Kafka connector has t

Question about the need of consumer groups from kafka

2018-02-16 Thread Ricardo Dinis
Hi, If flink can manage kafka without using its own's mechanism (kafka consumers) it still need the consumer group defined from kafka? And why the examples is needed to use the plugin for shadding creating a fat-jar? Thanks