Hi guys, I am using flink 1.7.2 and my application consumes from a kafka topic and publish to another kafka topic which is in its own kafka environment running a different kafka version,. I am using FlinkKafkaConsumer010 from this dependency *"org.apache.flink" %% "flink-connector-kafka-0.10" % flinkVersion. *
In the task manager log I see these lines: 2019-09-02 02:57:59,840 INFO org.apache.kafka.common.security.authenticator.AbstractLogin - Successfully logged in. 2019-09-02 02:57:59,841 INFO org.apache.kafka.common.security.kerberos.KerberosLogin - [Principal=kafka/sl73rspapd035.visa....@corpdev.visa.com]: TGT refresh thread started. 2019-09-02 02:57:59,842 INFO org.apache.kafka.common.security.kerberos.KerberosLogin - [Principal=kafka/sl73rspapd035.visa....@corpdev.visa.com]: TGT valid starting at: Mon Sep 02 02:57:59 GMT 2019 2019-09-02 02:57:59,843 INFO org.apache.kafka.common.security.kerberos.KerberosLogin - [Principal=kafka/sl73rspapd035.visa....@corpdev.visa.com]: TGT expires: Mon Sep 02 12:57:59 GMT 2019 2019-09-02 02:57:59,843 INFO org.apache.kafka.common.security.kerberos.KerberosLogin - [Principal=kafka/sl73rspapd035.visa....@corpdev.visa.com]: TGT refresh sleeping until: Mon Sep 02 11:14:13 GMT 2019 2019-09-02 02:57:59,919 WARN org.apache.kafka.clients.consumer.ConsumerConfig - The configuration 'zookeeper.connect' was supplied but isn't a known config.*2019-09-02 02:57:59,919 INFO org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.0 *2019-09-02 02:57:59,919 INFO org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : 576d93a8dc0cf421 Here if you see the Kafka version is 0.10.2.0. Is this the version the broker is running or is this coming from flink ? I have forced the kafka-client version to be 2.2.0 "org.apache.kafka" % "kafka-clients" % "2.2.0" force() I also don't see 0.10.2.0 in the dependency tree of my build. Also will flink-connector-kafka-0.10 work for kafka versions > 1.0 ? What should I do if the consumer broker and producer broker are on different versions of kafka ? Thanks, Vishwas Thanks, Vishwas
