pnowojski edited a comment on issue #6577: [FLINK-7964] Add Apache Kafka 1.0/1.1 connectors URL: https://github.com/apache/flink/pull/6577#issuecomment-417259753 Good point @aljoscha with those dependencies, it would be good to fix them. > @eliaslevy Is there a resource on the forward/backward compatibility of Kafka clients/brokers? I was under the impression that only from 1.0.0 onward can you properly use newer clients with older brokers. If that is the case things will get easier for us in the future and we only need the most recent versions. I believe that @eliaslevy was referring to compatibility other way around: our `0.11` connector can work with `1.0` and `1.1` brokers. @yanghua if it's problematic, I would be fine with fixing/refactoring kafka 0.10, 0.9 and 0.8 connectors in separate issue (if even fixing them at all, I imagine we might be able to start dropping them pretty soon if they start causing maintenance problems). Especially that their code differs quite a bit compared to Kafka 0.11 connector. It should be easier to strip current module `flink-connector-kafka-0.11` of kafka dependencies (as @aljoscha proposed, it should be possible and quite easy to do so by wrapping Kafka dependencies into our proxy/bridge interfaces), rename it to `flink-connector-kafka-base-2.0` and implement only `flink-connector-kafka-0.11`, `flink-connector-kafka-1.0`, `flink-connector-kafka-1.1` and `flink-connector-kafka-1.2` by extending from the newly created `flink-connector-kafka-base-2.0`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
