Good point @aljoscha with those dependencies, it would be good to fix them. 

> @eliaslevy Is there a resource on the forward/backward compatibility of Kafka 
> clients/brokers? I was under the impression that only from 1.0.0 onward can 
> you properly use newer clients with older brokers. If that is the case things 
> will get easier for us in the future and we only need the most recent 
> versions.

I believe that @eliaslevy was referring to compatibility other way around: our 
`0.11` connector can work with `1.0` and `1.1` brokers.

@yanghua if it's problematic, I would be fine with fixing/refactoring kafka 
0.10, 0.9 and 0.8 connectors in separate issue (if even fixing them at all). 
Especially that their code differs quite a bit compared to Kafka 0.11 
connector. 

It should be easier to strip current module `flink-connector-kafka-0.11` of 
kafka dependencies (as @aljoscha proposed, it should be possible and quite easy 
to do so by wrapping Kafka dependencies into our proxy/bridge interfaces), 
rename it to `flink-connector-kafka-base-2.0` and implement only 
`flink-connector-kafka-0.11`, `flink-connector-kafka-1.0`, 
`flink-connector-kafka-1.1` and `flink-connector-kafka-1.2` by extending from 
the newly created `flink-connector-kafka-base-2.0`.

[ Full content available at: https://github.com/apache/flink/pull/6577 ]
This message was relayed via gitbox.apache.org for [email protected]

Reply via email to