Richard Moorhead created BEAM-7216:
--------------------------------------
Summary: beam-sdks-java-io-kafka error with kafka brokers 0.10.2.1
Key: BEAM-7216
URL: https://issues.apache.org/jira/browse/BEAM-7216
Project: Beam
Issue Type: Bug
Components: io-java-kafka
Affects Versions: 2.12.0, 2.11.0, 2.10.0
Reporter: Richard Moorhead
In beam 2.9.0, KafkaRecordCoder was used for both producer/consumer records in
KafkaIO, in version 2.10.0, ProducerRecordCoder was introduced but it appears
that in the following code checks are not made to ensure kafka client
compatibility:
[https://github.com/apache/beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ProducerRecordCoder.java#L137]
Specifically the method call to `headers` will fail for kafka clients < 0.11.
Elsewhere in this class there are checks on ConsumerSpEL and it is proposed
that they should be reused in the line referenced.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
