We attempted a downgrade to beam-sdks-java-io-kafka 2.9 while using 2.10 for the rest and ran into issues. I still see checks to the ConsumerSpel throughout ProducerRecordCoder and I am beginning to think this is a bug.
________________________________ From: Juan Carlos Garcia <[email protected]> Sent: Thursday, May 2, 2019 11:10 PM To: [email protected] Cc: dev Subject: Re: kafka client interoperability Downgrade only the KafkaIO module to the version that works for you (also excluding any transient dependency of it) that works for us. JC. Lukasz Cwik <[email protected]<mailto:[email protected]>> schrieb am Do., 2. Mai 2019, 20:05: +dev<mailto:[email protected]> On Thu, May 2, 2019 at 10:34 AM Moorhead,Richard <[email protected]<mailto:[email protected]>> wrote: In Beam 2.9.0, this check was made: https://github.com/apache/beam/blob/2ba00576e3a708bb961a3c64a2241d9ab32ab5b3/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaRecordCoder.java#L132 However this logic was removed in 2.10+ in the newer ProducerRecordCoder class: https://github.com/apache/beam/blob/release-2.10.0/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/ProducerRecordCoder.java#L137 We are attempting to use Beam 2.10 with kafka 0.10.2.1; this is advertised as supported here: https://beam.apache.org/releases/javadoc/2.10.0/org/apache/beam/sdk/io/kafka/KafkaIO.html However we are experiencing issues with the `headers` method call mentioned above. Is there a way around this? CONFIDENTIALITY NOTICE This message and any included attachments are from Cerner Corporation and are intended only for the addressee. The information contained in this message is confidential and may constitute inside or non-public information under international, federal, or state securities laws. Unauthorized forwarding, printing, copying, distribution, or use of such information is strictly prohibited and may be unlawful. If you are not the addressee, please promptly delete this message and notify the sender of the delivery error by e-mail or you may call Cerner's corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.
