chamikaramj commented on PR #36295: URL: https://github.com/apache/beam/pull/36295#issuecomment-3398542372
Managed I/O uses a Beam construction Row (shema-aware transform) generated from old Beam versions to upgrade Kafka to newer Beam versions. So my suspicion is that that Row is now incompatible with the new Beam Kafka I/O version so we cannot upgrade. That test has been very stable historically in my experience (over last 10 Beam versions). May be we can add a guard against old Beam versions using the updateCompatibilityBeamVersion option [1] ? (which is always set for Managed I/O) https://github.com/apache/beam/blob/1c6f779bdf2784860296bac2ad92c415e342d1f5/sdks/java/core/src/main/java/org/apache/beam/sdk/options/StreamingOptions.java#L45 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
