[
https://issues.apache.org/jira/browse/BEAM-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343384#comment-17343384
]
Beam JIRA Bot commented on BEAM-11851:
--------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it
has been labeled "stale-P2". If this issue is still affecting you, we care!
Please comment and remove the label. Otherwise, in 14 days the issue will be
moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed
explanation of what these priorities mean.
> ConfluentSchemaRegistryProvider fails when authentication is required
> ---------------------------------------------------------------------
>
> Key: BEAM-11851
> URL: https://issues.apache.org/jira/browse/BEAM-11851
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka
> Affects Versions: 2.27.0
> Reporter: Maxim Ivanov
> Priority: P2
> Labels: stale-P2
>
> When configuring KafkaIO.reader with ConfluentSchemaRegistryProvider as value
> deserializer with `basic.auth.credentials.source=AUTH_INO` and
> `basic.auth.user.info=user:password` properties, it fails to start the
> pipepline
> {code:java}
> [error] java.lang.RuntimeException: Unable to get latest schema metadata for
> subject: identity_users_v2-value
> [error] at
> org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getSchemaMetadata(ConfluentSchemaRegistryDeserializerProvider.java:119)
> [error] at
> org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getAvroSchema(ConfluentSchemaRegistryDeserializerProvider.java:110)
> [error] at
> org.apache.beam.sdk.io.kafka.ConfluentSchemaRegistryDeserializerProvider.getCoder(ConfluentSchemaRegistryDeserializerProvider.java:106)
> [error] at
> org.apache.beam.sdk.io.kafka.KafkaIO$Read.getValueCoder(KafkaIO.java:1147)
> [error] at
> org.apache.beam.sdk.io.kafka.KafkaIO$Read.expand(KafkaIO.java:1052)
> [error] at
> org.apache.beam.sdk.io.kafka.KafkaIO$Read.expand(KafkaIO.java:481)
> [error] at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:547)
> [error] at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:498)
> [error] at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:56)
> [error] at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:191) {code}
>
> I suspect that it because it reconfigured KafkaAvroDeserializer only in
> getDeserializer, but doesn't do so in getCoder.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
