[
https://issues.apache.org/jira/browse/FLINK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Lorenzi updated FLINK-33045:
------------------------------------
Description:
{code:java}
'value.format' = 'avro-confluent',
'value.avro-confluent.url' = '<url>',
'value.avro-confluent.schema' = '<schema>', -- available in 1.18.x{code}
Currently the format {{avro-confluent}} seems to always try to register the
schema to the schema-registry, be it computed out of the table-schema or set by
property {{schema}} (if 1.18.x is used).
In our setup we would like to prevent our flink-jobs from registering schemas.
Flink should only lookup the schema-id by calling {{getId}} from confluents
schema-registry-client. We control publishing of new schema-versions outside of
flink.
The bevaviour is expected to be similar to the behvaiour of KafkaAvroSerializer
from confluent when {{auto.register.schemas=false}} is set.
Could there be a option like
{code:java}
'value.avro-confluent.auto.register.schema' = 'false'{code}
to disable auto-registering schema to the schema-registry?
Thank you for your help!
was:
{code:java}
'value.format' = 'avro-confluent',
'value.avro-confluent.url' = '<url>',
'value.avro-confluent.schema' = '<schema>', -- available in 1.18.x{code}
Currently the format {{avro-confluent}} seems to always try to register the
schema to the schema-registry, be it computed out of the table-schema or set by
property {{schema}} (if 1.18.x is used).
In our setup we would like to prevent our flink-jobs from registering schemas.
Flink should only lookup the schema-id by calling {{getId}} from confluents
schema-registry-client. We control publishing of new schema-versions outside of
flink.
The bevaviour is expected to be similar to the behvaiour of KafkaAvroSerializer
from confluent when {{auto.register.schemas=false}} is set.
Could there be a option like
{code:java}
'value.avro-confluent.auto-register.schema' = 'false'{code}
to disable auto-registering schema to the schema-registry?
Thank you for your help!
> format avro-confluent - disable auto-registering schema in registry
> -------------------------------------------------------------------
>
> Key: FLINK-33045
> URL: https://issues.apache.org/jira/browse/FLINK-33045
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Affects Versions: 1.17.1
> Environment: Flink-Kubernetes-Operator
> format avro-confluent
> Reporter: Michael Lorenzi
> Priority: Minor
>
> {code:java}
> 'value.format' = 'avro-confluent',
> 'value.avro-confluent.url' = '<url>',
> 'value.avro-confluent.schema' = '<schema>', -- available in 1.18.x{code}
> Currently the format {{avro-confluent}} seems to always try to register the
> schema to the schema-registry, be it computed out of the table-schema or set
> by property {{schema}} (if 1.18.x is used).
> In our setup we would like to prevent our flink-jobs from registering
> schemas. Flink should only lookup the schema-id by calling {{getId}} from
> confluents schema-registry-client. We control publishing of new
> schema-versions outside of flink.
> The bevaviour is expected to be similar to the behvaiour of
> KafkaAvroSerializer from confluent when {{auto.register.schemas=false}} is
> set.
> Could there be a option like
> {code:java}
> 'value.avro-confluent.auto.register.schema' = 'false'{code}
> to disable auto-registering schema to the schema-registry?
> Thank you for your help!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
