Swapna Marru created FLINK-39605:
------------------------------------

             Summary: Implement Avro Variant Confluent format for dynamic 
schema deserialization
                 Key: FLINK-39605
                 URL: https://issues.apache.org/jira/browse/FLINK-39605
             Project: Flink
          Issue Type: New Feature
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
            Reporter: Swapna Marru


Add a new deserialization format that can read Avro binary data from Confluent 
Schema Registry and convert it into Flink's VARIANT type. The existing 
avro-confluent format requires a fixed reader schema at table creation time. 
This format cannot be used if you want to deserialize the records with varying 
schemas. 

The new format should be able to use the writer schema dynamically per record — 
enabling schema-agnostic ingestion where the Avro schema varies across records.

Records are deserialized into VARIANT type column . Fields can later be 
accessed using VARIANT accessor methods. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to