Dawid Wysakowicz created FLINK-20175:
----------------------------------------

             Summary: Avro Confluent Registry SQL format does not support 
adding nullable columns
                 Key: FLINK-20175
                 URL: https://issues.apache.org/jira/browse/FLINK-20175
             Project: Flink
          Issue Type: Bug
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
            Reporter: Dawid Wysakowicz
            Assignee: Dawid Wysakowicz
             Fix For: 1.12.0


The {{AvroSchemaConverter#convertToSchema}} generates a union with "null" for 
nullable logical types, but it does not set the default value to null. In turn 
it makes it impossible to generate a backwards compatible schema from a DDL 
statement.

Example:
1. Create a table: {{CREATE TABLE t (id INT NOT NULL) WITH (/* avro confluent 
format*/)}}
2. Create a new table over the same topic or alter the old table with {{CREATE 
TABLE newT(id INT NOT NULL, optionalDescription STRING) WITH (/*avro confluent 
format*/)}}
3. When reading from {{newT}} records inserted into {{t}} it will fail, because 
the {{optionalDescription}} has no default value.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to