liwei created HUDI-1768:
---------------------------
Summary: spark datasource support schema validate add column
Key: HUDI-1768
URL: https://issues.apache.org/jira/browse/HUDI-1768
Project: Apache Hudi
Issue Type: Bug
Reporter: liwei
spark datasource now not support set avro column default value.
but it set column to nullable and use SchemaConverters.toAvroType transform to
union type which has null, such as :
Registered avro schema : {
"type" : "record",
"name" : "hoodie_test_record",
"namespace" : "hoodie.hoodie_test",
"fields" : [ {
"name" : "_row_key",
"type" : [ "string", "null" ]
}, {
"name" : "name",
"type" : [ "string", "null" ]
}, {
"name" : "timestamp",
"type" : [ "int", "null" ]
}, {
"name" : "partition",
"type" : [ "int", "null" ]
} ]
}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
