Nandini created AVRO-3578:
-----------------------------
Summary: Need a configurable value for validation of default
values in schemas
Key: AVRO-3578
URL: https://issues.apache.org/jira/browse/AVRO-3578
Project: Apache Avro
Issue Type: Improvement
Affects Versions: 1.9.0
Reporter: Nandini
With https://issues.apache.org/jira/browse/AVRO-2035, we enabled validation of
default values in schemas. This causes breaking change(if there are no defaults
in the schema) in case of an upgrade in version and can only be set at code
level.
To mitigated the issue,
Hive disabled this feature altogether in
https://issues.apache.org/jira/browse/HIVE-24797
Spark-Hive integration also imported the above changes in
https://issues.apache.org/jira/browse/SPARK-34512
We can expose an option validateDefaults and let user decide what to do with
the schema validation and update the code Avro Schema Parser as
Schema.Parser().setValidateDefaults(avroOptions.validateDefaults)
P.S. - The documentation should also mention, this change requires schema to be
changed when upgrading version of Avro.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
