Dan Schmitt created DRILL-7398:
----------------------------------
Summary: dfs avro file support to treat non existent fields as null
Key: DRILL-7398
URL: https://issues.apache.org/jira/browse/DRILL-7398
Project: Apache Drill
Issue Type: Improvement
Components: Storage - Avro
Reporter: Dan Schmitt
It would be nice to have an option to return null for non existing fields.
Currently we have a use case of evolving avro file schemas where things get
added.
It would be nice to be able to query old and new data without having to rewrite
the old data with a new schema with null/optional/default values.
A short term fix would be to provide an option to return null with dfs for avro
fields that aren't found in a file.
A nicer fix would be to support a resolving schema that can be given to dfs to
read the avro files to present a uniform interface (so aliases, defaults, etc.
could be utilized without rewriting each avro file.)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
