[
https://issues.apache.org/jira/browse/DRILL-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arina Ielchiieva resolved DRILL-7398.
-------------------------------------
Resolution: Fixed
Merged into master with commit id bf7277c9c8725d6b9a56988f72c31ede1d486b85.
> dfs avro file support to treat non existent fields as null
> ----------------------------------------------------------
>
> Key: DRILL-7398
> URL: https://issues.apache.org/jira/browse/DRILL-7398
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Avro
> Reporter: Dan Schmitt
> Priority: Major
>
> It would be nice to have an option to return null for non existing fields.
> Currently we have a use case of evolving avro file schemas where things get
> added.
> It would be nice to be able to query old and new data without having to
> rewrite the old data with a new schema with null/optional/default values.
> A short term fix would be to provide an option to return null with dfs for
> avro fields that aren't found in a file.
> A nicer fix would be to support a resolving schema that can be given to dfs
> to read the avro files to present a uniform interface (so aliases, defaults,
> etc. could be utilized without rewriting each avro file.)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)