Repository: parquet-format Updated Branches: refs/heads/master 98c5e2b85 -> 4bddbadf7
PARQUET-757: Add NULL type to Bring Parquet logical types to par with Arrow Author: Julien Le Dem <[email protected]> Closes #45 from julienledem/types and squashes the following commits: 2956b63 [Julien Le Dem] review feedback 94236c4 [Julien Le Dem] PARQUET-757: Bring Parquet logical types to par with Arrow Project: http://git-wip-us.apache.org/repos/asf/parquet-format/repo Commit: http://git-wip-us.apache.org/repos/asf/parquet-format/commit/4bddbadf Tree: http://git-wip-us.apache.org/repos/asf/parquet-format/tree/4bddbadf Diff: http://git-wip-us.apache.org/repos/asf/parquet-format/diff/4bddbadf Branch: refs/heads/master Commit: 4bddbadf79e20a32152076fbedae0c3ce77fb531 Parents: 98c5e2b Author: Julien Le Dem <[email protected]> Authored: Fri Nov 4 10:35:08 2016 -0700 Committer: Julien Le Dem <[email protected]> Committed: Fri Nov 4 10:35:08 2016 -0700 ---------------------------------------------------------------------- LogicalTypes.md | 4 ++++ src/main/thrift/parquet.thrift | 8 +++++++- 2 files changed, 11 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/parquet-format/blob/4bddbadf/LogicalTypes.md ---------------------------------------------------------------------- diff --git a/LogicalTypes.md b/LogicalTypes.md index 8c73f69..c411dbf 100644 --- a/LogicalTypes.md +++ b/LogicalTypes.md @@ -366,3 +366,7 @@ optional group my_map (MAP_KEY_VALUE) { } ``` +## Null +Sometimes when discovering the schema of existing data values are always null and there's no type information. +The `NULL` type can be used to annotates a column that is always null. +(Similar to Null type in Avro) http://git-wip-us.apache.org/repos/asf/parquet-format/blob/4bddbadf/src/main/thrift/parquet.thrift ---------------------------------------------------------------------- diff --git a/src/main/thrift/parquet.thrift b/src/main/thrift/parquet.thrift index ac4d50e..e89bc80 100644 --- a/src/main/thrift/parquet.thrift +++ b/src/main/thrift/parquet.thrift @@ -174,7 +174,13 @@ enum ConvertedType { * particular timezone or date. */ INTERVAL = 21; - + + /** + * Annotates a column that is always null + * Sometimes when discovering the schema of existing data + * values are always null + */ + NULL = 25; } /**
