[
https://issues.apache.org/jira/browse/HIVE-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HIVE-12159:
---------------------------------
Attachment: HIVE-12159.patch
This patch adds support for reading complex types to the vectorized ORC reader.
Important changes:
* RecordReader.nextBatch now requires a non-null batch. This simplifies life in
the recursive case when the TreeReader doesn't have enough information to
create the appropriate value.
* RecordReader.nextBatch now returns a boolean so that it is easy to embed as
the loop condition.
* ORC's SchemaEvolution can handle adding or removing columns from the end of
internal structs.
* Created tree readers for union, list, and map types.
* TreeReader.nextVector now takes an isNull mask since it can cascade from the
outer structs.
* A new TreeReader fills in null values for null columns caused by schema
evolution.
* The TimestampTreeReader does not use the row by row reader internally.
* The TreeReaderFactory now gets the file & reader types.
* TestVectorOrcFile now uses the vectorized reader exclusively.
* The reader passes down the TypeDescription for the file to the RecordReader.
* TypeDescription can now be placed into hash tables.
> Create vectorized readers for the complex types
> -----------------------------------------------
>
> Key: HIVE-12159
> URL: https://issues.apache.org/jira/browse/HIVE-12159
> Project: Hive
> Issue Type: Sub-task
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Attachments: HIVE-12159.patch
>
>
> We need vectorized readers for the complex types.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
