[
https://issues.apache.org/jira/browse/HIVE-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537693#comment-14537693
]
Dong Chen commented on HIVE-10257:
----------------------------------
Upload a patch to check the column statics and filter functionality when a
column has null values.
> Ensure Parquet Hive has null optimization
> -----------------------------------------
>
> Key: HIVE-10257
> URL: https://issues.apache.org/jira/browse/HIVE-10257
> Project: Hive
> Issue Type: Sub-task
> Reporter: Dong Chen
> Assignee: Dong Chen
> Attachments: HIVE-10257-parquet.1.patch, HIVE-10257-parquet.patch
>
>
> In Parquet statistics, a boolean value {{hasNonNullValue}} is used for each
> column chunk. Hive could use this value to skip a column, avoid null-checking
> logic, and speed up vectorization like HIVE-4478 (in the future, Parquet
> vectorization is not completed yet).
> In this Jira we could check whether this null optimization works, and make
> changes if any.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
