[
https://issues.apache.org/jira/browse/HIVE-12080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957485#comment-14957485
]
Mohammad Kamrul Islam commented on HIVE-12080:
----------------------------------------------
[~spena] thanks for your informative comments. I think we are converging
quickly.
Option#1: Agreed that we are doing in the common code path which can create
concern/issue for other data types. However, # of get call will not increase.
It will remain one call for existing and new proposed patch.
Option#2: I also prefer #2 and I did some progress which is surprisingly
similar to yours. Only issue is: we are not currently passing the
request_schema or hive schema in all the code path. We may need to add this new
parameter upto all converters. I'm working on that. I found these when I was
working on another parquet performance issue.
Uploading a patch very soon.
> Support auto type widening for Parquet table
> --------------------------------------------
>
> Key: HIVE-12080
> URL: https://issues.apache.org/jira/browse/HIVE-12080
> Project: Hive
> Issue Type: New Feature
> Components: File Formats
> Reporter: Mohammad Kamrul Islam
> Assignee: Mohammad Kamrul Islam
>
> Currently Hive+Parquet doesn't support it. It should include at least basic
> type promotions short->int->bigint, float->double etc, that are already
> supported for other file formats.
> There were similar effort (Hive-6784) but was not committed. This JIRA is to
> address the same in different way with little (no) performance impact.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
