[
https://issues.apache.org/jira/browse/IMPALA-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fredy Wijaya resolved IMPALA-6373.
----------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.1.0
> Allow type widening primitive conversion on parquet tables
> ----------------------------------------------------------
>
> Key: IMPALA-6373
> URL: https://issues.apache.org/jira/browse/IMPALA-6373
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Patrick Bayne
> Assignee: Fredy Wijaya
> Priority: Major
> Labels: parquet
> Fix For: Impala 3.1.0
>
>
> This improvement is very useful for users who have schema evolution on their
> tables, or users that use Impala and Hive for querying data and are allowing
> for this. Beings this improvement is in Hive, a Hive table with a "bigint"
> can read parquet files with "int32" and "int64" types. This same query will
> fail in Impala due to the unexpected data type, with an error similar to:
> "Column type: BIGINT, Parquet schema: optional int32"
> Hive 2.x's addition of type widening is found in the following JIRAs:
> https://issues.apache.org/jira/browse/HIVE-12080
> https://issues.apache.org/jira/browse/HIVE-14085
> Here's a list of widening conversions the upstream Hive improvement supports:
> tinyint -> smallint,int,bigint,float,double
> smallint -> int,bigint,float,double
> int -> bigint,float,double
> bigint -> float,double
> float -> double
> double -> --
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
