[
https://issues.apache.org/jira/browse/IMPALA-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-9410:
-----------------------------------
Description:
Currently we resolve ORC file columns by indices. We should provide an query
option like PARQUET_FALLBACK_SCHEMA_RESOLUTION for Parquet (IMPALA-2835), to
resolve ORC file columns by names.
Note that Hive only writes column names to ORC files after Hive-2.x
(HIVE-4243). For older versions of Hive, the column names in ORC files are
something like _col0, _col1,....,_col99. So this feature is only required when
deployed with Hive 2+.
was:
Currently we resolve ORC file columns by indices. We should provide an query
option like PARQUET_FALLBACK_SCHEMA_RESOLUTION for Parquet, to resolve ORC file
columns by names.
Note that Hive only writes column names to ORC files after Hive-2.x
(HIVE-4243). For older versions of Hive, the column names in ORC files are
something like _col0, _col1,....,_col99. So this feature is only required when
deployed with Hive 2+.
> Support resolving ORC file columns by names
> -------------------------------------------
>
> Key: IMPALA-9410
> URL: https://issues.apache.org/jira/browse/IMPALA-9410
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Priority: Major
>
> Currently we resolve ORC file columns by indices. We should provide an query
> option like PARQUET_FALLBACK_SCHEMA_RESOLUTION for Parquet (IMPALA-2835), to
> resolve ORC file columns by names.
> Note that Hive only writes column names to ORC files after Hive-2.x
> (HIVE-4243). For older versions of Hive, the column names in ORC files are
> something like _col0, _col1,....,_col99. So this feature is only required
> when deployed with Hive 2+.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
