[
https://issues.apache.org/jira/browse/IMPALA-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584816#comment-17584816
]
ASF subversion and git services commented on IMPALA-9410:
---------------------------------------------------------
Commit 051c59bd80dfb8291dd4ef61419db7db2c41cab4 in impala's branch
refs/heads/branch-4.1.1 from Gergely Fürnstáhl
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=051c59bd8 ]
IMPALA-9410: Support resolving ORC file columns by names
Added query option and implementation to be able to resolve columns by
names.
Changed secondary resolution strategy for iceberg orc tables to name
based resolution.
Testing:
Added new test dimension for orc tests, added results to now working
iceberg migrated table test
Change-Id: I29562a059160c19eb58ccea76aa959d2e408f8de
Reviewed-on: http://gerrit.cloudera.org:8080/18397
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-on: http://gerrit.cloudera.org:8080/18906
Reviewed-by: Zoltan Borok-Nagy <[email protected]>
Tested-by: Quanlong Huang <[email protected]>
> Support resolving ORC file columns by names
> -------------------------------------------
>
> Key: IMPALA-9410
> URL: https://issues.apache.org/jira/browse/IMPALA-9410
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Reporter: Quanlong Huang
> Assignee: Gergely Fürnstáhl
> Priority: Major
> Labels: orc
> Fix For: Impala 4.2.0
>
>
> Currently we resolve ORC file columns by indices. We should provide an query
> option like PARQUET_FALLBACK_SCHEMA_RESOLUTION for Parquet (IMPALA-2835), to
> resolve ORC file columns by names.
> Note that Hive only writes column names to ORC files after Hive-2.x
> (HIVE-4243). For older versions of Hive, the column names in ORC files are
> something like _col0, _col1,....,_col99. So this feature is only required
> when deployed with Hive 2+.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
