Zoltán Borók-Nagy created IMPALA-11053:
------------------------------------------
Summary: Impala should be able to read migrated partitioned
Iceberg tables
Key: IMPALA-11053
URL: https://issues.apache.org/jira/browse/IMPALA-11053
Project: IMPALA
Issue Type: Bug
Reporter: Zoltán Borók-Nagy
When Hive (and probably other engines as well) converts a legacy Hive table to
Iceberg it doesn't rewrite the data files.
It means that the data files don't have write ids, moreover they don't have the
partition columns neither.
Currently Impala expects tha partition columns to be present in the data files,
so it won't be able to read converted partitioned tables.
So we need to inject partition values from the Iceberg metadata, plus resolve
columns correctly (position-based resolution needs an offset).
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
