[
https://issues.apache.org/jira/browse/IMPALA-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy resolved IMPALA-11210.
----------------------------------------
Fix Version/s: Impala 4.1.0
Resolution: Fixed
> Impala can only handle lowercase schema elements of Iceberg table
> -----------------------------------------------------------------
>
> Key: IMPALA-11210
> URL: https://issues.apache.org/jira/browse/IMPALA-11210
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 4.1.0
>
>
> When Impala/Hive creates a table they lowercase the schema elements.
> Impala even has precondition checks that the schema elements are lower case:
> [https://github.com/apache/impala/blob/b1c1be12f3cceed48e93eddae8b9512737e3e0d2/fe/src/main/java/org/apache/impala/catalog/Column.java#L56]
> But when an Iceberg table is created via Spark it doesn't lowercase the
> column names, so the metadata.json file looks like this:
> {noformat}
> ...
> "schema" : {
> "type" : "struct",
> "schema-id" : 0,
> "fields" : [ {
> "id" : 1,
> "name" : "Region",
> "required" : false,
> "type" : "string"
> }, {
> ...
> {noformat}
> Hence when Impala tries to load such tables it runs to the above precondition
> check which raises an IllegalStateException.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
