Zoltán Borók-Nagy created IMPALA-11210:
------------------------------------------
Summary: Impala can only handle lowercase schema elements of
Iceberg table
Key: IMPALA-11210
URL: https://issues.apache.org/jira/browse/IMPALA-11210
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: Zoltán Borók-Nagy
When Impala/Hive creates a table they lowercase the schema elements.
Impala even has precondition checks that the schema elements are lower case:
[https://github.com/apache/impala/blob/b1c1be12f3cceed48e93eddae8b9512737e3e0d2/fe/src/main/java/org/apache/impala/catalog/Column.java#L56]
But when an Iceberg table is created via Spark it doesn't lowercase the column
names, so the metadata.json file looks like this:
{noformat}
...
"schema" : {
"type" : "struct",
"schema-id" : 0,
"fields" : [ {
"id" : 1,
"name" : "Region",
"required" : false,
"type" : "string"
}, {
...
{noformat}
Hence when Impala tries to load such tables it runs to the above precondition
check which raises an IllegalStateException.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
