[
https://issues.apache.org/jira/browse/IMPALA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy resolved IMPALA-13463.
----------------------------------------
Fix Version/s: Impala 4.5.0
Resolution: Fixed
> Impala should ignore case of Iceberg schema elements
> ----------------------------------------------------
>
> Key: IMPALA-13463
> URL: https://issues.apache.org/jira/browse/IMPALA-13463
> Project: IMPALA
> Issue Type: Bug
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 4.5.0
>
>
> Schema is case insensitive in Impala.
> Via Spark it's possible to create schema elements with upper/lower case
> letters and store them in the metadata JSON files of Iceberg, e.g.:
> {noformat}
> "schemas" : [ {
> "type" : "struct",
> "schema-id" : 0,
> "fields" : [ {
> "id" : 1,
> "name" : "ID",
> "required" : false,
> "type" : "string"
> }, {
> "id" : 2,
> "name" : "OWNERID",
> "required" : false,
> "type" : "string"
> } ]
> } ],
> {noformat}
> This can cause problems in Impala during predicate pushdown, as we can get a
> ValidationException from the Iceberg library (as Impala pushes down
> predicates with lower case column names, while Iceberg sees upper case names).
> We should invoke Scan.caseSensitive(boolean caseSensitive) on the TableScan
> object to set case insensitivity.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
