Zoltán Borók-Nagy created IMPALA-10569:
------------------------------------------
Summary: Impala should determine Iceberg data file format from
Iceberg metadata
Key: IMPALA-10569
URL: https://issues.apache.org/jira/browse/IMPALA-10569
Project: IMPALA
Issue Type: Bug
Reporter: Zoltán Borók-Nagy
When Impala creates an Iceberg table it sets HMS table property
'iceberg.file_format' to indicate the underlying data file format.
However, when the table was created by Hive or Spark, we don't have this
property and Impala assumes that the data file format is PARQUET. This
assumption is just a wild guess, and when it's wrong Impala raises an error
during query execution.
Instead of only checking the table property, Impala could also try to determine
the file format based on Iceberg metadata.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
