Zoltán Borók-Nagy created IMPALA-10254:
------------------------------------------
Summary: Load data files via Iceberg for Iceberg Tables
Key: IMPALA-10254
URL: https://issues.apache.org/jira/browse/IMPALA-10254
Project: IMPALA
Issue Type: Bug
Reporter: Zoltán Borók-Nagy
Currently we still load the file descriptors of an Iceberg table via recursive
file listing.
This lists too many files, e.g. metadata files, files that are being written
(can later throw checksum errors), files from aborted INSERTs, removed files,
etc.
We should use the Iceberg API to load the file descriptors corresponding to the
table snapshot.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
