guangxiji created IMPALA-14659:
----------------------------------
Summary: Impala 4.5 Iceberg table on Tencent Cloud COS fails
with"failedto load 1 paths" during metadata refresh.
Key: IMPALA-14659
URL: https://issues.apache.org/jira/browse/IMPALA-14659
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Affects Versions: Impala 4.5.0
Reporter: guangxiji
Attachments: impala_log.txt
I applied {{--max_nonhdfs_partitions_parallel_load=1}} and
{{--max_hdfs_partitions_parallel_load=1}} to my {{catalogd_flags}} and
restarted the service. Unfortunately, the issue persists even with
single-threaded loading.
It seems that in Impala 4.5, {{ParallelFileMetadataLoader}} encounters
difficulties when processing metadata returned by the {{cosn://}} driver,
regardless of the thread count. This suggests there might be a specific
compatibility issue with how file/block metadata is interpreted for this
storage scheme.
Below are the raw logs from my session showing that {*}SHOW METADATA{*},
{*}INSERT{*}, and *SELECT* all trigger the same metadata loading error:
[9.192.163.17:21050] db_on_cos_test> SHOW METADATA TABLES IN
iceberg_cos_employee_test;
Query: SHOW METADATA TABLES IN iceberg_cos_employee_test
2026-01-05 22:28:58 [Exception] ERROR: Query 9349f0ef1c788ec2:8548051e00000000
failed:
AnalysisException: Could not load table
db_on_cos_test.iceberg_cos_employee_test from catalog
... (此处省略部分重复输出以保持简洁，或按您要求保留全部) ...
CAUSED BY: TableLoadingException: Loading file and block metadata for 1 paths
for table db_on_cos_test.iceberg_cos_employee_test: failed to load 1 paths.
Check the catalog server log for more details.
[9.192.163.17:21050] db_on_cos_test> INSERT INTO iceberg_cos_employee_test
VALUES (1, '张三', '研发部', 15001.5, now());
Query: INSERT INTO iceberg_cos_employee_test VALUES (1, '张三', '研发部', 15001.5,
now())
Query submitted at: 2026-01-05 22:29:08 (Coordinator: http://9.192.163.17:8080)
2026-01-05 22:29:08 [Exception] ERROR: Query ad4f18bf73bf1157:772c7c7600000000
failed:
AnalysisException: org.apache.impala.catalog.TableLoadingException: Could not
load table db_on_cos_test.iceberg_cos_employee_test from catalog
...
CAUSED BY: TableLoadingException: Loading file and block metadata for 1 paths
for table db_on_cos_test.iceberg_cos_employee_test: failed to load 1 paths.
[9.192.163.17:21050] db_on_cos_test> select * from iceberg_cos_employee_test;
Query: select * from iceberg_cos_employee_test
Query submitted at: 2026-01-05 22:30:42 (Coordinator: http://9.192.163.17:8080)
2026-01-05 22:30:42 [Exception] ERROR: Query 274fea8afd3f9dde:8d9847ab00000000
failed:
AnalysisException: Failed to load metadata for table:
'iceberg_cos_employee_test'
...
CAUSED BY: TableLoadingException: Loading file and block metadata for 1 paths
for table db_on_cos_test.iceberg_cos_employee_test: failed to load 1 paths.
I have attached the full *catalogd logs* to this email for further
investigation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
