[jira] [Created] (IMPALA-12509) Starting backend is very slow when querying an Iceberg table with a large number of files

Fri, 20 Oct 2023 04:01:17 -0700 

Fu Lili created IMPALA-12509:
--------------------------------

             Summary: Starting backend is very slow when querying an Iceberg 
table with a large number of files
                 Key: IMPALA-12509
                 URL: https://issues.apache.org/jira/browse/IMPALA-12509
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Fu Lili


We found that when querying an Iceberg table with a large number of files 
(>=200000), the Query Plan and start backends took an abnormal time (>= 2s). 
The reason was that unnecessary objects were serialized when building 
TQueryCtx. The main function involved is IcebergTable::toThriftDescriptor



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to