Csaba Ringhofer created IMPALA-12162:
----------------------------------------

             Summary: makeInsertEventData() can be slow during ACID writes
                 Key: IMPALA-12162
                 URL: https://issues.apache.org/jira/browse/IMPALA-12162
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Csaba Ringhofer


Saw some INSERTs where most of the time was spent in
https://github.com/apache/impala/blob/dc63ae514a445e3f197cab405b01a30c58015695/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java#L7011

This was surprising, as I assumed that most of the time in 
updateCatalog()/createInsertEvents() is spent in HMS RPCs, but in the jstacks I 
saw it was mainly in calls to HDFS to compute checksum of files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to