Sai Hemanth Gantasala has posted comments on this change. ( http://gerrit.cloudera.org:8080/20507 )
Change subject: IMPALA-12460: Add lag and histogram of event processing in the log ...................................................................... Patch Set 4: (1 comment) http://gerrit.cloudera.org:8080/#/c/20507/4/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java File fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java: http://gerrit.cloudera.org:8080/#/c/20507/4/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java@1075 PS4, Line 1075: eventProcessingTime.put(event, elapsedTimeMs); This can override the last maximum value. For example, in a batch, there are two insert table events, i1 and i2. First i1 is processed and it takes 1000ms. And then i2 is processed and it takes 10ms. eventProcessingTime map will have 10ms at the end of the batch. So this logic should be something like this: eventProcessingTime.put(event, Math.max(elapsedTimeMs , eventProcessingTime.getOrDefault(event, 0L)); -- To view, visit http://gerrit.cloudera.org:8080/20507 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ib9421b5e26bfa2324217ec9695fbd81636727d22 Gerrit-Change-Number: 20507 Gerrit-PatchSet: 4 Gerrit-Owner: Quanlong Huang <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Kurt Deschler <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]> Gerrit-Comment-Date: Mon, 25 Sep 2023 23:54:14 +0000 Gerrit-HasComments: Yes
