Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/20473 )
Change subject: IMPALA-11553: Add event specific metrics in the table metrics ...................................................................... IMPALA-11553: Add event specific metrics in the table metrics This patch adds an event specific metric "avg-events-process-duration" at the table level metrics. This metric is also extended to last 1min, 5mins, 15mins duration. This metric is useful to identify the average events processed duration on the table. This is helpful to identify if a particular table is causing event procssor lagging and as a temporary workaround, event processing can be disabled on that table. Another metric is also added in the event processor summary page, "events-consuming-delay-ms", is the time difference in milliseconds of the event created in the metastore and event processed by event processor. This is another useful metric to gauge how the event processor is lagging. Tests: - Manually verified the metrics on catalogD UI page when running some hive workloads. Change-Id: I2428029361e610a0fcd8ed11be2ab771f03b00dd Reviewed-on: http://gerrit.cloudera.org:8080/20473 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M fe/src/main/java/org/apache/impala/catalog/Table.java M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEventsProcessor.java M tests/custom_cluster/test_events_custom_configs.py M tests/webserver/test_web_pages.py 5 files changed, 76 insertions(+), 24 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/20473 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I2428029361e610a0fcd8ed11be2ab771f03b00dd Gerrit-Change-Number: 20473 Gerrit-PatchSet: 13 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Anonymous Coward <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]>
