[
https://issues.apache.org/jira/browse/HIVE-24824?focusedWorklogId=557193&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-557193
]
ASF GitHub Bot logged work on HIVE-24824:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 24/Feb/21 18:02
Start Date: 24/Feb/21 18:02
Worklog Time Spent: 10m
Work Description: pvargacl opened a new pull request #2016:
URL: https://github.com/apache/hive/pull/2016
### What changes were proposed in this pull request?
Create AcidMetricsService for future Acid and compaction related metrics.
Move the existing metrics from Initiator
### Why are the changes needed?
Make the metrics collection independent from the Initiator
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing unit tests.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 557193)
Remaining Estimate: 0h
Time Spent: 10m
> Define metrics for compaction observability
> -------------------------------------------
>
> Key: HIVE-24824
> URL: https://issues.apache.org/jira/browse/HIVE-24824
> Project: Hive
> Issue Type: Improvement
> Reporter: Peter Varga
> Assignee: Peter Varga
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Many times if there are failures in the Compaction background processes
> (Initiator, Worker, Cleaner) it is hard notice the problem until it causes
> serious performance degradation.
> We should create new JMX metrics, that would make it easier to monitor the
> compaction health. Examples are:
> * number of failed / initiated compaction
> * number of aborted txns, oldest aborted txns
> * tables with disabled compactions and writes
> * Initiator and Cleaner cycle runtime
> * Size of ACID metadata tables that should have ~ constant rows
> (txn_to_writeId, completed_txns)
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
