[
https://issues.apache.org/jira/browse/HIVE-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated HIVE-10761:
-----------------------------
Attachment: HIVE-10761.patch
Review board:
[https://reviews.apache.org/r/34447/|https://reviews.apache.org/r/34447/]
This adds a codahale-based metrics system to HiveServer2 and HiveMetastore.
Metrics implementation is now internally pluggable, and the existing Metrics
system can be re-enabled by configuration if desired for backward-compatibility.
Following metrics are supported by Metrics system:
1. JVMPauseMonitor (used to call Hadoop's internal implementation, now forked
off to integrate with Metrics system)
2. HMS API calls
3. Standard JVM metrics (only for new implementation, as its free with
codahale).
The following metrics reporting are supported by new system (configuration
exposed)
1. JMX
2. CONSOLE
3. JSON_FILE (periodic file of metrics that gets overwritten).
An eventual goal is to add a web-server that exposes the JSON metrics, but this
will defer to a later JIRA.
> Create codahale-based metrics system for Hive
> ---------------------------------------------
>
> Key: HIVE-10761
> URL: https://issues.apache.org/jira/browse/HIVE-10761
> Project: Hive
> Issue Type: New Feature
> Components: Diagnosability
> Reporter: Szehon Ho
> Assignee: Szehon Ho
> Attachments: HIVE-10761.patch, hms-metrics.json
>
>
> There is a current Hive metrics system that hooks up to a JMX reporting, but
> all its measurements, models are custom.
> This is to make another metrics system that will be based on Codahale (ie
> yammer, dropwizard), which has the following advantage:
> * Well-defined metric model for frequently-needed metrics (ie JVM metrics)
> * Well-defined measurements for all metrics (ie max, mean, stddev, mean_rate,
> etc),
> * Built-in reporting frameworks like JMX, Console, Log, JSON webserver
> It is used for many projects, including several Apache projects like Oozie.
> Overall, monitoring tools should find it easier to understand these common
> metric, measurement, reporting models.
> The existing metric subsystem will be kept and can be enabled if backward
> compatibility is desired.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
