[
https://issues.apache.org/jira/browse/HADOOP-14492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039792#comment-16039792
]
Erik Krogen edited comment on HADOOP-14492 at 6/6/17 10:39 PM:
---------------------------------------------------------------
Hey [~cltlfcjin] - these metrics can be different since the RpcDetailed metric
is the time to complete a DN's entire block report, which may include multiple
storages (more than one value for {{dfs.datanode.data.dir}}), each of which
contributes to the NameNodeActivity metric. In the cluster this was recorded
from, do your datanodes run with multiple storages?
Assigning to myself in case there is in fact a bug since HADOOP-13782 was my
patch.
was (Author: xkrogen):
Hey [~cltlfcjin] - these metrics can be different since the RpcDetailed metric
is the time to complete a DN's entire block report, which may include multiple
storages (more than one value for {{dfs.datanode.data.dir}}), each of which
contributes to the NameNodeActivity metric. In the cluster this was recorded
from, do your datanodes run with multiple storages?
> RpcDetailedMetrics and NameNodeMetrics use different rate metrics abstraction
> cause the Xavgtime confused
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-14492
> URL: https://issues.apache.org/jira/browse/HADOOP-14492
> Project: Hadoop Common
> Issue Type: Bug
> Components: metrics
> Affects Versions: 2.8.0, 2.7.4
> Reporter: Lantao Jin
> Assignee: Erik Krogen
> Priority: Minor
>
> For performance purpose,
> [HADOOP-13782|https://issues.apache.org/jira/browse/HADOOP-13782] change the
> metrics behaviour in {{RpcDetailedMetrics}}.
> In 2.7.4:
> {code}
> public class RpcDetailedMetrics {
> @Metric MutableRatesWithAggregation rates;
> {code}
> In old version:
> {code}
> public class RpcDetailedMetrics {
> @Metric MutableRates rates;
> {code}
> But {{NameNodeMetrics}} still use {{MutableRate}} whatever in the new or old
> version:
> {code}
> public class NameNodeMetrics {
> @Metric("Block report") MutableRate blockReport;
> {code}
> It causes the metrics in JMX very different between them.
> {quote}
> name: "Hadoop:service=NameNode,name=RpcDetailedActivityForPort8030",
> modelerType: "RpcDetailedActivityForPort8030",
> tag.port: "8030",
> tag.Context: "rpcdetailed",
> ...
> BlockReportNumOps: 237634,
> BlockReportAvgTime: 1382,
> ...
> name: "Hadoop:service=NameNode,name=NameNodeActivity",
> modelerType: "NameNodeActivity",
> tag.ProcessName: "NameNode",
> ...
> BlockReportNumOps: 2592932,
> BlockReportAvgTime: 19.258064516129032,
> ...
> {quote}
> In the old version. They are correct.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
