[
https://issues.apache.org/jira/browse/HDFS-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qi Zhu updated HDFS-15874:
--------------------------
Description:
Now top metrics for namenode op is only supported aggregation for user, the
top user op is useful.
But actually, the most useful is the callerContext aggregation, we can use this
to aggregate the running apps in yarn or the scheduling jobs by extend the
callerContext in such as (oozie or airflow), so that we can get the real time
top pressure to namenode.
cc [~weichiu] [~hexiaoqiao] [~ayushtkn] [~shv] [~ferhui]
was:
Now top metrics for namenode op is only supported aggregation for user, the
top user op is useful.
But actually, the most useful is the callerContext aggregation, we can use this
to aggregate the running apps in yarn or the scheduling jobs by extend the
callerContext in such as (oozie or airflow), so that we can get the real time
top pressure to namenode.
cc [~weichiu] [~hexiaoqiao] [~ayushtkn] [~shv]
> Extend TopMetrics to support callerContext aggregation.
> -------------------------------------------------------
>
> Key: HDFS-15874
> URL: https://issues.apache.org/jira/browse/HDFS-15874
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Qi Zhu
> Assignee: Qi Zhu
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2021-03-05-12-01-16-852.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Now top metrics for namenode op is only supported aggregation for user, the
> top user op is useful.
> But actually, the most useful is the callerContext aggregation, we can use
> this to aggregate the running apps in yarn or the scheduling jobs by extend
> the callerContext in such as (oozie or airflow), so that we can get the real
> time top pressure to namenode.
> cc [~weichiu] [~hexiaoqiao] [~ayushtkn] [~shv] [~ferhui]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
