[ 
https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397888#comment-16397888
 ] 

Arpit Agarwal commented on HDFS-13055:
--------------------------------------

I think this patch will benefit from splitting into smaller tasks which can be 
unit tested in isolation. e.g.
 # Generate usage report on DN.
 # Pass usage report to NN periodically.
 # Process report on NN and expose stats via JMX.

> Aggregate usage statistics from datanodes
> -----------------------------------------
>
>                 Key: HDFS-13055
>                 URL: https://issues.apache.org/jira/browse/HDFS-13055
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Ajay Kumar
>            Assignee: Ajay Kumar
>            Priority: Major
>         Attachments: HDFS-13055.001.patch, HDFS-13055.002.patch, 
> HDFS-13055.003.patch, HDFS-13055.004.patch, HDFS-13055.005.patch, 
> HDFS-13055.006.patch
>
>
> We collect variety of statistics in DataNodes and expose them via JMX. 
> Aggregating some of the high level statistics which we are already collecting 
> in {{DataNodeMetrics}} (like bytesRead,bytesWritten etc) over a configurable 
> time window will create a central repository accessible via JMX and UI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to