[
https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352955#comment-16352955
]
Ajay Kumar commented on HDFS-13055:
-----------------------------------
[~anu] all the concerns you raised are valid. I would have also preferred pull
but current approach is outcome of existing architecture ( DataNodes send data
piggybacking on heartbeats over RPC). Aggregating it over javascript will be
clunky as it will add dependency on security policies of client infrastructure,
jmx and security config of Hadoop itself. The data reported to NN is 4 longs
per DN per 30 seconds which is a tiny compared to total data exchanged per
heartbeat, so the added NN load is miniscule.
> Aggregate usage statistics from datanodes
> -----------------------------------------
>
> Key: HDFS-13055
> URL: https://issues.apache.org/jira/browse/HDFS-13055
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Ajay Kumar
> Assignee: Ajay Kumar
> Priority: Major
> Attachments: HDFS-13055.001.patch
>
>
> We collect variety of statistics in DataNodes and expose them via JMX.
> Aggregating some of the high level statistics which we are already collecting
> in {{DataNodeMetrics}} (like bytesRead,bytesWritten etc) over a configurable
> time window will create a central repository accessible via JMX and UI.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
