[
https://issues.apache.org/jira/browse/HDFS-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Suresh Srinivas updated HDFS-4892:
----------------------------------
Description:
Currently a datanode reports the transceiver count to namenode. Namenode
aggregates this as TotalLoad metrics and is used for monitoring cluster
activity. It is also used for making block placement decision, to qualify if a
datanode is a good target.
Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of
readers) + 2 * (Number of writers in pipeline) + 1 * (number of datanode
replications) + 1 * (number of recover blocks)
Should the number of transceiver just reflect number of readers + writers,
instead of reporting it as is currently done. Separately we should perhaps
report readers and writers as separate count.
was:
Currently a datanode reports the transceiver count to namenode. Namenode
aggregates this as TotalLoad metrics and is used for monitoring cluster
activity. It is also used for making block placement decision, to qualify if a
datanode is a good target.
Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of
readers) + 2 * (Number of writers in pipeline) + 1 * (number of datanode
replications) + 1 * (number of recover blocks)
Should the number of transceiver just reflect number of readers + writers,
instead of reporting it as is currently done. Separately we should perhaps
report readers and writers as separate count.
This
> Number of transceivers reported by the datanode is incorrect
> ------------------------------------------------------------
>
> Key: HDFS-4892
> URL: https://issues.apache.org/jira/browse/HDFS-4892
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 2.0.0-alpha
> Reporter: Suresh Srinivas
>
> Currently a datanode reports the transceiver count to namenode. Namenode
> aggregates this as TotalLoad metrics and is used for monitoring cluster
> activity. It is also used for making block placement decision, to qualify if
> a datanode is a good target.
> Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of
> readers) + 2 * (Number of writers in pipeline) + 1 * (number of datanode
> replications) + 1 * (number of recover blocks)
> Should the number of transceiver just reflect number of readers + writers,
> instead of reporting it as is currently done. Separately we should perhaps
> report readers and writers as separate count.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
