[
https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741711#comment-14741711
]
Ming Ma commented on HDFS-8874:
-------------------------------
Thanks [~ctrezzo].
* If the new {{receiveBlock}} returns false due to balanceThrottler limit, it
seems {{addReplaceBlockOp}} still gets called.
* The new functions {{sendBlock}} and {{receiveBlock}} don't cover the regular
read and write scenarios. So maybe it is better to use different names like
{{copyBlockInt}}, {{replaceBlockInt}}.
> Add DN metrics for balancer and other block movement scenarios
> --------------------------------------------------------------
>
> Key: HDFS-8874
> URL: https://issues.apache.org/jira/browse/HDFS-8874
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Ming Ma
> Assignee: Chris Trezzo
> Attachments: HDFS-8874-trunk-v1.patch, HDFS-8874-trunk-v2.patch,
> HDFS-8874-trunk-v3.patch
>
>
> For balancer, mover and migrator (HDFS-8789), we want to know how close it is
> to the DN's throttling thresholds. Although DN has existing metrics such as
> {{BytesWritten}}, {{BytesRead}}, {{CopyBlockOpNumOps}} and
> {{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number of bytes
> moved.
> We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account
> for the bytes moved in ReplaceBlock and CopyBlock operations. In addition, we
> can also add throttling metrics for {{DataTransferThrottler}} and
> {{BlockBalanceThrottler}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
