[
https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149759#comment-16149759
]
Andrew Wang commented on HDFS-12043:
------------------------------------
Bit of unfortunate history on this JIRA, looks like alpha4 was released between
the initial bad commit and the subsequent revert and re-commit.
I'm going to change the fix version to 3.0.0-beta1, since that's where the
correct version will be released.
> Add counters for block re-replication
> -------------------------------------
>
> Key: HDFS-12043
> URL: https://issues.apache.org/jira/browse/HDFS-12043
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Chen Liang
> Assignee: Chen Liang
> Fix For: 2.9.0, 3.0.0-beta1
>
> Attachments: HDFS-12043.001.patch, HDFS-12043.002.patch,
> HDFS-12043.003.patch, HDFS-12043.004.patch, HDFS-12043-branch-2.005.patch
>
>
> We occasionally see that the under-replicated block count is not going down
> quickly enough. We've made at least one fix to speed up block replications
> (HDFS-9205) but we need better insight into the current state and activity of
> the block re-replication logic. For example, we need to understand whether is
> it because re-replication is not making forward progress at all, or is it
> because new under-replicated blocks are being added faster.
> We should include additional metrics:
> # Cumulative number of blocks that were successfully replicated.
> # Cumulative number of re-replications that timed out.
> # Cumulative number of blocks that were dequeued for re-replication but not
> scheduled e.g. because they were invalid, or under-construction or
> replication was postponed.
>
> The growth rate of of the above metrics will make it clear whether block
> replication is making forward progress and if not then provide potential
> clues about why it is stalled.
> Thanks [~arpitagarwal] for the offline discussions.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
