[
https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993912#comment-15993912
]
Tsz Wo Nicholas Sze edited comment on HDFS-11742 at 5/2/17 10:40 PM:
---------------------------------------------------------------------
What we need is HDFS-7639. The number of moves should NOT be limited by the
number of threads; see [this
comment|https://issues.apache.org/jira/browse/HDFS-7639?focusedCommentId=14284292&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14284292].
was (Author: szetszwo):
What we need is HDFS-7639. The number of moves should be limited by the number
of threads; see [this
comment|https://issues.apache.org/jira/browse/HDFS-7639?focusedCommentId=14284292&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14284292].
> Revert the core changes from HDFS-8818
> --------------------------------------
>
> Key: HDFS-11742
> URL: https://issues.apache.org/jira/browse/HDFS-11742
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Kihwal Lee
> Assignee: Kihwal Lee
> Priority: Blocker
> Attachments: HDFS-11742.branch-2.8.patch, HDFS-11742.branch-2.patch,
> HDFS-11742.trunk.patch
>
>
> This is to revert the core changes made by HDFS-8818. The reason is explained
> in the jira comments. HDFS-8818 put in config and logging changes that are
> tied to the core change. I will leave them as is.
> We ran 2.8 balancer with HDFS-8818 on a 280-node and a 2,400-node cluster. In
> both cases, it would hang forever after two iterations. The two iterations
> were also moving things at a significantly lower rate. The hang itself is
> fixed by HDFS-11377, but the design limitation remains, so the balancer
> throughput ends up actually lower.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
