[
https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911756#comment-16911756
]
Wei-Chiu Chuang commented on HDFS-10782:
----------------------------------------
Correct myself. I reviewed the patch, and this really need a test. Shouldn't be
too hard to come up with one.
Would this make getBlocks() slow when balancer asks NameNode for blocks? This
patch adds a new ArrayList which can potentially grow up to several millions of
elements, which is ok-ish.
> Decrease memory frequent exchange of Centralized Cache Management when run
> balancer
> -----------------------------------------------------------------------------------
>
> Key: HDFS-10782
> URL: https://issues.apache.org/jira/browse/HDFS-10782
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover, caching
> Affects Versions: 2.7.1
> Reporter: He Xiaoqiao
> Assignee: He Xiaoqiao
> Priority: Major
> Labels: patch
> Attachments: HDFS-10782-branch-2.001.patch
>
>
> CachedBlocks currently are transparent for Balancer when active feature of
> centralized cache management. This makes DataNode exchange memory frequently,
> because Balancer does not Distinguish CachedBlock from blocks, so it may
> trigger mount of cached/uncached ops.
> I think namenode should avoid return CacheBlocks as much as possible when
> Balanacer#getblocks.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
