[
https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237226#comment-17237226
]
Yang Yun commented on HDFS-15655:
---------------------------------
[~hexiaoqiao]， I can not get the detailed exception for this is old issue in
our customer's hbase setup. They often handle with many big temporary files
with cached block location information. if the balancer is running, The
availability of services is severely reduced. They dare not use balancer for a
long time. After this fix, the balancer can run again without impacting the
availability.
Thanks [~ayushtkn] for your explanation。
> Add option to make balancer prefer to get cold blocks
> -----------------------------------------------------
>
> Key: HDFS-15655
> URL: https://issues.apache.org/jira/browse/HDFS-15655
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover
> Reporter: Yang Yun
> Assignee: Yang Yun
> Priority: Minor
> Attachments: HDFS-15655.001.patch, HDFS-15655.002.patch,
> HDFS-15655.003.patch, HDFS-15655.004.patch
>
>
> We met two issues when using balancer.
> # Moving hot files may cause failing of dfsclient reading.
> # Some blocks of temporary files are moved and they are deleted soon.
> Add a config key " dfs.namenode.hot.block.time.interval", the balancer
> prefer to get the blocks which are belong to the cold files created before
> this time period.
> Also add a option "-hotBlockTimeInterval" to the command line of balancer for
> inputting.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
