[
https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243909#comment-17243909
]
Yang Yun commented on HDFS-15655:
---------------------------------
Thanks [~ayushtkn] for the review.
Updated to HDFS-15655.005.patch with following changes,
* Rename DFS_NAMENODE_HOT_BLOCK_TIME_INTERVAL_KEY to
DFS_BALANCER_GETBLOCKS_HOT_TIME_INTERVAL_KEY.
* Typecast directly to INodeFile in the function isHotBlock and don't call
isHotBlock if timeInterval equal 0.
* Revert wrong change dfs.datanode.same-disk-tiering.enabled in
hdfs-default.xml.
* Refactor test to avoid using sleep.
* Add comments when deal with the pending blocks.
* Update Balancer doc in HDFSCommands.md.
> Add option to make balancer prefer to get cold blocks
> -----------------------------------------------------
>
> Key: HDFS-15655
> URL: https://issues.apache.org/jira/browse/HDFS-15655
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer & mover
> Reporter: Yang Yun
> Assignee: Yang Yun
> Priority: Minor
> Attachments: HDFS-15655.001.patch, HDFS-15655.002.patch,
> HDFS-15655.003.patch, HDFS-15655.004.patch, HDFS-15655.005.patch
>
>
> We met two issues when using balancer.
> # Moving hot files may cause failing of dfsclient reading.
> # Some blocks of temporary files are moved and they are deleted soon.
> Add a config key " dfs.namenode.hot.block.time.interval", the balancer
> prefer to get the blocks which are belong to the cold files created before
> this time period.
> Also add a option "-hotBlockTimeInterval" to the command line of balancer for
> inputting.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
