[
https://issues.apache.org/jira/browse/HDFS-16331?focusedWorklogId=687091&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-687091
]
ASF GitHub Bot logged work on HDFS-16331:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Nov/21 02:58
Start Date: 29/Nov/21 02:58
Worklog Time Spent: 10m
Work Description: tomscut edited a comment on pull request #3676:
URL: https://github.com/apache/hadoop/pull/3676#issuecomment-981190467
> In the following code, `datanode.getDnConf().getBlockReportInterval()` can
not get the reconfigured property. Do we need to fix it?
>
>
https://github.com/apache/hadoop/blob/c9d64bad37fbfbaa77481f67338b39a029d7dc51/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java#L2626
Hi @tasanuma , I fixed this. PTAL. Thank you very much.
In addition, I find that `case DFS_DATANODE_DATA_DIR_KEY` and `case
DFS_DATANODE_BALANCE_MAX_NUM_CONCURRENT_MOVES_KEY` are indented too much (two
more indented), do I need to fix them?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 687091)
Time Spent: 2h 20m (was: 2h 10m)
> Make dfs.blockreport.intervalMsec reconfigurable
> ------------------------------------------------
>
> Key: HDFS-16331
> URL: https://issues.apache.org/jira/browse/HDFS-16331
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: tomscut
> Assignee: tomscut
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2021-11-18-09-33-24-236.png,
> image-2021-11-18-09-35-35-400.png
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> We have a cold data cluster, which stores as EC policy. There are 24 fast
> disks on each node and each disk is 7 TB.
> Recently, many nodes have more than 10 million blocks, and the interval of
> FBR is 6h as default. Frequent FBR caused great pressure on NN.
> !image-2021-11-18-09-35-35-400.png|width=334,height=229!
> !image-2021-11-18-09-33-24-236.png|width=566,height=159!
> We want to increase the interval of FBR, but have to rolling restart the DNs,
> this operation is very heavy. In this scenario, it is necessary to make
> _dfs.blockreport.intervalMsec_ reconfigurable.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
