[
https://issues.apache.org/jira/browse/HDFS-16331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tomscut updated HDFS-16331:
---------------------------
Description:
We have a cold data cluster, which stores as EC policy. There are 24 fast disks
on each node and each disk is 7 TB.
Recently, many nodes have more than 10 million blocks, and the interval of FBR
is 6h as default. Frequent FBR caused great pressure on NN.
!image-2021-11-18-09-35-35-400.png|width=334,height=229!
!image-2021-11-18-09-33-24-236.png|width=566,height=159!
We want to increase the interval of FBR, but have to rolling restart the DNs,
this operation is very heavy. In this scenario, it is necessary to make
_dfs.blockreport.intervalMsec_ reconfigurable.
was:
We have a cold data cluster, which stores as EC policy. There are 24 fast disks
on each node and each disk is 7 TB.
Recently, many nodes have more than 10 million blocks, and the interval of FBR
is 6h as default. Frequent FBR caused great pressure on NN.
!image-2021-11-18-09-35-35-400.png|width=491,height=337!
!image-2021-11-18-09-33-24-236.png|width=912,height=256!
We want to increase the interval of FBR, but have to rolling restart the DNs,
this operation is very heavy. In this scenario, it is necessary to make
_dfs.blockreport.intervalMsec_ reconfigurable.
> Make dfs.blockreport.intervalMsec reconfigurable
> ------------------------------------------------
>
> Key: HDFS-16331
> URL: https://issues.apache.org/jira/browse/HDFS-16331
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: tomscut
> Assignee: tomscut
> Priority: Major
> Attachments: image-2021-11-18-09-33-24-236.png,
> image-2021-11-18-09-35-35-400.png
>
>
> We have a cold data cluster, which stores as EC policy. There are 24 fast
> disks on each node and each disk is 7 TB.
> Recently, many nodes have more than 10 million blocks, and the interval of
> FBR is 6h as default. Frequent FBR caused great pressure on NN.
> !image-2021-11-18-09-35-35-400.png|width=334,height=229!
> !image-2021-11-18-09-33-24-236.png|width=566,height=159!
> We want to increase the interval of FBR, but have to rolling restart the DNs,
> this operation is very heavy. In this scenario, it is necessary to make
> _dfs.blockreport.intervalMsec_ reconfigurable.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
