J.Andreina created HDFS-3325: -------------------------------- Summary: When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or equal to 1 there is mismatch in the UI report Key: HDFS-3325 URL: https://issues.apache.org/jira/browse/HDFS-3325 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 2.0.0 Reporter: J.Andreina Fix For: 2.0.0, 3.0.0
When dfs.namenode.safemode.threshold-pct is configured to n Namenode will be in safemode until n percentage of blocks that should satisfy the minimal replication requirement defined by dfs.namenode.replication.min is reported to namenode But in UI it displays that n percentage of total blocks + 1 blocks are additionally needed to come out of the safemode Scenario 1: ============ Configurations: dfs.namenode.safemode.threshold-pct = 2 dfs.replication = 2 dfs.namenode.replication.min =2 Step 1: Start NN,DN1,DN2 Step 2: Write a file "a.txt" which has got 167 blocks step 3: Stop NN,DN1,DN2 Step 4: start NN In UI report the Number of blocks needed to come out of safemode and number of blocks actually present is different. {noformat} Cluster Summary Security is OFF Safe mode is ON. The reported blocks 0 needs additional 335 blocks to reach the threshold 2.0000 of total blocks 167. Safe mode will be turned off automatically. 2 files and directories, 167 blocks = 169 total. Heap Memory used 57.05 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory is 2 GB. Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. Max Non Heap Memory is 176 MB.{noformat} Scenario 2: =========== Configurations: dfs.namenode.safemode.threshold-pct = 1 dfs.replication = 2 dfs.namenode.replication.min =2 Step 1: Start NN,DN1,DN2 Step 2: Write a file "a.txt" which has got 167 blocks step 3: Stop NN,DN1,DN2 Step 4: start NN In UI report the Number of blocks needed to come out of safemode and number of blocks actually present is different {noformat} Cluster Summary Security is OFF Safe mode is ON. The reported blocks 0 needs additional 168 blocks to reach the threshold 1.0000 of total blocks 167. Safe mode will be turned off automatically. 2 files and directories, 167 blocks = 169 total. Heap Memory used 56.2 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory is 2 GB. Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. Max Non Heap Memory is 176 MB.{noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira