[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-25 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=491316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-491316
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 25/Sep/20 16:48
Start Date: 25/Sep/20 16:48
Worklog Time Spent: 10m 
  Work Description: goiri merged pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 491316)
Time Spent: 1.5h  (was: 1h 20m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-25 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=491315=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-491315
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 25/Sep/20 16:47
Start Date: 25/Sep/20 16:47
Worklog Time Spent: 10m 
  Work Description: goiri commented on pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#issuecomment-699035579


   There were a lot of failures because TestFileChecksum:
   
https://ci-hadoop.apache.org/job/hadoop-multibranch/view/change-requests/job/PR-2332/4/testReport/
   But they are not related.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 491315)
Time Spent: 1h 20m  (was: 1h 10m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-25 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=491103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-491103
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 25/Sep/20 13:42
Start Date: 25/Sep/20 13:42
Worklog Time Spent: 10m 
  Work Description: NickyYe commented on a change in pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#discussion_r494624826



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerSafeMode.java
##
@@ -309,16 +311,21 @@ String getSafeModeTip() {
 }
 
 if (datanodeThreshold > 0) {
-  int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
-  if (numLive < datanodeThreshold) {
-msg += String.format(
-"The number of live datanodes %d needs an additional %d live "
-+ "datanodes to reach the minimum number %d.%n",
-numLive, (datanodeThreshold - numLive), datanodeThreshold);
+  if (isBlockThresholdMet) {
+int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
+if (numLive < datanodeThreshold) {
+  msg += String.format(
+  "The number of live datanodes %d needs an additional %d live "
+  + "datanodes to reach the minimum number %d.%n",
+  numLive, (datanodeThreshold - numLive), datanodeThreshold);
+} else {
+  msg += String.format("The number of live datanodes %d has reached "
+  + "the minimum number %d. ",
+  numLive, datanodeThreshold);
+}
   } else {
-msg += String.format("The number of live datanodes %d has reached "
-+ "the minimum number %d. ",
-numLive, datanodeThreshold);
+msg += "The number of live datanodes is not calculated " +

Review comment:
   fixed.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 491103)
Time Spent: 1h 10m  (was: 1h)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-25 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=491053=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-491053
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 25/Sep/20 13:38
Start Date: 25/Sep/20 13:38
Worklog Time Spent: 10m 
  Work Description: goiri commented on pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#issuecomment-698636026


   Thanks @NickyYe for the StringBuilder, that will reduce some memory too.
   I'm a little surprised that Yetus is not kicking in.
   @ayushtkn are you familiar on how to kick it? And now that I have your 
attention... any issues you can see with changing the message.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 491053)
Time Spent: 1h  (was: 50m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-25 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=490836=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-490836
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 25/Sep/20 13:17
Start Date: 25/Sep/20 13:17
Worklog Time Spent: 10m 
  Work Description: goiri commented on a change in pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#discussion_r494462104



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerSafeMode.java
##
@@ -309,16 +311,21 @@ String getSafeModeTip() {
 }
 
 if (datanodeThreshold > 0) {
-  int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
-  if (numLive < datanodeThreshold) {
-msg += String.format(
-"The number of live datanodes %d needs an additional %d live "
-+ "datanodes to reach the minimum number %d.%n",
-numLive, (datanodeThreshold - numLive), datanodeThreshold);
+  if (isBlockThresholdMet) {
+int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
+if (numLive < datanodeThreshold) {
+  msg += String.format(
+  "The number of live datanodes %d needs an additional %d live "
+  + "datanodes to reach the minimum number %d.%n",
+  numLive, (datanodeThreshold - numLive), datanodeThreshold);
+} else {
+  msg += String.format("The number of live datanodes %d has reached "
+  + "the minimum number %d. ",
+  numLive, datanodeThreshold);
+}
   } else {
-msg += String.format("The number of live datanodes %d has reached "
-+ "the minimum number %d. ",
-numLive, datanodeThreshold);
+msg += "The number of live datanodes is not calculated " +

Review comment:
   As we are at it, does it make sense to use StringBuilder?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 490836)
Time Spent: 50m  (was: 40m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-24 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=490460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-490460
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 24/Sep/20 23:19
Start Date: 24/Sep/20 23:19
Worklog Time Spent: 10m 
  Work Description: goiri commented on pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#issuecomment-698636026


   Thanks @NickyYe for the StringBuilder, that will reduce some memory too.
   I'm a little surprised that Yetus is not kicking in.
   @ayushtkn are you familiar on how to kick it? And now that I have your 
attention... any issues you can see with changing the message.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 490460)
Time Spent: 40m  (was: 0.5h)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-24 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=490430=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-490430
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 24/Sep/20 21:36
Start Date: 24/Sep/20 21:36
Worklog Time Spent: 10m 
  Work Description: NickyYe commented on a change in pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#discussion_r494624826



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerSafeMode.java
##
@@ -309,16 +311,21 @@ String getSafeModeTip() {
 }
 
 if (datanodeThreshold > 0) {
-  int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
-  if (numLive < datanodeThreshold) {
-msg += String.format(
-"The number of live datanodes %d needs an additional %d live "
-+ "datanodes to reach the minimum number %d.%n",
-numLive, (datanodeThreshold - numLive), datanodeThreshold);
+  if (isBlockThresholdMet) {
+int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
+if (numLive < datanodeThreshold) {
+  msg += String.format(
+  "The number of live datanodes %d needs an additional %d live "
+  + "datanodes to reach the minimum number %d.%n",
+  numLive, (datanodeThreshold - numLive), datanodeThreshold);
+} else {
+  msg += String.format("The number of live datanodes %d has reached "
+  + "the minimum number %d. ",
+  numLive, datanodeThreshold);
+}
   } else {
-msg += String.format("The number of live datanodes %d has reached "
-+ "the minimum number %d. ",
-numLive, datanodeThreshold);
+msg += "The number of live datanodes is not calculated " +

Review comment:
   fixed.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 490430)
Time Spent: 0.5h  (was: 20m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-24 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=490313=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-490313
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 24/Sep/20 16:42
Start Date: 24/Sep/20 16:42
Worklog Time Spent: 10m 
  Work Description: goiri commented on a change in pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332#discussion_r494462104



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerSafeMode.java
##
@@ -309,16 +311,21 @@ String getSafeModeTip() {
 }
 
 if (datanodeThreshold > 0) {
-  int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
-  if (numLive < datanodeThreshold) {
-msg += String.format(
-"The number of live datanodes %d needs an additional %d live "
-+ "datanodes to reach the minimum number %d.%n",
-numLive, (datanodeThreshold - numLive), datanodeThreshold);
+  if (isBlockThresholdMet) {
+int numLive = blockManager.getDatanodeManager().getNumLiveDataNodes();
+if (numLive < datanodeThreshold) {
+  msg += String.format(
+  "The number of live datanodes %d needs an additional %d live "
+  + "datanodes to reach the minimum number %d.%n",
+  numLive, (datanodeThreshold - numLive), datanodeThreshold);
+} else {
+  msg += String.format("The number of live datanodes %d has reached "
+  + "the minimum number %d. ",
+  numLive, datanodeThreshold);
+}
   } else {
-msg += String.format("The number of live datanodes %d has reached "
-+ "the minimum number %d. ",
-numLive, datanodeThreshold);
+msg += "The number of live datanodes is not calculated " +

Review comment:
   As we are at it, does it make sense to use StringBuilder?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 490313)
Time Spent: 20m  (was: 10m)

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The number of live datanodes is not calculated since reported blocks hasn't 
> reached the threshold. Safe mode will be turned off automatically once the 
> thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Work logged] (HDFS-15594) Lazy calculate live datanodes in safe mode tip

2020-09-23 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15594?focusedWorklogId=489817=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-489817
 ]

ASF GitHub Bot logged work on HDFS-15594:
-

Author: ASF GitHub Bot
Created on: 23/Sep/20 20:12
Start Date: 23/Sep/20 20:12
Worklog Time Spent: 10m 
  Work Description: NickyYe opened a new pull request #2332:
URL: https://github.com/apache/hadoop/pull/2332


   https://issues.apache.org/jira/browse/HDFS-15594
   
   ## NOTICE
   
   Please create an issue in ASF JIRA before opening a pull request,
   and you need to set the title of the pull request which starts with
   the corresponding JIRA issue number. (e.g. HADOOP-X. Fix a typo in YYY.)
   For more details, please see 
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 489817)
Remaining Estimate: 0h
Time Spent: 10m

> Lazy calculate live datanodes in safe mode tip
> --
>
> Key: HDFS-15594
> URL: https://issues.apache.org/jira/browse/HDFS-15594
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: namenode
>Reporter: Ye Ni
>Assignee: Ye Ni
>Priority: Minor
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Safe mode tip is printed every 20 seconds.
> This change is to calculate live datanodes until reported block threshold is 
> meet.
>  Old 
> {code:java}
> STATE* Safe mode ON. The reported blocks 111054015 needs additional 27902753 
> blocks to reach the threshold 0.9990 of total blocks 139095856. The number of 
> live datanodes 2531 has reached the minimum number 1. Safe mode will be 
> turned off automatically once the thresholds have been reached.{code}
> New 
> {code:java}
> STATE* Safe mode ON. 
> The reported blocks 134851250 needs additional 3218494 blocks to reach the 
> threshold 0.9990 of total blocks 138207947.
> The minimum number of live datanodes is not calculated since reported blocks 
> hasn't reached the threshold. Safe mode will be turned off automatically once 
> the thresholds have been reached.{code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org