[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[ https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=552624=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-552624 ] ASF GitHub Bot logged work on HDFS-15821: - Author: ASF GitHub Bot Created on: 15/Feb/21 17:14 Start Date: 15/Feb/21 17:14 Worklog Time Spent: 10m Work Description: jbrennan333 merged pull request #2690: URL: https://github.com/apache/hadoop/pull/2690 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 552624) Time Spent: 1h 20m (was: 1h 10m) > Add metrics for in-service datanodes > > > Key: HDFS-15821 > URL: https://issues.apache.org/jira/browse/HDFS-15821 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Zehao Chen >Assignee: Zehao Chen >Priority: Minor > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > We currently have metrics for live datanodes but some of the datanodes may be > in decommissioning state or maintenance state. Adding this metric allows us > to know how many nodes are currently in service, where NumInServiceDatanodes > = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[ https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=552622=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-552622 ] ASF GitHub Bot logged work on HDFS-15821: - Author: ASF GitHub Bot Created on: 15/Feb/21 17:13 Start Date: 15/Feb/21 17:13 Worklog Time Spent: 10m Work Description: jbrennan333 commented on pull request #2690: URL: https://github.com/apache/hadoop/pull/2690#issuecomment-779355481 @zehaoc2 verified that if he builds hadoop before running the failed hadoop-hdfs-rbf tests, it does not fail. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 552622) Time Spent: 1h 10m (was: 1h) > Add metrics for in-service datanodes > > > Key: HDFS-15821 > URL: https://issues.apache.org/jira/browse/HDFS-15821 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Zehao Chen >Assignee: Zehao Chen >Priority: Minor > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > We currently have metrics for live datanodes but some of the datanodes may be > in decommissioning state or maintenance state. Adding this metric allows us > to know how many nodes are currently in service, where NumInServiceDatanodes > = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[
https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=551482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-551482
]
ASF GitHub Bot logged work on HDFS-15821:
-
Author: ASF GitHub Bot
Created on: 11/Feb/21 19:49
Start Date: 11/Feb/21 19:49
Worklog Time Spent: 10m
Work Description: jbrennan333 commented on pull request #2690:
URL: https://github.com/apache/hadoop/pull/2690#issuecomment-46769
@zehaoc2 the error in the unit test build does look like it is related.
{noformat}
[ERROR]
/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-2690/src/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/NamenodeBeanMetrics.java:[742,2]
error: method does not override or implement a method from a supertype
{noformat}
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 551482)
Time Spent: 50m (was: 40m)
> Add metrics for in-service datanodes
>
>
> Key: HDFS-15821
> URL: https://issues.apache.org/jira/browse/HDFS-15821
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Zehao Chen
>Assignee: Zehao Chen
>Priority: Minor
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> We currently have metrics for live datanodes but some of the datanodes may be
> in decommissioning state or maintenance state. Adding this metric allows us
> to know how many nodes are currently in service, where NumInServiceDatanodes
> = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[ https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=551483=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-551483 ] ASF GitHub Bot logged work on HDFS-15821: - Author: ASF GitHub Bot Created on: 11/Feb/21 19:49 Start Date: 11/Feb/21 19:49 Worklog Time Spent: 10m Work Description: jbrennan333 edited a comment on pull request #2690: URL: https://github.com/apache/hadoop/pull/2690#issuecomment-46769 @zehaoc2 the error in the unit test build does look like it is related. `[ERROR] /home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-2690/src/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/NamenodeBeanMetrics.java:[742,2] error: method does not override or implement a method from a supertype ` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 551483) Time Spent: 1h (was: 50m) > Add metrics for in-service datanodes > > > Key: HDFS-15821 > URL: https://issues.apache.org/jira/browse/HDFS-15821 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Zehao Chen >Assignee: Zehao Chen >Priority: Minor > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We currently have metrics for live datanodes but some of the datanodes may be > in decommissioning state or maintenance state. Adding this metric allows us > to know how many nodes are currently in service, where NumInServiceDatanodes > = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[
https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=551099=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-551099
]
ASF GitHub Bot logged work on HDFS-15821:
-
Author: ASF GitHub Bot
Created on: 11/Feb/21 01:58
Start Date: 11/Feb/21 01:58
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on pull request #2690:
URL: https://github.com/apache/hadoop/pull/2690#issuecomment-777159622
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexec | 0m 37s | | Docker mode activated. |
_ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files
found. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | | 0m 0s | [test4tests](test4tests) | The patch
appears to include 1 new or modified test files. |
_ trunk Compile Tests _ |
| +0 :ok: | mvndep | 14m 9s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 26m 2s | | trunk passed |
| +1 :green_heart: | compile | 6m 9s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | compile | 5m 35s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | checkstyle | 1m 32s | | trunk passed |
| +1 :green_heart: | mvnsite | 2m 20s | | trunk passed |
| +1 :green_heart: | shadedclient | 21m 34s | | branch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 1m 52s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 2m 45s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +0 :ok: | spotbugs | 1m 27s | | Used deprecated FindBugs config;
considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 5m 21s | | trunk passed |
_ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 29s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 2m 4s | | the patch passed |
| +1 :green_heart: | compile | 6m 7s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javac | 6m 7s | | the patch passed |
| +1 :green_heart: | compile | 5m 30s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | javac | 5m 30s | | the patch passed |
| +1 :green_heart: | checkstyle | 1m 34s | | the patch passed |
| +1 :green_heart: | mvnsite | 2m 3s | | the patch passed |
| +1 :green_heart: | whitespace | 0m 0s | | The patch has no
whitespace issues. |
| +1 :green_heart: | shadedclient | 17m 20s | | patch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 1m 35s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 2m 33s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | findbugs | 5m 41s | | the patch passed |
_ Other Tests _ |
| +1 :green_heart: | unit | 193m 46s | | hadoop-hdfs in the patch
passed. |
| -1 :x: | unit | 1m 3s |
[/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2690/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt)
| hadoop-hdfs-rbf in the patch failed. |
| +1 :green_heart: | asflicense | 0m 46s | | The patch does not
generate ASF License warnings. |
| | | 329m 36s | | |
| Subsystem | Report/Notes |
|--:|:-|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2690/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/2690 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux 425f924c584a 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / cacc8703896 |
| Default Java | Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| Test Results |
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[ https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=550933=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-550933 ] ASF GitHub Bot logged work on HDFS-15821: - Author: ASF GitHub Bot Created on: 10/Feb/21 20:30 Start Date: 10/Feb/21 20:30 Worklog Time Spent: 10m Work Description: jbrennan333 commented on pull request #2690: URL: https://github.com/apache/hadoop/pull/2690#issuecomment-777009218 Thanks for fixing checkstyle issues. I will wait for checks to finish before committing. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 550933) Time Spent: 0.5h (was: 20m) > Add metrics for in-service datanodes > > > Key: HDFS-15821 > URL: https://issues.apache.org/jira/browse/HDFS-15821 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Zehao Chen >Assignee: Zehao Chen >Priority: Minor > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > We currently have metrics for live datanodes but some of the datanodes may be > in decommissioning state or maintenance state. Adding this metric allows us > to know how many nodes are currently in service, where NumInServiceDatanodes > = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[
https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=550021=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-550021
]
ASF GitHub Bot logged work on HDFS-15821:
-
Author: ASF GitHub Bot
Created on: 09/Feb/21 03:13
Start Date: 09/Feb/21 03:13
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on pull request #2690:
URL: https://github.com/apache/hadoop/pull/2690#issuecomment-775627526
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexec | 0m 32s | | Docker mode activated. |
_ Prechecks _ |
| +1 :green_heart: | dupname | 0m 1s | | No case conflicting files
found. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | | 0m 0s | [test4tests](test4tests) | The patch
appears to include 1 new or modified test files. |
_ trunk Compile Tests _ |
| +0 :ok: | mvndep | 14m 20s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 20m 20s | | trunk passed |
| +1 :green_heart: | compile | 4m 54s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | compile | 4m 29s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | checkstyle | 1m 19s | | trunk passed |
| +1 :green_heart: | mvnsite | 2m 7s | | trunk passed |
| +1 :green_heart: | shadedclient | 16m 36s | | branch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 1m 36s | | trunk passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 2m 27s | | trunk passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +0 :ok: | spotbugs | 1m 13s | | Used deprecated FindBugs config;
considering switching to SpotBugs. |
| +1 :green_heart: | findbugs | 4m 18s | | trunk passed |
_ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 27s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 47s | | the patch passed |
| +1 :green_heart: | compile | 4m 38s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javac | 4m 38s | | the patch passed |
| +1 :green_heart: | compile | 4m 22s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | javac | 4m 22s | | the patch passed |
| -0 :warning: | checkstyle | 1m 12s |
[/diff-checkstyle-hadoop-hdfs-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2690/1/artifact/out/diff-checkstyle-hadoop-hdfs-project.txt)
| hadoop-hdfs-project: The patch generated 2 new + 219 unchanged - 0 fixed =
221 total (was 219) |
| +1 :green_heart: | mvnsite | 1m 49s | | the patch passed |
| +1 :green_heart: | whitespace | 0m 0s | | The patch has no
whitespace issues. |
| +1 :green_heart: | shadedclient | 13m 5s | | patch has no errors
when building and testing our client artifacts. |
| +1 :green_heart: | javadoc | 1m 28s | | the patch passed with JDK
Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 |
| +1 :green_heart: | javadoc | 2m 16s | | the patch passed with JDK
Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01 |
| +1 :green_heart: | findbugs | 4m 29s | | the patch passed |
_ Other Tests _ |
| -1 :x: | unit | 191m 16s |
[/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2690/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt)
| hadoop-hdfs in the patch passed. |
| +1 :green_heart: | unit | 17m 14s | | hadoop-hdfs-rbf in the patch
passed. |
| +1 :green_heart: | asflicense | 0m 47s | | The patch does not
generate ASF License warnings. |
| | | 318m 54s | | |
| Reason | Tests |
|---:|:--|
| Failed junit tests |
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks |
| | hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped |
| Subsystem | Report/Notes |
|--:|:-|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2690/1/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/2690 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux bdf5991d04e3 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 x86_64 x86_64
[jira] [Work logged] (HDFS-15821) Add metrics for in-service datanodes
[ https://issues.apache.org/jira/browse/HDFS-15821?focusedWorklogId=549918=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-549918 ] ASF GitHub Bot logged work on HDFS-15821: - Author: ASF GitHub Bot Created on: 08/Feb/21 21:53 Start Date: 08/Feb/21 21:53 Worklog Time Spent: 10m Work Description: zehaoc2 opened a new pull request #2690: URL: https://github.com/apache/hadoop/pull/2690 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 549918) Remaining Estimate: 0h Time Spent: 10m > Add metrics for in-service datanodes > > > Key: HDFS-15821 > URL: https://issues.apache.org/jira/browse/HDFS-15821 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Zehao Chen >Assignee: Zehao Chen >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > We currently have metrics for live datanodes but some of the datanodes may be > in decommissioning state or maintenance state. Adding this metric allows us > to know how many nodes are currently in service, where NumInServiceDatanodes > = NumLiveDataNodes - NumDecomLiveDataNodes - NumInMaintenanceLiveDataNodes. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
