[jira] [Commented] (HDFS-11378) Verify multiple DataNodes can be decommissioned/maintenance at the same time
[ https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843733#comment-15843733 ] Hudson commented on HDFS-11378: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11187 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11187/]) HDFS-11378. Verify multiple DataNodes can be decommissioned/maintenance (mingma: rev 312b36d113d83640b92c62fdd91ede74bd04c00f) * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMaintenanceState.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/AdminStatesBaseTest.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java > Verify multiple DataNodes can be decommissioned/maintenance at the same time > > > Key: HDFS-11378 > URL: https://issues.apache.org/jira/browse/HDFS-11378 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs >Affects Versions: 3.0.0-alpha1 >Reporter: Manoj Govindassamy >Assignee: Manoj Govindassamy > Fix For: 2.9.0, 3.0.0-alpha3 > > Attachments: HDFS-11378.01.patch > > > DecommissionManager is capable of transitioning multiple DataNodes to > Decommission/Maintenance states. Current tests under TestDecommission and > TestMaintenanceState only request for one DataNode for > Decommission/Maintenance. Better if we can simulate real world cases whereby > multiple DataNodes can be taken out of service and verify the resulting block > replication factor for the files. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11378) Verify multiple DataNodes can be decommissioned/maintenance at the same time
[ https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843201#comment-15843201 ] Manoj Govindassamy commented on HDFS-11378: --- Thanks for the review [~mingma]. Sure, multiple DNs in maintenance and decommission in parallel is also an interesting case. Am also planning for few more corner cases like min replication not met when N-1 or N-2 of the nodes are asked for Maintenance/Decom and DNs need to be recommissioned for the other ones to go IN_MAINTENANCE. Will add these tests in the next batch. Thanks. > Verify multiple DataNodes can be decommissioned/maintenance at the same time > > > Key: HDFS-11378 > URL: https://issues.apache.org/jira/browse/HDFS-11378 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs >Affects Versions: 3.0.0-alpha1 >Reporter: Manoj Govindassamy >Assignee: Manoj Govindassamy > Attachments: HDFS-11378.01.patch > > > DecommissionManager is capable of transitioning multiple DataNodes to > Decommission/Maintenance states. Current tests under TestDecommission and > TestMaintenanceState only request for one DataNode for > Decommission/Maintenance. Better if we can simulate real world cases whereby > multiple DataNodes can be taken out of service and verify the resulting block > replication factor for the files. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11378) Verify multiple DataNodes can be decommissioned/maintenance at the same time
[ https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843195#comment-15843195 ] Ming Ma commented on HDFS-11378: The patch LGTM. Thanks [~manojg] for the useful test cases! We might want to add test cases of putting some nodes to decommission and other nodes to maintenance at the same time. But that can be done in a separate jira unless it is your attention to do it here. > Verify multiple DataNodes can be decommissioned/maintenance at the same time > > > Key: HDFS-11378 > URL: https://issues.apache.org/jira/browse/HDFS-11378 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs >Affects Versions: 3.0.0-alpha1 >Reporter: Manoj Govindassamy >Assignee: Manoj Govindassamy > Attachments: HDFS-11378.01.patch > > > DecommissionManager is capable of transitioning multiple DataNodes to > Decommission/Maintenance states. Current tests under TestDecommission and > TestMaintenanceState only request for one DataNode for > Decommission/Maintenance. Better if we can simulate real world cases whereby > multiple DataNodes can be taken out of service and verify the resulting block > replication factor for the files. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11378) Verify multiple DataNodes can be decommissioned/maintenance at the same time
[
https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15841035#comment-15841035
]
Hadoop QA commented on HDFS-11378:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
14s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 3 new or modified test
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 16m
32s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
3s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
12s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
17s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
17s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
50s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 80m 6s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}111m 56s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.TestAclsEndToEnd |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:a9ad5d6 |
| JIRA Issue | HDFS-11378 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12849639/HDFS-11378.01.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux 4f4554786fa9 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2
15:37:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 7bc333a |
| Default Java | 1.8.0_121 |
| findbugs | v3.0.0 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/18281/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/18281/testReport/ |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U:
hadoop-hdfs-project/hadoop-hdfs |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/18281/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Verify multiple DataNodes can be decommissioned/maintenance at the same time
>
>
> Key: HDFS-11378
> URL: https://issues.apache.org/jira/browse/HDFS-11378
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs
>Affects Versions: 3.0.0-alpha1
>Reporter: Manoj Govindassamy
>
