[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-14 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474415#comment-16474415
 ] 

Íñigo Goiri commented on HDFS-13542:


Thanks [~linyiqun] for closing the JIRA, I completely forgot about it.

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.0.2
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
>
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-11 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472293#comment-16472293
 ] 

Hudson commented on HDFS-13542:
---

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14171 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/14171/])
HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails 
(inigoiri: rev d50c4d71dc42576f96ae5c268856fd1a7795f936)
* (edit) 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java


> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-11 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472264#comment-16472264
 ] 

Íñigo Goiri commented on HDFS-13542:


Committed to trunk, branch-3.1, branch-3.0, branch-2, and branch-2.9.
Thank you very much [~huanbang1993].

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-11 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472245#comment-16472245
 ] 

Íñigo Goiri commented on HDFS-13542:


Thanks [~huanbang1993] for  [^HDFS-13542.001.patch].
The change seems straightforward and it only makes the tests more resilient.
LGTM +1
Committing all the way to branch-2.9.

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-10 Thread genericqa (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471416#comment-16471416
 ] 

genericqa commented on HDFS-13542:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  1m 
15s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 27m 
42s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m  
0s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
53s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  1m  
5s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
12m 24s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
57s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
49s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
 3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  1m  
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
11m 26s{color} | {color:green} patch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  2m  
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
45s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}105m 53s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
29s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}171m 11s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy 
|
|   | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting |
|   | hadoop.hdfs.server.datanode.TestDirectoryScanner |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd |
| JIRA Issue | HDFS-13542 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12922938/HDFS-13542.001.patch |
| Optional Tests |  asflicense  compile  javac  javadoc  mvninstall  mvnsite  
unit  shadedclient  findbugs  checkstyle  |
| uname | Linux 41117c7f9479 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27 
10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 7369f41 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_162 |
| findbugs | v3.1.0-RC1 |
| unit | 
https://builds.apache.org/job/PreCommit-HDFS-Build/24176/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 |
|  Test Results | 
https://builds.apache.org/job/PreCommit-HDFS-Build/24176/testReport/ |
| Max. process+thread count | 3214 (vs. ulimit of 1) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U: 
hadoop-hdfs-project/hadoop-hdfs |
| Console output |

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-10 Thread Anbang Hu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471324#comment-16471324
 ] 

Anbang Hu commented on HDFS-13542:
--

Related report that shows testNeededReplicationWhileAppending is failing: 
[https://builds.apache.org/job/hadoop-trunk-win/453/testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestBlockManager/]

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-10 Thread Anbang Hu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471321#comment-16471321
 ] 

Anbang Hu commented on HDFS-13542:
--

*Console output*

Before patch:
{color:#FF}2018-05-10T21:01:54.4766448Z [ERROR] Tests run: 21, Failures: 0, 
Errors: 1, Skipped: 0, Time elapsed: 60.687 s <<< FAILURE! - in 
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager{color}
{color:#FF}2018-05-10T21:01:54.4766958Z [ERROR] 
testNeededReplicationWhileAppending(org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager)
 Time elapsed: 0.038 s <<< ERROR!{color}
{color:#FF}2018-05-10T21:01:54.4767413Z java.io.IOException: Could not 
fully delete 
D:\_work\4\s\hadoop-hdfs-project\hadoop-hdfs\target\test\data\3\dfs\name1{color}
{color:#FF}2018-05-10T21:01:54.4767595Z    at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1043){color}
{color:#FF}2018-05-10T21:01:54.4767757Z    at 
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879){color}
{color:#FF}2018-05-10T21:01:54.4768016Z    at 
org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:513){color}
{color:#FF}2018-05-10T21:01:54.4768425Z    at 
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:472){color}
{color:#FF}2018-05-10T21:01:54.4768632Z    at 
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:443){color}
{color:#FF}2018-05-10T21:01:54.4768796Z    at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method){color}
{color:#FF}2018-05-10T21:01:54.4768961Z    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
{color:#FF}2018-05-10T21:01:54.4769125Z    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
{color:#FF}2018-05-10T21:01:54.4769271Z    at 
java.lang.reflect.Method.invoke(Method.java:498){color}
{color:#FF}2018-05-10T21:01:54.4769434Z    at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
{color:#FF}2018-05-10T21:01:54.4770449Z    at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
{color:#FF}2018-05-10T21:01:54.4770611Z    at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
{color:#FF}2018-05-10T21:01:54.4770788Z    at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
{color:#FF}2018-05-10T21:01:54.4770949Z    at 
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
After patch:
{color:#14892c}2018-05-10T00:36:25.9725758Z [INFO] Running 
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager{color}
{color:#14892c}2018-05-10T00:37:32.3218337Z [INFO] Tests run: 21, Failures: 0, 
Errors: 0, Skipped: 0, Time elapsed: 66.335 s - in 
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager{color}

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-10 Thread Anbang Hu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471299#comment-16471299
 ] 

Anbang Hu commented on HDFS-13542:
--

Uploaded a new version that fix the style.

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, 
> HDFS-13542-branch-2.001.patch, HDFS-13542.000.patch, HDFS-13542.001.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-10 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470007#comment-16470007
 ] 

Íñigo Goiri commented on HDFS-13542:


The checkstyle issue was introduced by the patch, do you mind fixing it?
The unit tests seem unrelated; can you post your test report before and after 
the patch? 

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, HDFS-13542.000.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-09 Thread genericqa (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469867#comment-16469867
 ] 

genericqa commented on HDFS-13542:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
34s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 1 new or modified test 
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 23m 
15s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
49s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
44s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
56s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
10m 36s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
41s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
41s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  0m 
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
47s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}  
0m 39s{color} | {color:orange} hadoop-hdfs-project/hadoop-hdfs: The patch 
generated 1 new + 53 unchanged - 0 fixed = 54 total (was 53) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}  
9m 31s{color} | {color:green} patch has no errors when building and testing our 
client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
44s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}109m 50s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 
25s{color} | {color:green} The patch does not generate ASF License warnings. 
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}164m 36s{color} | 
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA |
|   | hadoop.hdfs.web.TestWebHdfsTimeouts |
|   | hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy |
|   | hadoop.hdfs.TestPread |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd |
| JIRA Issue | HDFS-13542 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12922764/HDFS-13542.000.patch |
| Optional Tests |  asflicense  compile  javac  javadoc  mvninstall  mvnsite  
unit  shadedclient  findbugs  checkstyle  |
| uname | Linux 70573ca17bda 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 
11:50:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 914b98a7 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_162 |
| findbugs | v3.1.0-RC1 |
| checkstyle | 
https://builds.apache.org/job/PreCommit-HDFS-Build/24170/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
 |
| unit | 
https://builds.apache.org/job/PreCommit-HDFS-Build/24170/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 |
|  Test

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-09 Thread Anbang Hu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469752#comment-16469752
 ] 

Anbang Hu commented on HDFS-13542:
--

[^HDFS-13542.000.patch] is for trunk.

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch, HDFS-13542.000.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-13542) TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows

2018-05-09 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/HDFS-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469739#comment-16469739
 ] 

Íñigo Goiri commented on HDFS-13542:


Does this apply to trunk?

> TestBlockManager#testNeededReplicationWhileAppending fails due to improper 
> cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows
> 
>
> Key: HDFS-13542
> URL: https://issues.apache.org/jira/browse/HDFS-13542
> Project: Hadoop HDFS
>  Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
>  Labels: windows
> Attachments: HDFS-13542-branch-2.000.patch
>
>
> branch-2.9 has failure message on Windows:
> {code:java}
> 2018-05-09 16:26:03,014 [Thread-3533] ERROR hdfs.MiniDFSCluster 
> (MiniDFSCluster.java:initMiniDFSCluster(884)) - IOE creating namenodes. 
> Permissions dump:
> path 
> 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data': 
>  
> absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs
>  permissions: drwx
> path 'E:\OSSHadoop\hadoop-hdfs-project': 
>  absolute:E:\OSSHadoop\hadoop-hdfs-project
>  permissions: drwx
> path 'E:\OSSHadoop': 
>  absolute:E:\OSSHadoop
>  permissions: drwx
> path 'E:\': 
>  absolute:E:\
>  permissions: drwxjava.io.IOException: Could not fully delete 
> E:\OSSHadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1026)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:982)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:879)
>  at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:515)
>  at 
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:474)
>  at 
> org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testNeededReplicationWhileAppending(TestBlockManager.java:465){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org