[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514161#comment-16514161
]
Íñigo Goiri commented on HDFS-13563:
The tests now pass
[here|https://builds.apache.org/job/hadoop-trunk-win/498/testReport/org.apache.hadoop.hdfs.tools/TestDFSAdminWithHA/].
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Lukas Majercak
>Priority: Minor
> Labels: Windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.4
>
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch,
> HDFS-13563.002.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512783#comment-16512783
]
Hudson commented on HDFS-13563:
---
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14428 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/14428/])
HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by (inigoiri:
rev 8d4926f38bf53b32453cd2bc7322c8818f752f85)
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDFSAdminWithHA.java
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Lukas Majercak
>Priority: Minor
> Labels: Windows
> Fix For: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.4
>
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch,
> HDFS-13563.002.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512746#comment-16512746
]
Anbang Hu commented on HDFS-13563:
--
+1
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Lukas Majercak
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch,
> HDFS-13563.002.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512733#comment-16512733
]
Íñigo Goiri commented on HDFS-13563:
The test passes
[here|https://builds.apache.org/job/PreCommit-HDFS-Build/24434/testReport/org.apache.hadoop.hdfs.tools/TestDFSAdminWithHA/].
Note that the unit tests now takes 7 minutes 36 seconds when it used to go all
the way to 9 minutes.
HDFS-13675 should take care of the rest.
+1 on [^HDFS-13563.002.patch].
Committing.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Lukas Majercak
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch,
> HDFS-13563.002.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511914#comment-16511914
]
genericqa commented on HDFS-13563:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
26s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 29m
1s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
2s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} shadedclient {color} | {color:red} 3m
21s{color} | {color:red} branch has errors when building and testing our client
artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
55s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
46s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} shadedclient {color} | {color:red} 2m
12s{color} | {color:red} patch has errors when building and testing our client
artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 95m 8s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
26s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}141m 40s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests |
hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd |
| JIRA Issue | HDFS-13563 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12927745/HDFS-13563.002.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux 6ae37bfab7ca 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27
10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 2299488 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_171 |
| findbugs | v3.1.0-RC1 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/24434/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/24434/testReport/ |
| Max. process+thread count | 2854 (vs. ulimit of 1) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U:
hadoop-hdfs-project/hadoop-hdfs |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/24434/console |
| Powered by | Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org |
This
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511828#comment-16511828
]
Lukas Majercak commented on HDFS-13563:
---
I think we can fix this by changing the retry policy on the client to have less
number of retries + faster timeout. This also speeds up other tests. Posted
patch02 with the change.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Lukas Majercak
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch,
> HDFS-13563.002.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493902#comment-16493902
]
Anbang Hu commented on HDFS-13563:
--
As a summary, there are 3 issues for TestDFSAdminWithHA running on Windows:
# 4 tests time out in
[HDFS-13632|https://issues.apache.org/jira/browse/HDFS-13632] (this JIRA)
# testUpgradeCommand does not release journalnode path after test is done.
[HDFS-13630|https://issues.apache.org/jira/browse/HDFS-13630]
# [HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for
TestDFSAdminWithHA|https://issues.apache.org/jira/browse/HDFS-13632]
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493758#comment-16493758
]
Íñigo Goiri commented on HDFS-13563:
I would keep this JIRA as the one trying to investigate the 4 time outs and
make HDFS-13630 just for randomizing the mini cluster path.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492979#comment-16492979
]
Anbang Hu commented on HDFS-13563:
--
[~elgoiri], there are 4 timeout tests in this test class, but they are not the
reason for the other 32 failures. It is the restarting NN1 with -upgrade option
in testUpgradeCommand that did not release the journalnode directory. I opened
[HDFS-13630|https://issues.apache.org/jira/browse/HDFS-13630] for discussion.
In addition, I would vote for having randomized MiniDFSCluster base path for
this test class. But we should leave
[HDFS-13630|https://issues.apache.org/jira/browse/HDFS-13630] open until root
cause is found.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492972#comment-16492972
]
Íñigo Goiri commented on HDFS-13563:
Currently the [daily Windows
build|https://builds.apache.org/job/hadoop-trunk-win/479/testReport/junit/org.apache.hadoop.hdfs.tools/TestDFSAdminWithHA/]
has 36 failures because of this.
However, this is caused by the 4 tests tweaked in [^HDFS-13563.001.patch].
I would use a randomized path for each test and then we can focus on why these
4 unit tests are timing out.
[~huanbang1993] can you open a separate JIRA to randomize the MiniDFSCluster?
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Test
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479810#comment-16479810
]
genericqa commented on HDFS-13563:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
46s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 28m
8s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
7s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
51s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 25s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
9s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
48s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
11m 36s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}121m 1s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
32s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}187m 37s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure |
| | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd |
| JIRA Issue | HDFS-13563 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12923973/HDFS-13563.001.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux 78fdcd3ab17b 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27
10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / a2cdffb |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_162 |
| findbugs | v3.1.0-RC1 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/24246/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/24246/testReport/ |
| Max. process+thread count | 2806 (vs. ulimit of 1) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U:
hadoop-hdfs-project/hadoop-hdfs |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/24246/console |
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479657#comment-16479657
]
Íñigo Goiri commented on HDFS-13563:
I guess we can discard the DNS issue.
However, I'd like to have a better understanding on why this gets stuck.
I don't feel comfortable just increasing the timeout.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479542#comment-16479542
]
Anbang Hu commented on HDFS-13563:
--
Trace stack shows:
{code:java}
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at
org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:203)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:686)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:789)
at org.apache.hadoop.ipc.Client$Connection.access$3600(Client.java:410)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1560)
at org.apache.hadoop.ipc.Client.call(Client.java:1391)
at org.apache.hadoop.ipc.Client.call(Client.java:1355)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:228)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
at com.sun.proxy.$Proxy28.refreshServiceAcl(Unknown Source)
at
org.apache.hadoop.security.protocolPB.RefreshAuthorizationPolicyProtocolClientSideTranslatorPB.refreshServiceAcl(RefreshAuthorizationPolicyProtocolClientSideTranslatorPB.java:59)
at
org.apache.hadoop.hdfs.tools.DFSAdmin.refreshServiceAcl(DFSAdmin.java:1541)
at org.apache.hadoop.hdfs.tools.DFSAdmin.run(DFSAdmin.java:2277)
at
org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down(TestDFSAdminWithHA.java:481)
{code}
It seems that WindowsSelectorImpl$SubSelector.poll0 takes a long time. The
tests finishes in 40 -50 seconds. [^HDFS-13563.001.patch] increases the
timeout for these tests to 60 seconds.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Minor
> Labels: Windows
> Attachments: HDFS-13563.000.patch, HDFS-13563.001.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478376#comment-16478376
]
Íñigo Goiri commented on HDFS-13563:
OK, can you post a patch with the needed changes and then based on that we see
what to do?
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478366#comment-16478366
]
Anbang Hu commented on HDFS-13563:
--
[~elgoiri], most of them were due to slow DNS resolution on Windows. The
remaining 4 should have some other reasons.
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478346#comment-16478346
]
Anbang Hu commented on HDFS-13563:
--
Modify the description after
[this|https://issues.apache.org/jira/browse/HDFS-13569?focusedCommentId=16478265=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16478265].
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#33}[Daily Windows
> build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/] shows
> TestDFSAdminWithHA has 4 timeout tests with "{color}test timed out after
> 3 milliseconds{color:#33}"{color}
> {code:java}
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshUserToGroupsMappingsNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshServiceAclNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshCallQueueNN1DownNN2Down
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfigurationNN1DownNN2Down
> {code}
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478345#comment-16478345
]
Íñigo Goiri commented on HDFS-13563:
Is this the same issue as the DNS resolution extra time?
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#33}Daily Windows build shows TestDFSAdminWithHA has 4 timeout
> tests. Local run confirms them:{color}
> {color:#d04437}[INFO] Running
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR] Tests run: 45, Failures: 0, Errors: 45, Skipped: 0,
> Time elapsed: 448.371 s <<< FAILURE! - in
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR]
> testRestoreFailedStorageNN1UpNN2Down(org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA)
> Time elapsed: 30.01 s <<< ERROR!{color}
> {color:#d04437}java.lang.Exception: test timed out after 3
> milliseconds{color}
> {color:#d04437} at java.net.Inet4AddressImpl.getHostByAddr(Native
> Method){color}
> {color:#d04437} at
> java.net.InetAddress$2.getHostByAddr(InetAddress.java:932){color}
> {color:#d04437} at
> java.net.InetAddress.getHostFromNameService(InetAddress.java:617){color}
> {color:#d04437} at
> java.net.InetAddress.getCanonicalHostName(InetAddress.java:588){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getLocalHostName(SecurityUtil.java:256){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.replacePattern(SecurityUtil.java:224){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getServerPrincipal(SecurityUtil.java:179){color}
> {color:#d04437} at
> org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:90){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:521){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:511){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:400){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:115){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:336){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:162){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:889){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:725){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:953){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:932){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1673){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1215){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1090){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:114){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:40){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster$Builder.build(MiniQJMHACluster.java:69){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.setUpHaCluster(TestDFSAdminWithHA.java:85){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRestoreFailedStorageNN1UpNN2Down(TestDFSAdminWithHA.java:235){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method){color}
> {color:#d04437} at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
> {color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
> {color:#d04437} at
>
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476639#comment-16476639
]
genericqa commented on HDFS-13563:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
35s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 31m
31s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
58s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
23s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 43s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 16s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 99m 53s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
27s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}173m 28s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests |
hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy |
| | hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA |
| | hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints |
| | hadoop.hdfs.client.impl.TestBlockReaderLocal |
| | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:abb62dd |
| JIRA Issue | HDFS-13563 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12923559/HDFS-13563.000.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux 55ec30c66059 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27
10:45:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 2d6195c |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_162 |
| findbugs | v3.1.0-RC1 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/24220/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/24220/testReport/ |
| Max. process+thread count | 3084 (vs.
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476484#comment-16476484
]
Íñigo Goiri commented on HDFS-13563:
Thanks [~huanbang1993] for the patch.
A couple comments:
* It may make sense to move all the timeouts into a rule.
* Why is the cluster not being shutdown properly? This class is supposed to be
cleaning the cluster at the end.
* In general, I would avoid to increase timeouts; any reason why this would
take longer on Windows?
Note that this timeout also happens in the [daily Windows
build|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/org.apache.hadoop.hdfs.tools/TestDFSAdminWithHA/].
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#d04437}[INFO] Running
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR] Tests run: 45, Failures: 0, Errors: 45, Skipped: 0,
> Time elapsed: 448.371 s <<< FAILURE! - in
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR]
> testRestoreFailedStorageNN1UpNN2Down(org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA)
> Time elapsed: 30.01 s <<< ERROR!{color}
> {color:#d04437}java.lang.Exception: test timed out after 3
> milliseconds{color}
> {color:#d04437} at java.net.Inet4AddressImpl.getHostByAddr(Native
> Method){color}
> {color:#d04437} at
> java.net.InetAddress$2.getHostByAddr(InetAddress.java:932){color}
> {color:#d04437} at
> java.net.InetAddress.getHostFromNameService(InetAddress.java:617){color}
> {color:#d04437} at
> java.net.InetAddress.getCanonicalHostName(InetAddress.java:588){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getLocalHostName(SecurityUtil.java:256){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.replacePattern(SecurityUtil.java:224){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getServerPrincipal(SecurityUtil.java:179){color}
> {color:#d04437} at
> org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:90){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:521){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:511){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:400){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:115){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:336){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:162){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:889){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:725){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:953){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:932){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1673){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1215){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1090){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:114){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:40){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster$Builder.build(MiniQJMHACluster.java:69){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.setUpHaCluster(TestDFSAdminWithHA.java:85){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRestoreFailedStorageNN1UpNN2Down(TestDFSAdminWithHA.java:235){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method){color}
> {color:#d04437} at
>
[jira] [Commented] (HDFS-13563) TestDFSAdminWithHA times out on Windows
[
https://issues.apache.org/jira/browse/HDFS-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476461#comment-16476461
]
Anbang Hu commented on HDFS-13563:
--
[^HDFS-13563.000.patch] applies to both trunk and branch-2. After the patch:
{color:#14892c}[INFO] Running org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA
[INFO] Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 809.368
s - in org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 45, Failures: 0, Errors: 0, Skipped: 0{color}
> TestDFSAdminWithHA times out on Windows
> ---
>
> Key: HDFS-13563
> URL: https://issues.apache.org/jira/browse/HDFS-13563
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Anbang Hu
>Assignee: Anbang Hu
>Priority: Major
> Labels: Windows
> Attachments: HDFS-13563.000.patch
>
>
> {color:#d04437}[INFO] Running
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR] Tests run: 45, Failures: 0, Errors: 45, Skipped: 0,
> Time elapsed: 448.371 s <<< FAILURE! - in
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA{color}
> {color:#d04437}[ERROR]
> testRestoreFailedStorageNN1UpNN2Down(org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA)
> Time elapsed: 30.01 s <<< ERROR!{color}
> {color:#d04437}java.lang.Exception: test timed out after 3
> milliseconds{color}
> {color:#d04437} at java.net.Inet4AddressImpl.getHostByAddr(Native
> Method){color}
> {color:#d04437} at
> java.net.InetAddress$2.getHostByAddr(InetAddress.java:932){color}
> {color:#d04437} at
> java.net.InetAddress.getHostFromNameService(InetAddress.java:617){color}
> {color:#d04437} at
> java.net.InetAddress.getCanonicalHostName(InetAddress.java:588){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getLocalHostName(SecurityUtil.java:256){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.replacePattern(SecurityUtil.java:224){color}
> {color:#d04437} at
> org.apache.hadoop.security.SecurityUtil.getServerPrincipal(SecurityUtil.java:179){color}
> {color:#d04437} at
> org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:90){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:521){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:511){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:400){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2.(HttpServer2.java:115){color}
> {color:#d04437} at
> org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:336){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:162){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:889){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:725){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:953){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:932){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1673){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1215){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1090){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:883){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:514){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:473){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:114){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster.(MiniQJMHACluster.java:40){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.qjournal.MiniQJMHACluster$Builder.build(MiniQJMHACluster.java:69){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.setUpHaCluster(TestDFSAdminWithHA.java:85){color}
> {color:#d04437} at
> org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRestoreFailedStorageNN1UpNN2Down(TestDFSAdminWithHA.java:235){color}
> {color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method){color}
> {color:#d04437} at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
> {color:#d04437} at
>
