[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827387#comment-13827387 ] Junping Du commented on HDFS-5527: -- Thanks Arpit for the patch. +1. Patch looks good to me. Also verify a few iterations of tests that all passed. > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch, h5527.02.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827255#comment-13827255 ] Junping Du commented on HDFS-5527: -- Yes. I also see this in my local test failure, suspecting it could be some race conditions in block queue of UnderReplicatedBlocks. Still in more investigation. > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[
https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827163#comment-13827163
]
Arpit Agarwal commented on HDFS-5527:
-
Looks like an NN bug. From the [Jenkins
logs|https://builds.apache.org/job/PreCommit-HDFS-Build/5488//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/].
{code}
2013-11-19 19:09:03,406 INFO BlockStateChange
(BlockManager.java:computeReplicationWorkForBlocks(1366)) - BLOCK* ask
127.0.0.1:59892 to replicate blk_1073741825_1001 to datanode(s) 127.0.0.1:38708
127.0.0.1:50461
{code}
And then again:
{code}
2013-11-19 19:09:06,407 INFO BlockStateChange
(BlockManager.java:computeReplicationWorkForBlocks(1366)) - BLOCK* ask
127.0.0.1:50461 to replicate blk_1073741825_1001 to datanode(s) 127.0.0.1:38708
{code}
> Fix TestUnderReplicatedBlocks on branch HDFS-2832
> -
>
> Key: HDFS-5527
> URL: https://issues.apache.org/jira/browse/HDFS-5527
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Affects Versions: Heterogeneous Storage (HDFS-2832)
>Reporter: Junping Du
>Assignee: Junping Du
> Attachments: HDFS-5527.patch
>
>
> The failure seems like a deadlock, which is show in:
> https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827149#comment-13827149 ] Junping Du commented on HDFS-5527: -- You mean reproduce the failure? Yes. It failed intermittent so I am misunderstanding the patch attached can fix it. I can put failed log here if you think it is helpful. > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826741#comment-13826741 ] Arpit Agarwal commented on HDFS-5527: - Junping, were you able to duplicate the failure? > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826266#comment-13826266 ] Junping Du commented on HDFS-5527: -- Looks like the patch didn't fix the problem completely as still get chance to failed. Need more investigations. > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832
[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826223#comment-13826223 ] Junping Du commented on HDFS-5527: -- File HDFS-5528 in fixing NPE issue in trunk (I guess all tests instantiating MiniDFSCluster will meet this problem). > Fix TestUnderReplicatedBlocks on branch HDFS-2832 > - > > Key: HDFS-5527 > URL: https://issues.apache.org/jira/browse/HDFS-5527 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: Heterogeneous Storage (HDFS-2832) >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-5527.patch > > > The failure seems like a deadlock, which is show in: > https://builds.apache.org/job/PreCommit-HDFS-Build/5440//testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestUnderReplicatedBlocks/testSetrepIncWithUnderReplicatedBlocks/ -- This message was sent by Atlassian JIRA (v6.1#6144)
