[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020633#comment-14020633 ] Junping Du commented on HDFS-6159: -- [~decster], would you take a look at the test failure

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999715#comment-13999715 ] Junping Du commented on HDFS-6250: -- Thanks [~airbots] for verification work! I will commit

[jira] [Updated] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6250: - Resolution: Fixed Fix Version/s: 2.5.0 Assignee: Binglin Chang (was: Chen He)

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998472#comment-13998472 ] Junping Du commented on HDFS-6250: -- bq. Should the balancer keep node0 always

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997684#comment-13997684 ] Junping Du commented on HDFS-6250: -- Thanks for review and comments, [~airbots]! The good

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997412#comment-13997412 ] Junping Du commented on HDFS-6250: -- Thanks [~decster] for updating on this. [~airbots], I

[jira] [Commented] (HDFS-6381) Fix a typo in INodeReference.java

[ https://issues.apache.org/jira/browse/HDFS-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996213#comment-13996213 ] Junping Du commented on HDFS-6381: -- Kick off Jenkins test manually. Fix a typo in

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996207#comment-13996207 ] Junping Du commented on HDFS-6250: -- Hi [~decster], patch LGTM. Would you run 50 iterations

[jira] [Commented] (HDFS-6342) TestBalancerWithNodeGroup.testBalancerWithRackLocality may fail if balancer.id file is huge

[ https://issues.apache.org/jira/browse/HDFS-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990613#comment-13990613 ] Junping Du commented on HDFS-6342: -- Hi [~airbots] and [~decster], can we move all

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990619#comment-13990619 ] Junping Du commented on HDFS-6250: -- The new patch sounds a good direction for me. Thanks

[jira] [Updated] (HDFS-6342) TestBalancerWithNodeGroup.testBalancerWithRackLocality may fail if balancer.id file is huge

[ https://issues.apache.org/jira/browse/HDFS-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6342: - Resolution: Duplicate Status: Resolved (was: Patch Available) Ok. Let's end up discussion here

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988541#comment-13988541 ] Junping Du commented on HDFS-5580: -- Hi [~decster], TestBalancerWithNodeGroup failed again

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988552#comment-13988552 ] Junping Du commented on HDFS-6159: -- Sorry for just notice this JIRA as it seems more

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987315#comment-13987315 ] Junping Du commented on HDFS-5168: -- Agree with [~szetszwo] that the test failure is not

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982196#comment-13982196 ] Junping Du commented on HDFS-6261: -- Thanks [~decster] for working on this effort. I

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981894#comment-13981894 ] Junping Du commented on HDFS-5168: -- Hi [~nikola.vujic], the patch seems to break two tests

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977931#comment-13977931 ] Junping Du commented on HDFS-5168: -- [~nikola.vujic], sorry for response lately on this as

[jira] [Moved] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-10497 to HDFS-6261: --- Component/s: (was: documentation) documentation

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13974349#comment-13974349 ] Junping Du commented on HDFS-6261: -- NodeGroup Topology feature is completed in HDFS part,

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958608#comment-13958608 ] Junping Du commented on HDFS-5168: -- Hi [~nikola.vujic], thanks for contributing a patch

[jira] [Commented] (HDFS-6033) PBImageXmlWriter incorrectly handles processing cache directives

[ https://issues.apache.org/jira/browse/HDFS-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13915378#comment-13915378 ] Junping Du commented on HDFS-6033: -- +1. Thanks ATM for working on this. You are right that

[jira] [Updated] (HDFS-6033) PBImageXmlWriter incorrectly handles processing cache directives

[ https://issues.apache.org/jira/browse/HDFS-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6033: - Labels: reviewed (was: ) PBImageXmlWriter incorrectly handles processing cache directives

[jira] [Commented] (HDFS-3747) balancer-Test failed because of time out

[ https://issues.apache.org/jira/browse/HDFS-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911140#comment-13911140 ] Junping Du commented on HDFS-3747: -- The Balancer timeout bug has been fixed through

[jira] [Resolved] (HDFS-3747) balancer-Test failed because of time out

[ https://issues.apache.org/jira/browse/HDFS-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-3747. -- Resolution: Cannot Reproduce balancer-Test failed because of time out

[jira] [Resolved] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-3746. -- Resolution: Cannot Reproduce This issue has been fixed in HDFS-4261, let's resolve it as Cannot

[jira] [Updated] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report

[ https://issues.apache.org/jira/browse/HDFS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3295: - Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) This issue has been fixed

[jira] [Updated] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5970: - Priority: Minor (was: Major) callers of NetworkTopology's chooseRandom method to expect null return

[jira] [Commented] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13906813#comment-13906813 ] Junping Du commented on HDFS-5970: -- The plan sounds reasonable. I agree NPE happens here

[jira] [Updated] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5970: - Component/s: (was: hdfs-client) (was: datanode) namenode

[jira] [Commented] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13906529#comment-13906529 ] Junping Du commented on HDFS-5970: -- Nice catch, Yongjun! Would be great if you can deliver

[jira] [Updated] (HDFS-5828) BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true

[ https://issues.apache.org/jira/browse/HDFS-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5828: - Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) Commit

[jira] [Updated] (HDFS-5828) BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true

[ https://issues.apache.org/jira/browse/HDFS-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5828: - Status: Patch Available (was: Open) BlockPlacementPolicyWithNodeGroup can place multiple replicas on

[jira] [Commented] (HDFS-5828) BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true

[ https://issues.apache.org/jira/browse/HDFS-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13888513#comment-13888513 ] Junping Du commented on HDFS-5828: -- Kick off Jenkins to see the test result. Buddy, thanks

[jira] [Commented] (HDFS-5828) BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true

[ https://issues.apache.org/jira/browse/HDFS-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13887509#comment-13887509 ] Junping Du commented on HDFS-5828: -- Thanks for nice catch, Buddy! Patch looks good to me

[jira] [Updated] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5721: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) I have

[jira] [Updated] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5721: - Issue Type: Improvement (was: Bug) sharedEditsImage in Namenode#initializeSharedEdits() should be

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866305#comment-13866305 ] Junping Du commented on HDFS-5721: -- Agree with Uma that in most cases, the closing streams

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865017#comment-13865017 ] Junping Du commented on HDFS-5721: -- Thanks Ted for the patch! I think TestHASafeMode is

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865142#comment-13865142 ] Junping Du commented on HDFS-5721: -- Thanks Ted for the patch! v2 patch looks good overall

[jira] [Commented] (HDFS-5719) FSImage#doRollback() should close prevState before return

[ https://issues.apache.org/jira/browse/HDFS-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13862844#comment-13862844 ] Junping Du commented on HDFS-5719: -- Thanks for nice catch, Ted! +1. Patch looks good to

[jira] [Commented] (HDFS-4273) Fix some issue in DFSInputstream

[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13863947#comment-13863947 ] Junping Du commented on HDFS-4273: -- Current simple workaround (expire for local deadnode)

[jira] [Commented] (HDFS-5721) sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns

[ https://issues.apache.org/jira/browse/HDFS-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13863967#comment-13863967 ] Junping Du commented on HDFS-5721: -- Thanks for nice catch again. Ted! There are also other

[jira] [Updated] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5540: - Description: TestBlocksWithNotEnoughRacks fails with timed out waiting for corrupt replicas

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852752#comment-13852752 ] Junping Du commented on HDFS-5540: -- +1. The test failure is unrelated and will file a

[jira] [Updated] (HDFS-5540) Fix intermittent failure in TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5540: - Summary: Fix intermittent failure in TestBlocksWithNotEnoughRacks (was: Fix

[jira] [Updated] (HDFS-5540) Fix intermittent failure in TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5540: - Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851546#comment-13851546 ] Junping Du commented on HDFS-5540: -- I am reviewing this patch which seems a little out of

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852502#comment-13852502 ] Junping Du commented on HDFS-5540: -- It can be applied, but not very clean. It is typically

[jira] [Updated] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5540: - Priority: Minor (was: Major) Fix TestBlocksWithNotEnoughRacks

[jira] [Commented] (HDFS-5454) DataNode UUID should be assigned prior to FsDataset initialization

[ https://issues.apache.org/jira/browse/HDFS-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848820#comment-13848820 ] Junping Du commented on HDFS-5454: -- +1. Patch looks good to me. Thanks for this

[jira] [Updated] (HDFS-5454) DataNode UUID should be assigned prior to FsDataset initialization

[ https://issues.apache.org/jira/browse/HDFS-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5454: - Assignee: Arpit Agarwal DataNode UUID should be assigned prior to FsDataset initialization

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5484: - Assignee: Eric Sirianni StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[jira] [Commented] (HDFS-5652) refactoring/uniforming invalid block token exception handling in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847068#comment-13847068 ] Junping Du commented on HDFS-5652: -- +1. patch looks good to me. refactoring/uniforming

[jira] [Updated] (HDFS-5652) refactoring/uniforming invalid block token exception handling in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5652: - Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845204#comment-13845204 ] Junping Du commented on HDFS-5580: -- +1. I have commit this to trunk and branch-2. Thanks

[jira] [Updated] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5580: - Resolution: Fixed Fix Version/s: 2.4.0 Target Version/s: 2.4.0 Status:

[jira] [Updated] (HDFS-5637) try to refeatchToken while local read InvalidToken occurred

[ https://issues.apache.org/jira/browse/HDFS-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5637: - Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) I have

[jira] [Commented] (HDFS-5637) try to refeatchToken while local read InvalidToken occurred

[ https://issues.apache.org/jira/browse/HDFS-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845014#comment-13845014 ] Junping Du commented on HDFS-5637: -- The purpose of refactoring is trying to keep

[jira] [Commented] (HDFS-5637) try to refeatchToken while local read InvalidToken occurred

[ https://issues.apache.org/jira/browse/HDFS-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845055#comment-13845055 ] Junping Du commented on HDFS-5637: -- +1. I am OK with doing work in separated JIRA. Thanks

[jira] [Commented] (HDFS-5637) try to refeatchToken while local read InvalidToken occurred

[ https://issues.apache.org/jira/browse/HDFS-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843907#comment-13843907 ] Junping Du commented on HDFS-5637: -- Thanks [~xieliang007] for the patch! Agree with Colin

[jira] [Commented] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836389#comment-13836389 ] Junping Du commented on HDFS-5535: -- Hi [~azuryy], Definitely. Sharing ideas, design and

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836153#comment-13836153 ] Junping Du commented on HDFS-5580: -- Thanks for working on this. Binglin! I will review

[jira] [Updated] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5580: - Hadoop Flags: Reviewed Infinite loop in Balancer.waitForMoveCompletion

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836333#comment-13836333 ] Junping Du commented on HDFS-5580: -- +1. v3 patch looks good to me. Thanks for fixing this.

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827149#comment-13827149 ] Junping Du commented on HDFS-5527: -- You mean reproduce the failure? Yes. It failed

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827255#comment-13827255 ] Junping Du commented on HDFS-5527: -- Yes. I also see this in my local test failure,

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827387#comment-13827387 ] Junping Du commented on HDFS-5527: -- Thanks Arpit for the patch. +1. Patch looks good to

[jira] [Assigned] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5527: Assignee: Arpit Agarwal (was: Junping Du) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[jira] [Created] (HDFS-5527) Fix TestUnderReplicatedBlocks

Junping Du created HDFS-5527: Summary: Fix TestUnderReplicatedBlocks Key: HDFS-5527 URL: https://issues.apache.org/jira/browse/HDFS-5527 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Assigned] (HDFS-5527) Fix TestUnderReplicatedBlocks

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5527: Assignee: Junping Du Fix TestUnderReplicatedBlocks -

[jira] [Updated] (HDFS-5527) Fix TestUnderReplicatedBlocks

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5527: - Attachment: HDFS-5527.patch Update a quick fix to test failure. The NPE in instantiating MiniDFSCluster

[jira] [Updated] (HDFS-5527) Fix TestUnderReplicatedBlocks

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5527: - Description: The failure seems like a deadlock, which is show in:

[jira] [Updated] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5527: - Summary: Fix TestUnderReplicatedBlocks on branch HDFS-2832 (was: Fix TestUnderReplicatedBlocks) Fix

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826216#comment-13826216 ] Junping Du commented on HDFS-2832: -- Filed HDFS-5527 to fix TestUnderReplicatedBlocks

[jira] [Created] (HDFS-5528) NPE in instantiating MiniDFSCluster

Junping Du created HDFS-5528: Summary: NPE in instantiating MiniDFSCluster Key: HDFS-5528 URL: https://issues.apache.org/jira/browse/HDFS-5528 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826223#comment-13826223 ] Junping Du commented on HDFS-5527: -- File HDFS-5528 in fixing NPE issue in trunk (I guess

[jira] [Commented] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826266#comment-13826266 ] Junping Du commented on HDFS-5527: -- Looks like the patch didn't fix the problem completely

[jira] [Commented] (HDFS-5528) NPE in instantiating MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826289#comment-13826289 ] Junping Du commented on HDFS-5528: -- Yes. It looks like the same issue. Let's close it with

[jira] [Commented] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

[ https://issues.apache.org/jira/browse/HDFS-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13823181#comment-13823181 ] Junping Du commented on HDFS-5510: -- Thanks Arpit for review! Fix a findbug warning in

[jira] [Commented] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13823193#comment-13823193 ] Junping Du commented on HDFS-5515: -- +1 patch looks good. I think #1 fix the

[jira] [Updated] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

[ https://issues.apache.org/jira/browse/HDFS-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5510: - Attachment: HDFS-5510.patch Fix a findbug warning in DataStorage.java on HDFS-2832 branch

[jira] [Created] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

Junping Du created HDFS-5510: Summary: Fix a findbug warning in DataStorage.java on HDFS-2832 branch Key: HDFS-5510 URL: https://issues.apache.org/jira/browse/HDFS-5510 Project: Hadoop HDFS

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821047#comment-13821047 ] Junping Du commented on HDFS-2832: -- The unit test failure may due to no cleanup as I still

[jira] [Commented] (HDFS-5486) Fix TestNameNodeMetrics

[ https://issues.apache.org/jira/browse/HDFS-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818640#comment-13818640 ] Junping Du commented on HDFS-5486: -- +1. new patch looks good to me. We can have something

[jira] [Commented] (HDFS-5479) Fix test failures in Balancer.

[ https://issues.apache.org/jira/browse/HDFS-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817108#comment-13817108 ] Junping Du commented on HDFS-5479: -- Looks like the root cause is simulated capacity is not

[jira] [Commented] (HDFS-5480) Update Balancer for HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817151#comment-13817151 ] Junping Du commented on HDFS-5480: -- Hi Nicholas, thanks for jira and patch. Do you think

[jira] [Created] (HDFS-5481) Fix TestDataNodeVolumeFailure

Junping Du created HDFS-5481: Summary: Fix TestDataNodeVolumeFailure Key: HDFS-5481 URL: https://issues.apache.org/jira/browse/HDFS-5481 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: HDFS-5481.patch Attach a quick patch and verify it fix the test failure of

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: HDFS-5481.patch Fix TestDataNodeVolumeFailure -

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: (was: HDFS-5481.patch) Fix TestDataNodeVolumeFailure -

[jira] [Commented] (HDFS-5479) Fix test failures in Balancer.

[ https://issues.apache.org/jira/browse/HDFS-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817846#comment-13817846 ] Junping Du commented on HDFS-5479: -- Given HDFS-5480 is created almost at the same time and

[jira] [Resolved] (HDFS-5479) Fix test failures in Balancer.

[ https://issues.apache.org/jira/browse/HDFS-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-5479. -- Resolution: Duplicate Fix test failures in Balancer. --

[jira] [Commented] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817859#comment-13817859 ] Junping Du commented on HDFS-5481: -- Thanks Arpit for review and comments! Update v2 patch.

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: HDFS-5481-v2.patch Fix TestDataNodeVolumeFailure -

[jira] [Commented] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817887#comment-13817887 ] Junping Du commented on HDFS-5481: -- Add an additional fix for TestNameNodeMetrics in v3

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure and TestNameNodeMetrics

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Summary: Fix TestDataNodeVolumeFailure and TestNameNodeMetrics (was: Fix TestDataNodeVolumeFailure)

[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: HDFS-5481-v3.patch Fix TestDataNodeVolumeFailure -

[jira] [Commented] (HDFS-5481) Fix TestDataNodeVolumeFailure and TestNameNodeMetrics

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817892#comment-13817892 ] Junping Du commented on HDFS-5481: -- Oops. We are updating JIRA in the same time. :) Do you

[jira] [Commented] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817894#comment-13817894 ] Junping Du commented on HDFS-5481: -- Hi Arpit, Thanks for review and comments! I can

[jira] [Commented] (HDFS-5481) Fix TestDataNodeVolumeFailure

[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817897#comment-13817897 ] Junping Du commented on HDFS-5481: -- Ok. I will put the fix patch on HDFS-5486. Thanks!

<    2   3   4   5   6   7   8   9   10   11   >