[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311932#comment-14311932 ] Hadoop QA commented on HDFS-7754: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312379#comment-14312379 ] Hadoop QA commented on HDFS-7753: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Attachment: HDFS-7704-v5.patch Attaching a new patch to address all the comments DN heartbeat to

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Status: Patch Available (was: Open) DN heartbeat to Active NN may be blocked and expire if

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312425#comment-14312425 ] Rushabh S Shah commented on HDFS-7704: -- Sorry..ignore the previous comment. Thanks for

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Status: Open (was: Patch Available) Thanks [~kihwal] for reviewing the patch and catching the

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312463#comment-14312463 ] Zhe Zhang commented on HDFS-7613: - Thanks [~zhangyongxyz]. [~walter.k.su] I'm glad you are

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.000.patch Upload the patch to make {{FsDatasetImpl#getVolumes()}} as a private

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313358#comment-14313358 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- ..., HDFS-7712 and HDFS-7734 also

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313405#comment-14313405 ] zhaoyunjiong commented on HDFS-6133: You mean choosing the mechanism don't rely on the

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313464#comment-14313464 ] Zhe Zhang commented on HDFS-7285: - I'm fine with changing to HDFS-7285 to be consistent

[jira] [Commented] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313462#comment-14313462 ] Hadoop QA commented on HDFS-7714: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7762) Add more unit tests to TestDFSOutputStream

Li Bo created HDFS-7762: --- Summary: Add more unit tests to TestDFSOutputStream Key: HDFS-7762 URL: https://issues.apache.org/jira/browse/HDFS-7762 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-6753) When one the Disk is full and all the volumes configured are unhealthy , then Datanode is not considering it as failure and datanode process is not shutting down .

[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313615#comment-14313615 ] Vinayakumar B commented on HDFS-6753: - Thanks [~andreina] for the patch. bq. Can we add

[jira] [Assigned] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned HDFS-6826: - Assignee: Arun Suresh (was: Alejandro Abdelnur) Plugin interface to enable delegation of HDFS

[jira] [Commented] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313634#comment-14313634 ] Hadoop QA commented on HDFS-7756: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313655#comment-14313655 ] Li Bo commented on HDFS-7545: - Hi, Zhe, I notice you have just submitted a patch of HDFS-7652.

[jira] [Commented] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313480#comment-14313480 ] Hudson commented on HDFS-7756: -- FAILURE: Integrated in Hadoop-trunk-Commit #7056 (See

[jira] [Updated] (HDFS-6753) When one the Disk is full and all the volumes configured are unhealthy , then Datanode is not considering it as failure and datanode process is not shutting down .

[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6753: Assignee: J.Andreina (was: Srikanth Upputuri) Status: Patch Available (was: Open) When one

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313334#comment-14313334 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- The branch-trunk-win, fs-encryption

[jira] [Commented] (HDFS-6662) [ UI ] Not able to open file from UI if file path contains %

[ https://issues.apache.org/jira/browse/HDFS-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1431#comment-1431 ] Akira AJISAKA commented on HDFS-6662: - Cancelling my +1. Some comments: {code} +

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313387#comment-14313387 ] Tsz Wo Nicholas Sze commented on HDFS-6133: --- If you agree with mixed mechanism,

[jira] [Created] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

Lei (Eddy) Xu created HDFS-7758: --- Summary: Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead Key: HDFS-7758 URL: https://issues.apache.org/jira/browse/HDFS-7758 Project:

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313355#comment-14313355 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- Since the decom manager iterates

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313357#comment-14313357 ] Plamen Jeliazkov commented on HDFS-7058: I understand. Yes was best to remove it.

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313368#comment-14313368 ] Arpit Agarwal commented on HDFS-7723: - This patch is still too large to review

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313367#comment-14313367 ] Tsz Wo Nicholas Sze commented on HDFS-4114: --- I see. What you want actually is

[jira] [Commented] (HDFS-2319) Add test cases for FSshell -stat

[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313397#comment-14313397 ] Akira AJISAKA commented on HDFS-2319: - Hi [~xiexianshan], would you fix the test

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313396#comment-14313396 ] Hadoop QA commented on HDFS-7718: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6133: -- Hadoop Flags: Reviewed +1 patch looks good. (Let's do the existence-of-a-second-file

[jira] [Created] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

zhaoyunjiong created HDFS-7759: -- Summary: Provide existence-of-a-second-file implementation for pinning blocks on Datanode Key: HDFS-7759 URL: https://issues.apache.org/jira/browse/HDFS-7759 Project:

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Description: The usage of following two variables is unnecessary. We can remove them to make code a bit brief.

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313513#comment-14313513 ] Yongjun Zhang commented on HDFS-6133: - Hi [~zhaoyunjiong], Nice work! Thanks Nicholas

[jira] [Updated] (HDFS-7058) Tests for truncate CLI

[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dasha Boudnik updated HDFS-7058: Attachment: HDFS-7058.patch So, because it takes time to truncate the file, the test doesn't pass in

[jira] [Updated] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4114: -- Status: Open (was: Patch Available) Remove the BackupNode and CheckpointNode from

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313321#comment-14313321 ] Tsz Wo Nicholas Sze commented on HDFS-4114: --- Since BackupNode is not required by

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313349#comment-14313349 ] Konstantin Shvachko commented on HDFS-4114: --- [This probably summarises my

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-2319: Target Version/s: (was: 0.24.0) Affects Version/s: (was: 0.24.0)

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313432#comment-14313432 ] zhaoyunjiong commented on HDFS-6133: Sure. Create HDFS-7759 to track. Thanks for your

[jira] [Commented] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313446#comment-14313446 ] Brahma Reddy Battula commented on HDFS-7736: Hi [~ajisakaa] Thanks for

[jira] [Updated] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7736: --- Attachment: HDFS-7736-branch2-003.patch Typos in dfsadmin/fsck/snapshotDiff Commands

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313528#comment-14313528 ] Colin Patrick McCabe commented on HDFS-7718: Findbugs warning is about

[jira] [Updated] (HDFS-7058) Tests for truncate CLI

[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7058: -- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Created] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

Yi Liu created HDFS-7761: Summary: cleanup unnecssary code logic in LocatedBlock Key: HDFS-7761 URL: https://issues.apache.org/jira/browse/HDFS-7761 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313519#comment-14313519 ] Hudson commented on HDFS-7647: -- FAILURE: Integrated in HBase-1.0 #724 (See

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313516#comment-14313516 ] Colin Patrick McCabe commented on HDFS-7744: Findbugs warning is unrelated (it

[jira] [Commented] (HDFS-7736) Typos in dfsadmin/fsck/snapshotDiff Commands

[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313693#comment-14313693 ] Hadoop QA commented on HDFS-7736: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-10.patch Thanks Nicholas. Update patch to use

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313417#comment-14313417 ] Tsz Wo Nicholas Sze commented on HDFS-6133: --- You mean choosing the mechanism

[jira] [Commented] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313419#comment-14313419 ] Yi Liu commented on HDFS-7756: -- The findbugs is not related, will commit it later. Thanks Ted

[jira] [Created] (HDFS-7760) Further update user doc for truncate

Yi Liu created HDFS-7760: Summary: Further update user doc for truncate Key: HDFS-7760 URL: https://issues.apache.org/jira/browse/HDFS-7760 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313673#comment-14313673 ] Hadoop QA commented on HDFS-7058: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7608: - Status: Patch Available (was: Open) hdfs dfsclient newConnectedPeer has no write timeout

[jira] [Resolved] (HDFS-7652) Process block reports for erasure coded blocks

[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7652. - Resolution: Fixed Process block reports for erasure coded blocks

[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312626#comment-14312626 ] Akira AJISAKA commented on HDFS-7754: - Sorry, I missed this jira. I'll see it. Fix

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312645#comment-14312645 ] Akira AJISAKA commented on HDFS-7753: - I'm +1 for ignoring the warning by adding an

[jira] [Commented] (HDFS-7710) Remove dead code in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312655#comment-14312655 ] Haohui Mai commented on HDFS-7710: -- [~ajisakaa], just a head up -- please make sure that

[jira] [Assigned] (HDFS-4718) TestHDFSCLI regexps reject valid user names

[ https://issues.apache.org/jira/browse/HDFS-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dasha Boudnik reassigned HDFS-4718: --- Assignee: Dasha Boudnik TestHDFSCLI regexps reject valid user names

[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312735#comment-14312735 ] Akira AJISAKA commented on HDFS-7754: - Thanks [~wheat9] for the review comment. bq. I

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312782#comment-14312782 ] Arpit Agarwal commented on HDFS-7647: - Thanks for the explanation - I missed that. The

[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312649#comment-14312649 ] Haohui Mai commented on HDFS-7754: -- I don't think that there is a significant performance

[jira] [Commented] (HDFS-6743) Put IP address into a new column on the new NN webUI

[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312657#comment-14312657 ] Haohui Mai commented on HDFS-6743: -- Given the fact that we're kind of out of space in the

[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312742#comment-14312742 ] Haohui Mai commented on HDFS-7754: -- bq. Is it really? Would you tell me why there is no

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312771#comment-14312771 ] Milan Desai commented on HDFS-7647: --- Hi [~arpitagarwal], I added those in because

[jira] [Updated] (HDFS-7647) DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs

[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7647: Summary: DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs (was:

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311910#comment-14311910 ] Yong Zhang commented on HDFS-7613: -- Hi zhe, Walter Su works with us together on this work,

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311909#comment-14311909 ] Yong Zhang commented on HDFS-7613: -- Hi zhe, Walter Su works with us together on this work,

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311918#comment-14311918 ] Hadoop QA commented on HDFS-7058: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

Liang Xie created HDFS-7763: --- Summary: fix zkfc hung issue due to not catching exception in a corner case Key: HDFS-7763 URL: https://issues.apache.org/jira/browse/HDFS-7763 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7760: - Fix Version/s: (was: 2.7.0) Further update user doc for truncate

[jira] [Commented] (HDFS-7764) DirectoryScanner should cancel the future tasks when #compileReport throws exception

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313772#comment-14313772 ] Rakesh R commented on HDFS-7764: Attached a patch where it will signal

[jira] [Commented] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313742#comment-14313742 ] Zhe Zhang commented on HDFS-7716: - Thanks for the patch Jing! I just finished reading

[jira] [Updated] (HDFS-7764) DirectoryScanner should cancel the future tasks when #compileReport throws exception

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7764: --- Attachment: HDFS-7764.patch DirectoryScanner should cancel the future tasks when #compileReport throws

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: jstack.4936 HDFS-7763.txt fix zkfc hung issue due to not catching exception in

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7608: - Fix Version/s: (was: 2.6.0) hdfs dfsclient newConnectedPeer has no write timeout

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7608: - Target Version/s: 2.7.0 (was: 2.6.0) hdfs dfsclient newConnectedPeer has no write timeout

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312528#comment-14312528 ] Zhe Zhang commented on HDFS-7652: - Thanks Jing for taking care of the {{BlockInfo}}

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312566#comment-14312566 ] Jing Zhao commented on HDFS-7652: - Thanks Zhe! +1 for the latest patch. Process block

[jira] [Commented] (HDFS-7467) Provide storage tier information for a directory via fsck

[ https://issues.apache.org/jira/browse/HDFS-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312484#comment-14312484 ] Benoy Antony commented on HDFS-7467: The findbugs warning and test failure are

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312535#comment-14312535 ] Anu Engineer commented on HDFS-7684: The failure does not seem to be related to this

[jira] [Updated] (HDFS-7652) Process block reports for erasure coded blocks

[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7652: Attachment: HDFS-7652.006.patch Process block reports for erasure coded blocks

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312643#comment-14312643 ] Colin Patrick McCabe commented on HDFS-7744: address Akira's comments Fix

[jira] [Updated] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7744: --- Attachment: HDFS-7744.002.patch Fix potential NPE in DFSInputStream after

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312550#comment-14312550 ] Ravi Prakash commented on HDFS-7753: Hi Rakesh! Not very many people use the

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312575#comment-14312575 ] Zhe Zhang commented on HDFS-7652: - I just committed to HDFS-EC. Thanks Jing for the help on

[jira] [Updated] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7716: Attachment: HDFS-7716.001.patch Update the patch: # Rebase the patch based on the recent changes (HDFS-7743

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313262#comment-14313262 ] Konstantin Shvachko commented on HDFS-4114: --- Yes, it is still quite useful for

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313267#comment-14313267 ] Tsz Wo Nicholas Sze commented on HDFS-4114: --- Are both BackupNode and

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313272#comment-14313272 ] Hadoop QA commented on HDFS-6133: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313273#comment-14313273 ] Zhe Zhang commented on HDFS-7285: - bq. We should keep HDFS-EC for a while. tszwo] Good

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313293#comment-14313293 ] Kai Zheng commented on HDFS-7285: - bq.keep using HDFS-EC to name the primary branch I would

[jira] [Updated] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-7748: --- Target Version/s: 2.7.0 Separate ECN flags from the Status in the

[jira] [Updated] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-7270: --- Fix Version/s: 2.7.0 Add congestion signaling capability to DataNode write protocol

[jira] [Updated] (HDFS-7662) Erasure Coder API for encoding and decoding of block group

[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7662: Status: Open (was: Patch Available) Avoiding the messy incurred. Erasure Coder API for encoding and

[jira] [Updated] (HDFS-7664) Reed-Solomon ErasureCoder

[ https://issues.apache.org/jira/browse/HDFS-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7664: Description: This is to implement Reed-Solomon ErasureCoder using the API defined in HDFS-7662. It supports

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313304#comment-14313304 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- ... It avoids we having to update

[jira] [Commented] (HDFS-7662) Erasure Coder API for encoding and decoding of block group

[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313308#comment-14313308 ] Kai Zheng commented on HDFS-7662: - The minor XOR ErasureCoder implementation of this API is

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313313#comment-14313313 ] Konstantin Shvachko commented on HDFS-4114: --- BackupNode and CheckpointNode are

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313325#comment-14313325 ] Kai Zheng commented on HDFS-7285: - bq.It is easy to rename HDFS-EC to something else Glad

[jira] [Commented] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313328#comment-14313328 ] Hadoop QA commented on HDFS-7756: - {color:red}-1 overall{color}. Here are the results of

  1   2   >