[jira] [Commented] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2015-06-11 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581757#comment-14581757 ] gurmukh singh commented on HDFS-7134: - Any update on this behavior. I see this in 2.6.0

[jira] [Commented] (HDFS-8549) Abort the balancer if an upgrade is in progress

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581799#comment-14581799 ] Hudson commented on HDFS-8549: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #225 (See

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Description: Right now, during upgrades datanode is processing all the storage dirs

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Description: Right now, during upgrades datanode is processing all the storage dirs

[jira] [Updated] (HDFS-6249) Output AclEntry in PBImageXmlWriter

2015-06-11 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-6249: - Attachment: HDFS-6249.patch Output AclEntry in PBImageXmlWriter

[jira] [Created] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

2015-06-11 Thread Walter Su (JIRA)
Walter Su created HDFS-8580: --- Summary: Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto Key: HDFS-8580 URL: https://issues.apache.org/jira/browse/HDFS-8580 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8580: Description: Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought: Add a cellSize

[jira] [Updated] (HDFS-7618) Support read when a file is being converted

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7618: Description: When a file is being converted from replication to EC or vice versa, users should still be able

[jira] [Updated] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2015-06-11 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gurmukh singh updated HDFS-7134: Affects Version/s: 2.6.0 Replication count for a block should not update till the blocks have

[jira] [Updated] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist

2015-06-11 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8577: - Description: 1. Avoid retrying to recover lease on a file which does not exist {noformat} recoverLease

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581840#comment-14581840 ] Hadoop QA commented on HDFS-8572: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8580: Description: Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought: Add a cellSize

[jira] [Created] (HDFS-8576) Lease recovery returns false , eventhough recovery happens.

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8576: Summary: Lease recovery returns false , eventhough recovery happens. Key: HDFS-8576 URL: https://issues.apache.org/jira/browse/HDFS-8576 Project: Hadoop HDFS

[jira] [Created] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8577: Summary: Avoid retrying to recover lease on a file which does not exist Key: HDFS-8577 URL: https://issues.apache.org/jira/browse/HDFS-8577 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8549) Abort the balancer if an upgrade is in progress

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581812#comment-14581812 ] Hudson commented on HDFS-8549: -- FAILURE: Integrated in Hadoop-Yarn-trunk #955 (See

[jira] [Created] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
Raju Bairishetti created HDFS-8578: -- Summary: On upgrade, Datanode should process all storage/data dirs in parallel Key: HDFS-8578 URL: https://issues.apache.org/jira/browse/HDFS-8578 Project:

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Description: Right now, during upgrades datanode is processing all the storage dirs

[jira] [Updated] (HDFS-6249) Output AclEntry in PBImageXmlWriter

2015-06-11 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-6249: - Status: Patch Available (was: Open) Attached patch, Please review... Output

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581847#comment-14581847 ] Walter Su commented on HDFS-8494: - Zhe Zhang, Kai Zheng and I had a offline discussion.

[jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581856#comment-14581856 ] Walter Su commented on HDFS-8059: - BlockInfoStriped has {{ECSchema}} now, and maybe

[jira] [Updated] (HDFS-8577) Avoid retrying to recover lease on a file which does not exist

2015-06-11 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8577: - Description: 1. Avoid retrying to recover lease on a file which does not exist {noformat} recoverLease

[jira] [Created] (HDFS-8579) Update HDFS usage with missing options

2015-06-11 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8579: Summary: Update HDFS usage with missing options Key: HDFS-8579 URL: https://issues.apache.org/jira/browse/HDFS-8579 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-11 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8542: -- Attachment: HDFS-8542-00.patch WebHDFS getHomeDirectory behavior does not match

[jira] [Assigned] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-11 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8542: - Assignee: kanaka kumar avvaru WebHDFS getHomeDirectory behavior does not match

[jira] [Commented] (HDFS-8549) Abort the balancer if an upgrade is in progress

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581971#comment-14581971 ] Hudson commented on HDFS-8549: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #214 (See

[jira] [Commented] (HDFS-8549) Abort the balancer if an upgrade is in progress

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581986#comment-14581986 ] Hudson commented on HDFS-8549: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2153 (See

[jira] [Commented] (HDFS-8574) When block count for a volume exceeds dfs.blockreport.split.threshold, block report causes exception

2015-06-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581979#comment-14581979 ] Arpit Agarwal commented on HDFS-8574: - Hi [~ajithshetty], Thanks for reporting this.

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582036#comment-14582036 ] Yongjun Zhang commented on HDFS-8572: - Hi [~wheat9], Thanks for the new rev to address

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-11 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8542: -- Status: Patch Available (was: Open) Attached patch to consider the user from request

[jira] [Commented] (HDFS-8573) Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582200#comment-14582200 ] Lei (Eddy) Xu commented on HDFS-8573: - The {{pre-patch}} failure is not caused by this

[jira] [Commented] (HDFS-8573) Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline

2015-06-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582234#comment-14582234 ] Andrew Wang commented on HDFS-8573: --- LGTM I'll commit Move creation of restartMeta file

[jira] [Commented] (HDFS-8573) Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582242#comment-14582242 ] Lei (Eddy) Xu commented on HDFS-8573: - Thanks a lot for reviews, [~andrew.wang] Move

[jira] [Updated] (HDFS-8573) Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline

2015-06-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8573: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Pushed

[jira] [Commented] (HDFS-8573) Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582256#comment-14582256 ] Hudson commented on HDFS-8573: -- FAILURE: Integrated in Hadoop-trunk-Commit #8006 (See

[jira] [Commented] (HDFS-8543) Erasure Coding: processOverReplicatedBlock() handles striped block

2015-06-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582275#comment-14582275 ] Zhe Zhang commented on HDFS-8543: - Thanks Walter for the update. No worries :) The patch

[jira] [Commented] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582311#comment-14582311 ] Hadoop QA commented on HDFS-8542: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8580: Attachment: HDFS-8580.00.patch Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto

[jira] [Updated] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-06-11 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8581: -- Description: If one directory such as /result exists about 20 files, then when execute hdfs dfs

[jira] [Commented] (HDFS-8530) Restore ECZone info inside FSImageLoader

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581879#comment-14581879 ] Walter Su commented on HDFS-8530: - Let's get HDFS-8580 done first, then we can work on

[jira] [Updated] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-06-11 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8581: -- Description: If one directory such as /result exists about 20 files, then when execute hdfs dfs

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581893#comment-14581893 ] Yi Liu commented on HDFS-8499: -- The approach {{#1}}(04 patch) looks good. Some comments: We

[jira] [Created] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-06-11 Thread tongshiquan (JIRA)
tongshiquan created HDFS-8581: - Summary: count cmd calculate wrong when huge files exist in one folder Key: HDFS-8581 URL: https://issues.apache.org/jira/browse/HDFS-8581 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-06-11 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8581: -- Description: If one directory such as /result exists about 20 files, then when execute hdfs dfs

[jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581864#comment-14581864 ] Walter Su commented on HDFS-8059: - Approach 1:Keep (dataUnits, parityUnits, cellSize) as a

[jira] [Commented] (HDFS-8576) Lease recovery returns false , eventhough recovery happens.

2015-06-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582515#comment-14582515 ] Tsz Wo Nicholas Sze commented on HDFS-8576: --- The javadoc says @return true if the

[jira] [Commented] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582544#comment-14582544 ] Hudson commented on HDFS-8566: -- FAILURE: Integrated in Hadoop-trunk-Commit #8007 (See

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

2015-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8566: --- Summary: HDFS documentation about debug commands wrongly identifies them as hdfs dfs

[jira] [Updated] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8582: Summary: Reduce failure messages when running datanode reconfiguration (was: Spurious failure

[jira] [Commented] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-06-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582519#comment-14582519 ] Tsz Wo Nicholas Sze commented on HDFS-8384: --- Dean, I don't have a workaround

[jira] [Commented] (HDFS-8566) HDFS debug Command usage is wrong.

2015-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582520#comment-14582520 ] Colin Patrick McCabe commented on HDFS-8566: +1. Thanks, [~surendrasingh].

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582527#comment-14582527 ] Yongjun Zhang commented on HDFS-8572: - Hi [~wheat9], I both checked that the patch

[jira] [Created] (HDFS-8582) Spurious failure messages when running datanode reconfiguration

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8582: --- Summary: Spurious failure messages when running datanode reconfiguration Key: HDFS-8582 URL: https://issues.apache.org/jira/browse/HDFS-8582 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8582) Spurious failure messages when running datanode reconfiguration

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8582: Status: Patch Available (was: Open) Spurious failure messages when running datanode

[jira] [Updated] (HDFS-8582) Spurious failure messages when running datanode reconfiguration

2015-06-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8582: Attachment: HDFS-8582.000.patch {{DFSAdmin}} does not show a reconfigure failure if it is a not

[jira] [Updated] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8499: Attachment: HDFS-8499.05.patch Thanks Yi for the review! Uploading 05 patch to address the comments.

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2015-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582517#comment-14582517 ] Colin Patrick McCabe commented on HDFS-8564: Another possibility would be to

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

2015-06-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8566: --- Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: 2.7.1

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-06-11 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582672#comment-14582672 ] Nate Edel commented on HDFS-8078: - I've been developing it in trunk, and testing HDFS on

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582685#comment-14582685 ] Zhe Zhang commented on HDFS-8494: - Based on the above discussion, I think we have agreed to

[jira] [Updated] (HDFS-6022) Moving deadNodes from being thread local. Improving dead datanode handling in DFSClient

2015-06-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-6022: --- Labels: patch (was: BB2015-05-TBR patch) Moving deadNodes from being thread local. Improving

[jira] [Assigned] (HDFS-6022) Moving deadNodes from being thread local. Improving dead datanode handling in DFSClient

2015-06-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-6022: -- Assignee: Masatake Iwasaki (was: Colin Patrick McCabe) Moving deadNodes from being

[jira] [Commented] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2015-06-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582598#comment-14582598 ] Hudson commented on HDFS-8583: -- FAILURE: Integrated in Hadoop-trunk-Commit #8008 (See

[jira] [Moved] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2015-06-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal moved HADOOP-12069 to HDFS-8583: -- Component/s: (was: documentation)

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582620#comment-14582620 ] Hadoop QA commented on HDFS-8499: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-6022) Moving deadNodes from being thread local. Improving dead datanode handling in DFSClient

2015-06-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582599#comment-14582599 ] Masatake Iwasaki commented on HDFS-6022: Thanks, [~cmccabe]. I'm looking into this.

[jira] [Commented] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582597#comment-14582597 ] Hadoop QA commented on HDFS-8583: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582625#comment-14582625 ] Zhe Zhang commented on HDFS-8499: - All 3 reported failures / timeout pass locally. Merge

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-06-11 Thread khanderao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582627#comment-14582627 ] khanderao commented on HDFS-7240: - Great initiative! Jitendra and team. 1. What are the

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582975#comment-14582975 ] Walter Su commented on HDFS-8499: - Commonts on 05 patch and Yi's previous comment:

[jira] [Created] (HDFS-8585) Remove dataBlockNum and parityBlockNum from StripedBlockProto

2015-06-11 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8585: Summary: Remove dataBlockNum and parityBlockNum from StripedBlockProto Key: HDFS-8585 URL: https://issues.apache.org/jira/browse/HDFS-8585 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582956#comment-14582956 ] Hadoop QA commented on HDFS-7048: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582972#comment-14582972 ] Zhe Zhang commented on HDFS-8499: - Thanks for the comment Yi. We certainly can have static

[jira] [Commented] (HDFS-8572) DN always uses HTTP/localhost@REALM principals in SPNEGO

2015-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582906#comment-14582906 ] Yongjun Zhang commented on HDFS-8572: - Hi Haohui, Thanks again for the solution. As we

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582907#comment-14582907 ] Raju Bairishetti commented on HDFS-8578: I am not seeing any critical section code

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-06-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582935#comment-14582935 ] Vinayakumar B commented on HDFS-8277: - bq. Agreed, and this is is because the manual

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-06-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582941#comment-14582941 ] Vinayakumar B commented on HDFS-8277: - bq. if you mean including the above in addition

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582943#comment-14582943 ] Amareshwari Sriramadasu commented on HDFS-8578: --- doTransition is doing either

[jira] [Assigned] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu reassigned HDFS-7048: --- Assignee: Chengbing Liu Incorrect Balancer#Source wait/notify leads to early termination

[jira] [Commented] (HDFS-8569) TestDeadDatanode#testDeadDatanode is failing

2015-06-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581496#comment-14581496 ] Vinayakumar B commented on HDFS-8569: - We are seeing issues related to

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581543#comment-14581543 ] Yongjun Zhang commented on HDFS-8572: - Hi [~wheat9], Thanks for the new rev. Two

[jira] [Commented] (HDFS-8543) Erasure Coding: processOverReplicatedBlock() handles striped block

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581513#comment-14581513 ] Hadoop QA commented on HDFS-8543: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582750#comment-14582750 ] Yi Liu commented on HDFS-8499: -- Zhe, I don't quite get your point. For Striped, we will have

[jira] [Updated] (HDFS-8572) DN always uses HTTP/localhost@REALM principals in SPNEGO

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8572: - Description: In HDFS-7279 the Netty server in DN proxies all servlet requests to the local Jetty

[jira] [Created] (HDFS-8584) Support using ramfs partitions on Linux

2015-06-11 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8584: --- Summary: Support using ramfs partitions on Linux Key: HDFS-8584 URL: https://issues.apache.org/jira/browse/HDFS-8584 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582869#comment-14582869 ] Chengbing Liu commented on HDFS-7048: - Here is a bit explanation for the patch. On our

[jira] [Updated] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7048: Target Version/s: (was: 2.6.0) Incorrect Balancer#Source wait/notify leads to early termination

[jira] [Updated] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7048: Affects Version/s: 2.7.0 Incorrect Balancer#Source wait/notify leads to early termination

[jira] [Commented] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

2015-06-11 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582885#comment-14582885 ] surendra singh lilhore commented on HDFS-8566: -- Thanks [~cmccabe] for

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-11 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Issue Type: Improvement (was: Bug) On upgrade, Datanode should process all storage/data dirs

[jira] [Commented] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582783#comment-14582783 ] Hadoop QA commented on HDFS-8582: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2015-06-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8583: Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: (was: 2.7.1)

[jira] [Updated] (HDFS-8572) DN always use HTTP/localhost@REALM principals in SPNEGO

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8572: - Summary: DN always use HTTP/localhost@REALM principals in SPNEGO (was: DN uses incorrect kerberos

[jira] [Updated] (HDFS-8572) DN always uses HTTP/localhost@REALM principals in SPNEGO

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8572: - Summary: DN always uses HTTP/localhost@REALM principals in SPNEGO (was: DN always use

[jira] [Updated] (HDFS-8572) DN always uses HTTP/localhost@REALM principals in SPNEGO

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8572: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7048: Status: Patch Available (was: Open) Incorrect Balancer#Source wait/notify leads to early

[jira] [Updated] (HDFS-7048) Incorrect Balancer#Source wait/notify leads to early termination

2015-06-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7048: Attachment: HDFS-7048.01.patch the uploaded patch wait/notify on the source and target, instead of

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581625#comment-14581625 ] Hadoop QA commented on HDFS-8572: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581646#comment-14581646 ] Haohui Mai commented on HDFS-8572: -- bq. Is this expected? if so, why we don't need to set

[jira] [Updated] (HDFS-8572) DN uses incorrect kerberos principals in spnego authentication

2015-06-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8572: - Attachment: HDFS-8572.002.patch DN uses incorrect kerberos principals in spnego authentication

[jira] [Updated] (HDFS-8570) KMS restful API for Generating Encrypted Key with Current KeyVersion will roll keyversion

2015-06-11 Thread huangyitian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyitian updated HDFS-8570: -- Summary: KMS restful API for Generating Encrypted Key with Current KeyVersion will roll keyversion

  1   2   >