[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718106#comment-14718106 ] Hudson commented on HDFS-8900: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2264 (See

[jira] [Updated] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-08-28 Thread Lifeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lifeng Wang updated HDFS-8987: -- Summary: Erasure coding: MapReduce job failed when I set the / folder to the EC zone (was: Erasure

[jira] [Updated] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / foler to the EC zone

2015-08-28 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8987: - Description: Test progress is as follows * For a new cluster, I format the namenode and then start HDFS service.

[jira] [Commented] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / foler to the EC zone

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718113#comment-14718113 ] Zhe Zhang commented on HDFS-8987: - Thanks for testing and finding the issue [~Lifeng Wang].

[jira] [Commented] (HDFS-8960) DFS client says no more good datanodes being available to try on a single drive failure

2015-08-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718146#comment-14718146 ] Yongjun Zhang commented on HDFS-8960: - Yes, it's trying to do pipeline recovery, see

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-8793 Use LightWeightHashSet instead of

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Status: Patch Available (was: Open) Use LightWeightHashSet instead of LightWeightLinkedSet in

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718121#comment-14718121 ] Hadoop QA commented on HDFS-8704: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-08-28 Thread Lifeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718116#comment-14718116 ] Lifeng Wang commented on HDFS-8987: --- OK. Please help to close this JIRA. Erasure

[jira] [Resolved] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8987. - Resolution: Duplicate Erasure coding: MapReduce job failed when I set the / folder to the EC zone

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718102#comment-14718102 ] Hadoop QA commented on HDFS-8965: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8963) Fix incorrect sign extension of xattr length in HDFS-8900

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718105#comment-14718105 ] Hudson commented on HDFS-8963: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2264 (See

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Description: {code} public final MapString, LightWeightLinkedSetBlock excessReplicateMap = new HashMap(); {code}

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Attachment: HDFS-8988.001.patch Use LightWeightHashSet instead of LightWeightLinkedSet in

[jira] [Updated] (HDFS-8987) MapReduce job failed when I set the / foler to the EC zone

2015-08-28 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8987: - Issue Type: Sub-task (was: Bug) Parent: HDFS-7285 MapReduce job failed when I set the / foler to the EC

[jira] [Updated] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / foler to the EC zone

2015-08-28 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8987: - Summary: Erasure coding: MapReduce job failed when I set the / foler to the EC zone (was: MapReduce job failed

[jira] [Reopened] (HDFS-8689) move hasClusterEverBeenMultiRack to NetworkTopology

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su reopened HDFS-8689: - move hasClusterEverBeenMultiRack to NetworkTopology ---

[jira] [Resolved] (HDFS-8689) move hasClusterEverBeenMultiRack to NetworkTopology

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8689. - Resolution: Invalid move hasClusterEverBeenMultiRack to NetworkTopology

[jira] [Created] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8988: Summary: Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap Key: HDFS-8988 URL: https://issues.apache.org/jira/browse/HDFS-8988 Project:

[jira] [Resolved] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8987. - Resolution: Fixed Erasure coding: MapReduce job failed when I set the / folder to the EC zone

[jira] [Reopened] (HDFS-8987) Erasure coding: MapReduce job failed when I set the / folder to the EC zone

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-8987: - Erasure coding: MapReduce job failed when I set the / folder to the EC zone

[jira] [Commented] (HDFS-8963) Fix incorrect sign extension of xattr length in HDFS-8900

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718147#comment-14718147 ] Hudson commented on HDFS-8963: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #307 (See

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718148#comment-14718148 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #307 (See

[jira] [Updated] (HDFS-8964) Provide max TxId when validating in-progress edit log files

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8964: Attachment: HDFS-8964.01.patch Thanks Colin for taking a look. Updating the patch to better handle cases

[jira] [Commented] (HDFS-8978) Erasure coding: fix 2 failed tests of DFSStripedOutputStream

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718158#comment-14718158 ] Hadoop QA commented on HDFS-8978: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8987) MapReduce job failed when I set the / foler to the EC zone

2015-08-28 Thread Lifeng Wang (JIRA)
Lifeng Wang created HDFS-8987: - Summary: MapReduce job failed when I set the / foler to the EC zone Key: HDFS-8987 URL: https://issues.apache.org/jira/browse/HDFS-8987 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718222#comment-14718222 ] Masatake Iwasaki commented on HDFS-8946: Thanks for working on this, [~Hitliuyi]. I

[jira] [Commented] (HDFS-5714) Use byte array to represent UnderConstruction feature and Snapshot feature for INodeFile

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718219#comment-14718219 ] Yi Liu commented on HDFS-5714: -- Thanks [~jingzhao]. I think this is good, can you rebase the

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

2015-08-28 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718235#comment-14718235 ] Li Bo commented on HDFS-8704: - The two failed test cases are about insufficient datanodes. They

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718343#comment-14718343 ] Hadoop QA commented on HDFS-8988: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8501) Erasure Coding: Improve memory efficiency of BlockInfoStriped

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8501: Attachment: HDFS-8501-HDFS-7285.01.patch Erasure Coding: Improve memory efficiency of BlockInfoStriped

[jira] [Commented] (HDFS-8964) Provide max TxId when validating in-progress edit log files

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718390#comment-14718390 ] Hadoop QA commented on HDFS-8964: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8946: - Attachment: HDFS-8946.003.patch Improve choosing datanode storage for block placement

[jira] [Updated] (HDFS-8501) Erasure Coding: Improve memory efficiency of BlockInfoStriped

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8501: Status: Patch Available (was: Open) Erasure Coding: Improve memory efficiency of BlockInfoStriped

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-28 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718197#comment-14718197 ] GAO Rui commented on HDFS-7285: --- Thank you very much [~brahmareddy], [~zhz]. {quote} 1)

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718232#comment-14718232 ] Yi Liu commented on HDFS-8946: -- Thanks Masatake for the comments. {quote} LocatedBlock

[jira] [Commented] (HDFS-8963) Fix incorrect sign extension of xattr length in HDFS-8900

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718199#comment-14718199 ] Hudson commented on HDFS-8963: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2245 (See

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718200#comment-14718200 ] Hudson commented on HDFS-8900: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2245 (See

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718234#comment-14718234 ] Yi Liu commented on HDFS-8946: -- Will update the patch later. Improve choosing datanode

[jira] [Commented] (HDFS-8973) NameNode exit without any exception log

2015-08-28 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718325#comment-14718325 ] kanaka kumar avvaru commented on HDFS-8973: --- Regarding logs not printed, looks

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-28 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7285: -- Attachment: HDFSErasureCodingSystemTestReport-20150826.pdf Based on latest version of branch HDFS-7285, we

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718226#comment-14718226 ] Masatake Iwasaki commented on HDFS-8946: DatanodeDescriptor.java {code} 679

[jira] [Commented] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-28 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718308#comment-14718308 ] kanaka kumar avvaru commented on HDFS-8892: --- Hi [~Ravikumar], are you planning to

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

2015-08-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718588#comment-14718588 ] Daryn Sharp commented on HDFS-8967: --- This mimics a subset of what I've been working on,

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718396#comment-14718396 ] Walter Su commented on HDFS-8833: - ...encode replication and ecPolicy together (Zhe Zhang)

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.005.patch Tests are all passing. Again. NameNode refresh doesn't

[jira] [Commented] (HDFS-8501) Erasure Coding: Improve memory efficiency of BlockInfoStriped

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14719964#comment-14719964 ] Hadoop QA commented on HDFS-8501: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-2070: --- Status: Patch Available (was: In Progress) Ready for review. This should be a quick and easy

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14719294#comment-14719294 ] Hadoop QA commented on HDFS-8946: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-2070: --- Attachment: HDFS-2070.001.patch Turns out there was already one getmerge test in the

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720929#comment-14720929 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2249 (See

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720913#comment-14720913 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720907#comment-14720907 ] Hadoop QA commented on HDFS-8965: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720899#comment-14720899 ] Yi Liu commented on HDFS-8946: -- The test failure is not related, they run successfully in my

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720967#comment-14720967 ] Jitendra Nath Pandey commented on HDFS-8983: Thanks for addressing my comments

[jira] [Commented] (HDFS-8978) Erasure coding: fix 2 failed tests of DFSStripedOutputStream

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720954#comment-14720954 ] Hadoop QA commented on HDFS-8978: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720982#comment-14720982 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8983: Attachment: HDFS-8983.04.patch Thanks [~jnp]! Addressed in .04 patch. Also updated

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-28 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720070#comment-14720070 ] Bob Hansen commented on HDFS-8855: -- Xiaobing - is there a race condition in initializing

[jira] [Updated] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8938: - Status: Patch Available (was: Reopened) Extract BlockToMarkCorrupt and ReplicationWork as standalone

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720296#comment-14720296 ] Hadoop QA commented on HDFS-8950: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720043#comment-14720043 ] Chris Nauroth commented on HDFS-8155: - {code}

[jira] [Commented] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-28 Thread Ravikumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720116#comment-14720116 ] Ravikumar commented on HDFS-8892: - Please feel free to contribute the patch [~kanaka]. I am

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Attachment: HDFS-8155.006.patch Fixed ChrisN's final coment. Yeah, Jenkins is being weird for me. I

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Status: Open (was: Patch Available) Support OAuth2 in WebHDFS -

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Status: Patch Available (was: Open) Support OAuth2 in WebHDFS -

[jira] [Commented] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720417#comment-14720417 ] Hadoop QA commented on HDFS-2070: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720344#comment-14720344 ] Daryn Sharp commented on HDFS-8865: --- +1 This has made a huge difference, and all the

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720363#comment-14720363 ] Kihwal Lee commented on HDFS-8865: -- Thanks [~xyao] and [~daryn] for reviews. I've

[jira] [Resolved] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8865. -- Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Improve quota initialization

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Hadoop Flags: Reviewed Improve quota initialization performance

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720368#comment-14720368 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-trunk-Commit #8364 (See

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Status: In Progress (was: Patch Available) Improve quota initialization performance

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720370#comment-14720370 ] Kihwal Lee commented on HDFS-8879: -- Cherry-picked the fix to branch-2.7. Quota by

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8879: - Fix Version/s: (was: 2.8.0) 2.7.2 3.0.0 Quota by storage type

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720375#comment-14720375 ] Haohui Mai commented on HDFS-8779: -- -1 on the 03 patch. For 04 patch the javascript needs

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720399#comment-14720399 ] Haohui Mai commented on HDFS-8779: -- I'll upload a patch to demonstrate the idea later

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720750#comment-14720750 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #318 (See

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720768#comment-14720768 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720770#comment-14720770 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720769#comment-14720769 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.000.patch The v0 patch moves the {{RemoteBlockReader}} and

[jira] [Commented] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720793#comment-14720793 ] Haohui Mai commented on HDFS-8990: -- {code} public int available() throws IOException {

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720796#comment-14720796 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2267 (See

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.001.patch Move RemoteBlockReader to hdfs-client module

[jira] [Updated] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8983: Attachment: HDFS-8983.03.patch NameNode support for protected directories

[jira] [Created] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8990: --- Summary: Move RemoteBlockReader to hdfs-client module Key: HDFS-8990 URL: https://issues.apache.org/jira/browse/HDFS-8990 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Fix Version/s: (was: 2.8.0) Move RemoteBlockReader to hdfs-client module

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Hadoop Flags: (was: Reviewed) Move RemoteBlockReader to hdfs-client module

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720699#comment-14720699 ] Colin Patrick McCabe commented on HDFS-8965: bq. Do we also already have tests

[jira] [Updated] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8965: --- Attachment: HDFS-8965.005.patch Harden edit log reading code against out of memory

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720727#comment-14720727 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #324 (See

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720728#comment-14720728 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #324 (See

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720615#comment-14720615 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-trunk-Commit #8367 (See

[jira] [Updated] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8925: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720620#comment-14720620 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2247 (See

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720631#comment-14720631 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

  1   2   >