[jira] [Updated] (HDFS-7371) Loading predefined EC schemas from configuration

2015-02-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7371: Attachment: HDFS-7371_v1.patch Uploaded a patch to load predefined ec schemas from an XML configuration file

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341411#comment-14341411 ] Arun Suresh commented on HDFS-7858: --- [~bikassaha], you make a very valid point. I guess

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341474#comment-14341474 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341472#comment-14341472 ] Hudson commented on HDFS-7308: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341473#comment-14341473 ] Hudson commented on HDFS-7685: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341471#comment-14341471 ] Hudson commented on HDFS-6753: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341486#comment-14341486 ] Hudson commented on HDFS-7685: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #852 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341515#comment-14341515 ] Hudson commented on HDFS-7308: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341517#comment-14341517 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341516#comment-14341516 ] Hudson commented on HDFS-7685: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341547#comment-14341547 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #109 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341545#comment-14341545 ] Hudson commented on HDFS-7308: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #109 (See

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341546#comment-14341546 ] Hudson commented on HDFS-7685: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #109 (See

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341584#comment-14341584 ] Hudson commented on HDFS-7685: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2068 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341583#comment-14341583 ] Hudson commented on HDFS-7308: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2068 (See

[jira] [Commented] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

2015-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341453#comment-14341453 ] Hadoop QA commented on HDFS-7759: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341585#comment-14341585 ] Hudson commented on HDFS-7769: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2068 (See

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341484#comment-14341484 ] Hudson commented on HDFS-6753: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #852 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341485#comment-14341485 ] Hudson commented on HDFS-7308: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #852 (See

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341487#comment-14341487 ] Hudson commented on HDFS-7769: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #852 (See

[jira] [Commented] (HDFS-7845) Compress block reports

2015-02-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341828#comment-14341828 ] Todd Lipcon commented on HDFS-7845: --- fwiw I ran a quick test on a random DN I found in

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341539#comment-14341539 ] Hudson commented on HDFS-7685: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2050 (See

[jira] [Commented] (HDFS-7308) DFSClient write packet size may 64kB

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341538#comment-14341538 ] Hudson commented on HDFS-7308: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2050 (See

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341540#comment-14341540 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2050 (See

[jira] [Updated] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7261: - Description: Here is the code: {code} failedStorageInfos = new HashSetDatanodeStorageInfo(

[jira] [Commented] (HDFS-7757) Misleading error messages in FSImage.java

2015-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341722#comment-14341722 ] Brahma Reddy Battula commented on HDFS-7757: [~arpitagarwal] and [~xyao] any

[jira] [Commented] (HDFS-7845) Compress block reports

2015-02-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341822#comment-14341822 ] Todd Lipcon commented on HDFS-7845: --- One quick hint here that may help: for a series of

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341849#comment-14341849 ] Bikas Saha commented on HDFS-7858: -- What are long lived client examples? How many such

[jira] [Created] (HDFS-7863) Missing description of parameter fsd in javadoc

2015-02-28 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-7863: --- Summary: Missing description of parameter fsd in javadoc Key: HDFS-7863 URL: https://issues.apache.org/jira/browse/HDFS-7863 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-7863) Missing description of parameter fsd in javadoc

2015-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7863: -- Assignee: Brahma Reddy Battula Missing description of parameter fsd in javadoc

[jira] [Commented] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-02-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341807#comment-14341807 ] Eric Payne commented on HDFS-7818: -- Hi [~wheat9]. Did you have a chance to think about my

[jira] [Commented] (HDFS-7845) Compress block reports

2015-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341842#comment-14341842 ] Brahma Reddy Battula commented on HDFS-7845: Yes,plain snappy and lz4 might not

[jira] [Assigned] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7261: -- Assignee: Brahma Reddy Battula storageMap is accessed without synchronization

[jira] [Commented] (HDFS-5292) clean up output of `dfs -du -s`

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342002#comment-14342002 ] Allen Wittenauer commented on HDFS-5292: +1, but for trunk only since it changes

[jira] [Updated] (HDFS-7231) rollingupgrade needs some guard rails

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7231: --- Priority: Critical (was: Blocker) rollingupgrade needs some guard rails

[jira] [Updated] (HDFS-1447) Make getGenerationStampFromFile() more efficient, so it doesn't reprocess full directory listing for every block

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1447: --- Status: Open (was: Patch Available) Canceling patch. Make getGenerationStampFromFile() more

[jira] [Commented] (HDFS-5853) Add hadoop.user.group.metrics.percentiles.intervals to hdfs-default.xml

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342008#comment-14342008 ] Allen Wittenauer commented on HDFS-5853: +1. Those failures have to be wrong. Add

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4681: --- Assignee: Ayappan (was: Suresh Srinivas)

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4681: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-5292) clean up output of `dfs -du -s`

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5292: --- Target Version/s: 3.0.0 (was: 2.7.0) Release Note: The output of du has now been made

[jira] [Resolved] (HDFS-3267) TestBlocksWithNotEnoughRacks races with DN startup

2015-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-3267. Resolution: Duplicate Closing as a dupe of HDFS-4681 because that one at least has a patch.

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342036#comment-14342036 ] Hudson commented on HDFS-4681: -- FAILURE: Integrated in Hadoop-trunk-Commit #7229 (See