[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-03 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407034#comment-15407034 ] Yuanbo Liu commented on HDFS-10645: --- I don't think these failures are related to my change. Resume the

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-03 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Status: Patch Available (was: In Progress) > Make block report size as a metric and add this metric to

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-03 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Status: In Progress (was: Patch Available) > Make block report size as a metric and add this metric to

[jira] [Commented] (HDFS-10169) TestEditLog.testBatchedSyncWithClosedLogs with useAsyncEditLog sometimes fails

2016-08-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407030#comment-15407030 ] Rakesh R commented on HDFS-10169: - This test is failing frequently in Jenkins build, could someone help in

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10718: - Release Note: Re-submitted the patch to trigger Jenkins building. Status: Patch Available (was:

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-08-03 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407012#comment-15407012 ] Fenghua Hu commented on HDFS-10690: --- Xiaoyu, [~xiaoyuyao] I tried to replace TreeMap with

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10718: - Status: Open (was: Patch Available) > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Commented] (HDFS-10434) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407001#comment-15407001 ] Rakesh R commented on HDFS-10434: - Thanks [~yzhangal], [~liuml07] for pointing out this. I'll dig more

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-08-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406986#comment-15406986 ] Weiwei Yang commented on HDFS-10569: My pleasure thanks [~kihwal] > A bug causes OutOfIndex error in

[jira] [Comment Edited] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406965#comment-15406965 ] Guangbin Zhu edited comment on HDFS-10715 at 8/4/16 1:43 AM: - Many thanks

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406965#comment-15406965 ] Guangbin Zhu commented on HDFS-10715: - Many thanks Kihawal. I found one failed test

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406669#comment-15406669 ] Chen Liang commented on HDFS-10682: --- Thanks to [~arpitagarwal] for the advise! I moved the separate lock

[jira] [Commented] (HDFS-10707) Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406657#comment-15406657 ] Hadoop QA commented on HDFS-10707: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10434) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406648#comment-15406648 ] Kai Zheng commented on HDFS-10434: -- Traveling this week, please expect delayed response. Thanks. > Fix

[jira] [Commented] (HDFS-10434) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-08-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406645#comment-15406645 ] Mingliang Liu commented on HDFS-10434: -- And the test failure happens again at

[jira] [Commented] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406612#comment-15406612 ] Kai Zheng commented on HDFS-10718: -- Good catch, [~Sammi]! The patch looks great, +1 pending on Jenkins.

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406592#comment-15406592 ] Hadoop QA commented on HDFS-9271: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406582#comment-15406582 ] Hudson commented on HDFS-10569: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10208 (See

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10569: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10569: -- Priority: Minor (was: Major) > A bug causes OutOfIndex error in BlockListAsLongs >

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406554#comment-15406554 ] Kihwal Lee commented on HDFS-10569: --- The failed test is passing for me with the patch. HDFS-10572

[jira] [Commented] (HDFS-9271) Implement basic NN operations

2016-08-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406547#comment-15406547 ] James Clampffer commented on HDFS-9271: --- Overall the patch looks good to me. Just some really minor

[jira] [Updated] (HDFS-9271) Implement basic NN operations

2016-08-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9271: -- Attachment: HDFS-9271.HDFS-8707.007.patch I went ahead and resolved some minor merge conflicts

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406539#comment-15406539 ] Chen Liang commented on HDFS-10682: --- The failed tests are unrelated. > Replace FsDatasetImpl object

[jira] [Commented] (HDFS-10710) In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection

2016-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406530#comment-15406530 ] Hudson commented on HDFS-10710: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10206 (See

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406528#comment-15406528 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10710) In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection

2016-08-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10710: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-10707) Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets

2016-08-03 Thread Vincent Poon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated HDFS-10707: Attachment: HDFS-10707.branch-2.patch fix style > Replace org.apache.commons.io.Charsets with

[jira] [Updated] (HDFS-10707) Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets

2016-08-03 Thread Vincent Poon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated HDFS-10707: Attachment: (was: HDFS-10707.branch-2.patch) > Replace org.apache.commons.io.Charsets with

[jira] [Updated] (HDFS-10710) In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection

2016-08-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10710: - Summary: In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406370#comment-15406370 ] Chen Liang commented on HDFS-10682: --- Thanks for the review [~arpitagarwal]! Uploaded another patch to

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.009.patch > Replace FsDatasetImpl object lock with a separate lock object >

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406363#comment-15406363 ] Hadoop QA commented on HDFS-10619: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10674) Optimize creating a full path from an inode

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406340#comment-15406340 ] Kihwal Lee commented on HDFS-10674: --- +1 the patch looks good. > Optimize creating a full path from an

[jira] [Updated] (HDFS-10674) Optimize creating a full path from an inode

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10674: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406333#comment-15406333 ] Hadoop QA commented on HDFS-10662: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10710) In BlockManager#rescanPostponedMisreplicatedBlocks(), start and end block counts should be get with the protect with lock

2016-08-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406326#comment-15406326 ] Jing Zhao commented on HDFS-10710: -- The patch looks good to me. The failed tests should be unrelated:

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406317#comment-15406317 ] Arpit Agarwal commented on HDFS-10682: -- Thanks for working through the patch iterations

[jira] [Commented] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

2016-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406286#comment-15406286 ] Hudson commented on HDFS-742: - SUCCESS: Integrated in Hadoop-trunk-Commit #10203 (See

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-08-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406266#comment-15406266 ] Daryn Sharp commented on HDFS-10673: [~jingzhao]? > Optimize FSPermissionChecker's internal path

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406272#comment-15406272 ] Kihwal Lee commented on HDFS-10715: --- [~zhuguangbin86], I've added you as a contributor and assigned this

[jira] [Commented] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406268#comment-15406268 ] Hadoop QA commented on HDFS-10719: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10674) Optimize creating a full path from an inode

2016-08-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406269#comment-15406269 ] Daryn Sharp commented on HDFS-10674: TestSnapshotFileLength is unrelated. It's not about the path

[jira] [Updated] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10715: -- Assignee: Guangbin Zhu > NPE when applying AvailableSpaceBlockPlacementPolicy >

[jira] [Updated] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-742: Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 2.8.0

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-08-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406257#comment-15406257 ] Daryn Sharp commented on HDFS-9781: --- Yes, in {{FsDatasetImpl#getBlockReports()}}, this chunk: {code}

[jira] [Commented] (HDFS-10656) Optimize conversion of byte arrays back to path string

2016-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406250#comment-15406250 ] Hudson commented on HDFS-10656: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10202 (See

[jira] [Commented] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

2016-08-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406242#comment-15406242 ] Daryn Sharp commented on HDFS-742: -- +1 A triple-digit jira! > A down DataNode makes Balancer to hang on

[jira] [Commented] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406233#comment-15406233 ] Kihwal Lee commented on HDFS-742: - The test failure is due to HDFS-9781. > A down DataNode makes Balancer

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406222#comment-15406222 ] Kihwal Lee commented on HDFS-10619: --- HDFS-10653 got committed. I will run this through precommit one

[jira] [Commented] (HDFS-10656) Optimize conversion of byte arrays back to path string

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406204#comment-15406204 ] Kihwal Lee commented on HDFS-10656: --- It looks like existing test cases (e.g. TestPathComponents) are

[jira] [Updated] (HDFS-10656) Optimize conversion of byte arrays back to path string

2016-08-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10656: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-08-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Attachment: HDFS-10662.patch.1 resolved minor conflicts. > Optimize UTF8 string/byte conversions >

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Status: Patch Available (was: Open) > In HA, Namenode is failed to start If any of the

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Description: 2016-08-03 02:53:53,760 ERROR namenode.NameNode (NameNode.java:main(1712))

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Description: 2016-08-03 02:53:53,760 ERROR namenode.NameNode (NameNode.java:main(1712))

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: HDFS-10719-1.patch > In HA, Namenode is failed to start If any of the

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: (was: HADOOP-HDFS-10719-1-patch) > In HA, Namenode is failed to start

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Affects Version/s: 2.7.1 > In HA, Namenode is failed to start If any of the Quorum

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: (was: HADOOP-HDFS-10719-2.patch) > In HA, Namenode is failed to start

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: HADOOP-HDFS-10719-2.patch > In HA, Namenode is failed to start If any of

[jira] [Updated] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palanisamy updated HDFS-10719: -- Attachment: HADOOP-HDFS-10719-1-patch > In HA, Namenode is failed to start If any of

[jira] [Created] (HDFS-10719) In HA, Namenode is failed to start If any of the Quorum hostname is unresolved.

2016-08-03 Thread Karthik Palanisamy (JIRA)
Karthik Palanisamy created HDFS-10719: - Summary: In HA, Namenode is failed to start If any of the Quorum hostname is unresolved. Key: HDFS-10719 URL: https://issues.apache.org/jira/browse/HDFS-10719

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2016-08-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405968#comment-15405968 ] Vinayakumar B commented on HDFS-8498: - We experienced this in one of our testing cluster under high

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405915#comment-15405915 ] Hadoop QA commented on HDFS-10625: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10625: - Attachment: HDFS-10625.004.patch > VolumeScanner to report why a block is found bad >

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405774#comment-15405774 ] Yiqun Lin commented on HDFS-10625: -- Thanks a lot for the review, [~vinayrpet]. Post a new patch for

[jira] [Commented] (HDFS-10586) Erasure Code misfunctions when 3 DataNode down

2016-08-03 Thread gao shan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405759#comment-15405759 ] gao shan commented on HDFS-10586: - By running "hadoop fsck" , I find the following info. It shows the

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405692#comment-15405692 ] Hadoop QA commented on HDFS-10715: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Attachment: HDFS-10718-v1.patch > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Status: Patch Available (was: Open) > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangbin Zhu updated HDFS-10715: Attachment: HDFS-10715.004.patch fix checkstyle > NPE when applying

[jira] [Commented] (HDFS-4176) EditLogTailer should call rollEdits with a timeout

2016-08-03 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405585#comment-15405585 ] Surendra Singh Lilhore commented on HDFS-4176: -- Hi [~eddyxu] One minor comments. {code} +

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405567#comment-15405567 ] Vinayakumar B commented on HDFS-10625: -- one nit, I thought it was already mentioned.

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405547#comment-15405547 ] Hadoop QA commented on HDFS-10715: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405522#comment-15405522 ] Yiqun Lin commented on HDFS-10625: -- Thanks [~yzhangal] and [~shahrs87] for the review. Hi, [~vinayrpet],

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405476#comment-15405476 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
SammiChen created HDFS-10718: Summary: Prefer direct ByteBuffer in native RS encoder and decoder Key: HDFS-10718 URL: https://issues.apache.org/jira/browse/HDFS-10718 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangbin Zhu updated HDFS-10715: Attachment: HDFS-10715.003.patch code refactoring > NPE when applying

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405391#comment-15405391 ] Guangbin Zhu commented on HDFS-10715: - Thanks Akira, I'll fix it and submit another patch. > NPE when

[jira] [Commented] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2016-08-03 Thread Guangbin Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405390#comment-15405390 ] Guangbin Zhu commented on HDFS-10715: - Thanks Akira, I'll fix it and submit another patch. > NPE when