[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11135: - Description: I am making test for HDFS-11051, I found a serious issue: All the tests in {{TestBalancer}}

[jira] [Comment Edited] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663796#comment-15663796 ] Brahma Reddy Battula edited comment on HDFS-11135 at 11/14/16 12:39 PM:

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10802: -- Attachment: editsStored > [SPS]: Add satisfyStoragePolicy API in HdfsAdmin >

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10802: -- Attachment: HDFS-10802-HDFS-10285.002.patch > [SPS]: Add satisfyStoragePolicy API in HdfsAdmin >

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Attachment: HDFS-3-00.patch > Document dfs.client.read.striped configuration in hdfs-default.xml >

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Status: Patch Available (was: Open) Attached patch which includes the property into {{hdfs-default.xml}}

[jira] [Commented] (HDFS-11111) Delete something in .Trash using "rm" should be forbidden without safety option

2016-11-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663862#comment-15663862 ] Lantao Jin commented on HDFS-1: --- [~yuanbo] Thank you, your suggestions are very helpful for me. >

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663952#comment-15663952 ] Hadoop QA commented on HDFS-11135: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664127#comment-15664127 ] Yiqun Lin commented on HDFS-11135: -- Thanks [~brahmareddy] for the quick review. {quote} and can you also

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11135: - Attachment: HDFS-11135.001.patch > The tests in TestBalancer run fails due to NPE >

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11135: - Description: I am making test for HDFS-11051, I found a serious issue: All the tests in {{TestBalancer}}

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663812#comment-15663812 ] Brahma Reddy Battula commented on HDFS-11135: - linking the broken jira. > The tests in

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11135: - Status: Patch Available (was: Open) Attach a simple patch to make a quick fix. Thanks for the review. >

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11135: Component/s: test > The tests in TestBalancer run fails due to NPE >

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663796#comment-15663796 ] Brahma Reddy Battula commented on HDFS-11135: - [~linyiqun] Nice Catch, +1, Pending for

[jira] [Commented] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663930#comment-15663930 ] Hadoop QA commented on HDFS-3: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11135: Summary: The tests in TestBalancer run fails due to NPE Key: HDFS-11135 URL: https://issues.apache.org/jira/browse/HDFS-11135 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11135: - Description: I am making test for HDFS-11051, I found a serious issue: All the tests in {{TestBalancer}}

[jira] [Commented] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663218#comment-15663218 ] SammiChen commented on HDFS-7: -- Thank Kai so much for reviewing the code! I will upload a new patch

[jira] [Updated] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7: - Attachment: HDFS-7-v3.patch > Refactor striped file tests to allow flexibly test erasure coding

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663492#comment-15663492 ] Yuanbo Liu commented on HDFS-10802: --- [~rakeshr] Thanks for your comments. Upload v2 patch to address

[jira] [Commented] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663449#comment-15663449 ] Hadoop QA commented on HDFS-7: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665713#comment-15665713 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.06.patch Thanks [~arpitagarwal] for the review. Attach v06 patch that addresses

[jira] [Commented] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665601#comment-15665601 ] Andrew Wang commented on HDFS-11090: Thanks for the comment Konst. If you look at Jing's comment

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665742#comment-15665742 ] Yuanbo Liu commented on HDFS-10802: --- Don't know why the Jenkins job is not triggered. Upload another the

[jira] [Moved] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula moved HADOOP-13819 to HDFS-11140: -- Affects Version/s: (was: 2.7.1)

[jira] [Commented] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665826#comment-15665826 ] Brahma Reddy Battula commented on HDFS-11140: - Moved to hadoop-hdfs. > Directory Scanner

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665516#comment-15665516 ] Zhe Zhang commented on HDFS-10534: -- Thanks Kai again for the work, and sorry for the late review. I

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872-branch-2.7.013.patch Attaching patch for branch-2.7 (v13). > Add MutableRate

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665422#comment-15665422 ] Arpit Agarwal commented on HDFS-10930: -- Mirroring comment from Github: Thanks [~xyao]. The patch

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Open (was: Patch Available) > Datanode support to read from external stores.

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872-branch-2.013.patch Looks like I introduced two small checkstyle issues when I

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665527#comment-15665527 ] Zhe Zhang commented on HDFS-10872: -- Thanks Erik! I manually verified the 2 checkstyle issues. I just

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10872: - Fix Version/s: 3.0.0-alpha2 2.8.0 > Add MutableRate metrics for FSNamesystemLock

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10802: -- Attachment: HDFS-10802-HDFS-10285.003.patch > [SPS]: Add satisfyStoragePolicy API in HdfsAdmin >

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665750#comment-15665750 ] Andrew Wang commented on HDFS-11058: Thanks for working on this Manoj. I think we're getting close, I

[jira] [Comment Edited] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665803#comment-15665803 ] Rakesh R edited comment on HDFS-10368 at 11/15/16 2:40 AM: --- Thank you

[jira] [Commented] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665839#comment-15665839 ] Hadoop QA commented on HDFS-11081: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10656) Optimize conversion of byte arrays back to path string

2016-11-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665493#comment-15665493 ] Xiao Chen commented on HDFS-10656: -- Thank you for the nice optimization [~daryn]! Sorry for posting my

[jira] [Comment Edited] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665516#comment-15665516 ] Zhe Zhang edited comment on HDFS-10534 at 11/15/16 12:30 AM: - Thanks Kai again

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10534: - Attachment: Screen Shot 2016-11-14 at 4.27.15 PM.png Screenshot of the web UI. I have to scroll to the

[jira] [Updated] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11090: --- Status: Open (was: Patch Available) > Leave safemode immediately if all blocks have reported in >

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665656#comment-15665656 ] Andrew Wang commented on HDFS-10368: Looks good overall, thanks for working on this Rakesh! A few

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665803#comment-15665803 ] Rakesh R commented on HDFS-10368: - Thank you [~andrew.wang] for the useful comments. I'll take care in my

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665459#comment-15665459 ] Hadoop QA commented on HDFS-10872: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11081: Attachment: HDFS-11081-HDFS-7240.003.patch Updates based on code review comments from [~xyao] >

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665687#comment-15665687 ] Andrew Wang commented on HDFS-10994: SGTM, thanks for raising these issues [~drankye]. We can add a

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665882#comment-15665882 ] ASF GitHub Bot commented on HDFS-10930: --- Github user xiaoyuyao commented on the issue:

[jira] [Comment Edited] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664127#comment-15664127 ] Yiqun Lin edited comment on HDFS-11135 at 11/14/16 3:03 PM: Thanks

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664229#comment-15664229 ] Hudson commented on HDFS-11135: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10831 (See

[jira] [Created] (HDFS-11136) TestDataNodeLifeline#testNoLifelineSentIfHeartbeatsOnTime Fails intermittently

2016-11-14 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-11136: --- Summary: TestDataNodeLifeline#testNoLifelineSentIfHeartbeatsOnTime Fails intermittently Key: HDFS-11136 URL: https://issues.apache.org/jira/browse/HDFS-11136

[jira] [Updated] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-3: Attachment: HDFS-3-01.patch > Document dfs.client.read.striped configuration in hdfs-default.xml >

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664399#comment-15664399 ] Zhe Zhang commented on HDFS-10872: -- Thanks for the tip Mingliang :) > Add MutableRate metrics for

[jira] [Updated] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11135: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872.012.patch Looks like when going from v009 to v010 patch I accidentally

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666100#comment-15666100 ] Yuanbo Liu commented on HDFS-10802: --- [~umamaheswararao] Thanks for your response. {quote} instead of

[jira] [Comment Edited] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666130#comment-15666130 ] Rakesh R edited comment on HDFS-10802 at 11/15/16 6:06 AM: --- {quote} One

[jira] [Commented] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666311#comment-15666311 ] Xiaoyu Yao commented on HDFS-11140: --- Thanks [~xiaochen] for reporting the issue and [~linyiqun] for

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10872: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Issue Type: Improvement (was: New Feature) > Adding metrics for long FSNamesystem read and write locks >

[jira] [Assigned] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11140: Assignee: Yiqun Lin > Directory Scanner should log startup message time correctly >

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666056#comment-15666056 ] Uma Maheswara Rao G commented on HDFS-10802: HI [~yuanbo], Thank you so much for the

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

2016-11-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666178#comment-15666178 ] Takanobu Asanuma commented on HDFS-9911: Hi, [~cnauroth]. I looked into this issue. When building

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666024#comment-15666024 ] Hadoop QA commented on HDFS-10872: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666025#comment-15666025 ] Hadoop QA commented on HDFS-10802: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666130#comment-15666130 ] Rakesh R commented on HDFS-10802: - {quote} One suggestion here, instead of mixing up the persistence and

[jira] [Commented] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666403#comment-15666403 ] Hadoop QA commented on HDFS-11140: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11117) Refactor striped file tests to allow flexibly test erasure coding policy

2016-11-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7: - Attachment: HDFS-7-v4.patch Fix style issues > Refactor striped file tests to allow flexibly test

[jira] [Commented] (HDFS-11135) The tests in TestBalancer run fails due to NPE

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666035#comment-15666035 ] Yiqun Lin commented on HDFS-11135: -- [~brahmareddy],thanks for the commit! > The tests in TestBalancer

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666091#comment-15666091 ] Hadoop QA commented on HDFS-10872: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11140: - Attachment: HDFS-11140.001.patch > Directory Scanner should log startup message time correctly >

[jira] [Comment Edited] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666191#comment-15666191 ] Yiqun Lin edited comment on HDFS-11140 at 11/15/16 5:48 AM: Thanks for

[jira] [Updated] (HDFS-11140) Directory Scanner should log startup message time correctly

2016-11-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11140: - Status: Patch Available (was: Open) Thanks for reporting this, [~xiaochen]. Attach a patch to make a

[jira] [Commented] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664526#comment-15664526 ] Xiaoyu Yao commented on HDFS-11081: --- Thanks [~anu] for working on this. The patch looks good to me

[jira] [Commented] (HDFS-11130) Block Storage : add storage client to server protocol

2016-11-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664627#comment-15664627 ] Anu Engineer commented on HDFS-11130: - +1, pending jenkins. > Block Storage : add storage client to

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664936#comment-15664936 ] Zhe Zhang commented on HDFS-10872: -- Thanks Erik. Local cluster on branch-2 patch looks good. I just

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664641#comment-15664641 ] Hadoop QA commented on HDFS-10872: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-10666 >

[jira] [Updated] (HDFS-11130) Block Storage : add storage client to server protocol

2016-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11130: -- Attachment: HDFS-11130-HDFS-7240.002.patch Thanks [~anu] for the comments! uploaded v002 patch to fix

[jira] [Commented] (HDFS-9911) TestDataNodeLifeline Fails intermittently

2016-11-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664458#comment-15664458 ] Anu Engineer commented on HDFS-9911: Another precommit failure reported by [~brahmareddy].

[jira] [Updated] (HDFS-9911) TestDataNodeLifeline Fails intermittently

2016-11-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9911: --- Summary: TestDataNodeLifeline Fails intermittently (was: TestDataNodeLifeline failure in a branch)

[jira] [Resolved] (HDFS-11136) TestDataNodeLifeline#testNoLifelineSentIfHeartbeatsOnTime Fails intermittently

2016-11-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11136. - Resolution: Duplicate > TestDataNodeLifeline#testNoLifelineSentIfHeartbeatsOnTime Fails >

[jira] [Commented] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664545#comment-15664545 ] Mingliang Liu commented on HDFS-11105: -- I think the patch makes sense; we need to make sure the

[jira] [Commented] (HDFS-11113) Document dfs.client.read.striped configuration in hdfs-default.xml

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664592#comment-15664592 ] Hadoop QA commented on HDFS-3: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11060) make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

2016-11-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664815#comment-15664815 ] Ravi Prakash commented on HDFS-11060: - Hi Lantao! Could you please go through

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664745#comment-15664745 ] Hudson commented on HDFS-10872: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10832 (See

[jira] [Commented] (HDFS-11060) make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

2016-11-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664817#comment-15664817 ] Ravi Prakash commented on HDFS-11060: - Just a word of warning BTW! This API that the NameNode provides

[jira] [Updated] (HDFS-11119) Support for parallel checking of StorageLocations on DataNode startup

2016-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664718#comment-15664718 ] Zhe Zhang commented on HDFS-10872: -- Thanks Erik. +1 on v12 patch. I did another check of the metrics from

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664725#comment-15664725 ] Zhe Zhang commented on HDFS-10872: -- Actually {{FSNamesystem}} has many conflicts -- though most of them

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-11-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872-branch-2.012.patch Thank you for the commit, [~zhz]! I've attached a branch-2

[jira] [Updated] (HDFS-11138) Block Storage : add block storage server

2016-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11138: -- Status: Patch Available (was: Open) > Block Storage : add block storage server >

[jira] [Comment Edited] (HDFS-10675) Datanode support to read from external stores.

2016-11-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665126#comment-15665126 ] Virajith Jalaparti edited comment on HDFS-10675 at 11/14/16 9:44 PM: -

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Patch Available (was: Open) > Datanode support to read from external stores.

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.007.patch > Make DistCpOptions class immutable >

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665267#comment-15665267 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.008.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.006.patch Ping [~yzhangal] and [~jnp] for review. Thanks, > Make

[jira] [Created] (HDFS-11138) Block Storage : add block storage server

2016-11-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11138: - Summary: Block Storage : add block storage server Key: HDFS-11138 URL: https://issues.apache.org/jira/browse/HDFS-11138 Project: Hadoop HDFS Issue Type: Sub-task

  1   2   >