[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12141: Attachment: HDFS-12141-HDFS-10285-02.patch > [SPS]: Fix checkstyle warnings >

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088474#comment-16088474 ] Hadoop QA commented on HDFS-12115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088463#comment-16088463 ] Xiao Chen commented on HDFS-12116: -- patch 3 returned to a 5% failure :( Will take a closer look >

[jira] [Assigned] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12144: --- Assignee: Anu Engineer > Ozone: KSM: Cleanup of keys in KSM for failed clients >

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088427#comment-16088427 ] Anu Engineer commented on HDFS-12069: - [~cheersyang] Thanks for getting this done. Deeply appreciate

[jira] [Commented] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088424#comment-16088424 ] Nandakumar commented on HDFS-12144: --- Thanks [~vagarychen]. Yes, the TODO was originally added in

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088417#comment-16088417 ] Hadoop QA commented on HDFS-12098: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar resolved HDFS-12144. --- Resolution: Duplicate > Ozone: KSM: Cleanup of keys in KSM for failed clients >

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Status: In Progress (was: Patch Available) > Ozone: Datanode is unable to register with scm if scm

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088411#comment-16088411 ] Weiwei Yang commented on HDFS-12098: Please hold on looking at the test patch, it still has some

[jira] [Updated] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12115: Attachment: HDFS-12115-HDFS-7240.004.patch Addressing a test failure > Ozone: SCM: Add queryNode

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088382#comment-16088382 ] Weiwei Yang commented on HDFS-12098: Hi [~anu] I just uploaded a test case patch to reproduce this

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Attachment: HDFS-12098-HDFS-7240.testcase.patch > Ozone: Datanode is unable to register with scm if

[jira] [Commented] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088370#comment-16088370 ] Hadoop QA commented on HDFS-2319: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088368#comment-16088368 ] Hadoop QA commented on HDFS-12116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088362#comment-16088362 ] Bharat Viswanadham commented on HDFS-2319: -- Hi [~ajisakaa] I have updated the code. Fixed the test

[jira] [Comment Edited] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088362#comment-16088362 ] Bharat Viswanadham edited comment on HDFS-2319 at 7/15/17 1:34 AM: --- Hi

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-2319: - Status: Patch Available (was: In Progress) > Add test cases for FSshell -stat >

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-2319: - Attachment: HDFS-2319.02.patch > Add test cases for FSshell -stat >

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-2319: - Attachment: (was: HDFS-2319.patch) > Add test cases for FSshell -stat >

[jira] [Updated] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-2319: - Attachment: HDFS-2319.patch > Add test cases for FSshell -stat >

[jira] [Updated] (HDFS-11989) Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11989: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088329#comment-16088329 ] Hadoop QA commented on HDFS-12115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12116: - Attachment: HDFS-12116.03.patch Will run dist-test again with patch 3 just in case. >

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088315#comment-16088315 ] Xiao Chen commented on HDFS-12116: -- Thanks a lot for the review Eddy! Updated patch 3 to address both

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088273#comment-16088273 ] Lei (Eddy) Xu commented on HDFS-12116: -- Hi, Xiao Thanks for address the test failure. it looks good

[jira] [Commented] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088267#comment-16088267 ] Chen Liang commented on HDFS-12144: --- I read through the comments in HDFS-12123 discussion. Actually I

[jira] [Commented] (HDFS-12138) Remove redundant 'public' modifiers from BlockCollection

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088269#comment-16088269 ] Hadoop QA commented on HDFS-12138: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11989) Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088256#comment-16088256 ] Anu Engineer commented on HDFS-11989: - +1, I will commit this shortly. Also, FYI, ListKeys is fixed

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088221#comment-16088221 ] Anu Engineer commented on HDFS-12115: - v3 rebased on top of the tree. > Ozone: SCM: Add queryNode RPC

[jira] [Updated] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12115: Attachment: HDFS-12115-HDFS-7240.003.patch > Ozone: SCM: Add queryNode RPC Call >

[jira] [Updated] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12123: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12130) Optimizing permission check for getContentSummary

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088187#comment-16088187 ] Hudson commented on HDFS-12130: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12012 (See

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088185#comment-16088185 ] Hadoop QA commented on HDFS-12123: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088144#comment-16088144 ] Hudson commented on HDFS-12140: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12011 (See

[jira] [Updated] (HDFS-12138) Remove redundant 'public' modifiers from BlockCollection

2017-07-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12138: -- Attachment: HDFS-12138.001.patch Post initial patch. > Remove redundant 'public' modifiers from

[jira] [Updated] (HDFS-12138) Remove redundant 'public' modifiers from BlockCollection

2017-07-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12138: -- Status: Patch Available (was: Open) > Remove redundant 'public' modifiers from BlockCollection >

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088124#comment-16088124 ] Kihwal Lee commented on HDFS-12136: --- [~jojochuang], we started seeing significant performance regression

[jira] [Commented] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088100#comment-16088100 ] Hudson commented on HDFS-12137: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12010 (See

[jira] [Comment Edited] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086282#comment-16086282 ] Kihwal Lee edited comment on HDFS-12136 at 7/14/17 9:21 PM: Normal serving has

[jira] [Updated] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12140: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.3 3.0.0-beta1

[jira] [Work started] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-2319 started by Bharat Viswanadham. > Add test cases for FSshell -stat > > >

[jira] [Assigned] (HDFS-2319) Add test cases for FSshell -stat

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-2319: Assignee: Bharat Viswanadham > Add test cases for FSshell -stat >

[jira] [Commented] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088053#comment-16088053 ] Kihwal Lee commented on HDFS-12140: --- +1. For a BPOS, the blockpool ID won't change once registers. >

[jira] [Commented] (HDFS-12130) Optimizing permission check for getContentSummary

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088051#comment-16088051 ] Hudson commented on HDFS-12130: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12009 (See

[jira] [Comment Edited] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088043#comment-16088043 ] Kihwal Lee edited comment on HDFS-12137 at 7/14/17 8:56 PM: Thanks for the

[jira] [Updated] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12137: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 2.9.0

[jira] [Commented] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-07-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088042#comment-16088042 ] Tsz Wo Nicholas Sze commented on HDFS-11948: Thanks, Anu. I will see why the tests use so

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088034#comment-16088034 ] Anu Engineer commented on HDFS-12115: - Thank you, but before I commit I will post one more patch,

[jira] [Updated] (HDFS-12130) Optimizing permission check for getContentSummary

2017-07-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12130: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0

[jira] [Commented] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088022#comment-16088022 ] Kihwal Lee commented on HDFS-12137: --- +1 the patch looks good. The test failure is not related. > DN

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088023#comment-16088023 ] Nandakumar commented on HDFS-12123: --- {quote} >> I think this a JIRA that we should file against KSM. I

[jira] [Updated] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12144: -- Description: While writing data into Ozone, client can fail after the key is allocated in KSM. Cleanup

[jira] [Created] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients.

2017-07-14 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12144: - Summary: Ozone: KSM: Cleanup of keys in KSM for failed clients. Key: HDFS-12144 URL: https://issues.apache.org/jira/browse/HDFS-12144 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12144) Ozone: KSM: Cleanup of keys in KSM for failed clients

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12144: -- Summary: Ozone: KSM: Cleanup of keys in KSM for failed clients (was: Ozone: KSM: Cleanup of keys in

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088011#comment-16088011 ] Rushabh S Shah commented on HDFS-12131: --- Thanks [~xkrogen] for the patch. Adding a test case in

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088005#comment-16088005 ] Xiaoyu Yao commented on HDFS-12115: --- Patch v2 looks good to me. +1. > Ozone: SCM: Add queryNode RPC

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087997#comment-16087997 ] Anu Engineer commented on HDFS-12123: - Thank you very much for the quick turn around, I appreciate it.

[jira] [Commented] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087993#comment-16087993 ] Anu Engineer commented on HDFS-11948: - [~szetszwo] Thanks for uploading the patch. From code changes

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087992#comment-16087992 ] Nandakumar commented on HDFS-12123: --- Thanks [~anu] for the review. >> Line: 100, Please add a

[jira] [Updated] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12123: -- Attachment: HDFS-12123-HDFS-7240.001.patch > Ozone: OzoneClient: Abstraction of OzoneClient and default

[jira] [Comment Edited] (HDFS-5896) DataXceiver and DFSOutputStream call Thread.setName(), which is not thread safe

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087936#comment-16087936 ] Bharat Viswanadham edited comment on HDFS-5896 at 7/14/17 8:03 PM: --- Hi

[jira] [Commented] (HDFS-5896) DataXceiver and DFSOutputStream call Thread.setName(), which is not thread safe

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087936#comment-16087936 ] Bharat Viswanadham commented on HDFS-5896: -- Hi [~ikeda] Refer this JDK bug for setName/getName

[jira] [Assigned] (HDFS-5896) DataXceiver and DFSOutputStream call Thread.setName(), which is not thread safe

2017-07-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-5896: Assignee: Bharat Viswanadham > DataXceiver and DFSOutputStream call

[jira] [Commented] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087922#comment-16087922 ] Rushabh S Shah commented on HDFS-12140: --- [~daryn]: thanks for the patch. Precommit ran on only

[jira] [Commented] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087917#comment-16087917 ] Hadoop QA commented on HDFS-12137: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087839#comment-16087839 ] Anu Engineer commented on HDFS-12115: - Other than an expected failure in TestKeys, all test failures

[jira] [Commented] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087811#comment-16087811 ] Hadoop QA commented on HDFS-12141: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087804#comment-16087804 ] Anu Engineer commented on HDFS-12123: - *OzoneClientImpl.java* * Line: 100, Please add a

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087778#comment-16087778 ] Hadoop QA commented on HDFS-12136: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-07-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087734#comment-16087734 ] Kihwal Lee commented on HDFS-12137: --- The trunk precommit failed to download the patch and failed. I

[jira] [Commented] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-07-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087703#comment-16087703 ] Xiaoyu Yao commented on HDFS-11493: --- Thanks [~anu] for the update. +1 for v5 patch. > Ozone: SCM: Add

[jira] [Commented] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087678#comment-16087678 ] Hadoop QA commented on HDFS-12140: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12143) Improve performance of getting and removing inode features

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087650#comment-16087650 ] Hadoop QA commented on HDFS-12143: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12130) Optimizing permission check for getContentSummary

2017-07-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087652#comment-16087652 ] Chen Liang commented on HDFS-12130: --- Thanks [~szetszwo] for the review! The failed tests are unrelated,

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087608#comment-16087608 ] Daryn Sharp commented on HDFS-12136: The failed tests either aren't failing for me, or are failing

[jira] [Commented] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087604#comment-16087604 ] Rakesh R commented on HDFS-11874: - Committed to the branch! > [SPS]: Document the SPS feature >

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11874: Resolution: Fixed Fix Version/s: HDFS-10285 Target Version/s: (was: HDFS-10285)

[jira] [Commented] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087583#comment-16087583 ] Rakesh R commented on HDFS-11874: - Thanks [~umamaheswararao] for the good docs. +1 LGTM, I will commit it

[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12141: Status: Patch Available (was: Open) > [SPS]: Fix checkstyle warnings > -- > >

[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12141: Attachment: HDFS-12141-HDFS-10285-01.patch Attached simple patch fixing applicable checkstyle warnings.

[jira] [Commented] (HDFS-12142) Files may be closed before streamer is done

2017-07-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087565#comment-16087565 ] Kihwal Lee commented on HDFS-12142: --- The following appears after the files is successfully closed. It

[jira] [Commented] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087525#comment-16087525 ] Hadoop QA commented on HDFS-11874: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-12083) Ozone: KSM: previous key has to be excluded from result in listVolumes, listBuckets and listKeys

2017-07-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12083: - Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: KSM: previous key has to be

[jira] [Updated] (HDFS-12083) Ozone: KSM: previous key has to be excluded from result in listVolumes, listBuckets and listKeys

2017-07-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12083: - Affects Version/s: HDFS-7240 Hadoop Flags: Reviewed Target Version/s: HDFS-7240 Fix

[jira] [Updated] (HDFS-12143) Improve performance of getting and removing inode features

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12143: --- Attachment: HDFS-12143.patch > Improve performance of getting and removing inode features >

[jira] [Updated] (HDFS-12143) Improve performance of getting and removing inode features

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12143: --- Status: Patch Available (was: Open) > Improve performance of getting and removing inode features >

[jira] [Comment Edited] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087505#comment-16087505 ] Uma Maheswara Rao G edited comment on HDFS-11874 at 7/14/17 3:49 PM: -

[jira] [Created] (HDFS-12143) Improve performance of getting and removing inode features

2017-07-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12143: -- Summary: Improve performance of getting and removing inode features Key: HDFS-12143 URL: https://issues.apache.org/jira/browse/HDFS-12143 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11874) [SPS]: Document the SPS feature

2017-07-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11874: --- Attachment: ArchivalStorage.html HDFS-11874-HDFS-10285-004.patch A

[jira] [Created] (HDFS-12142) Files may be closed before streamer is done

2017-07-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12142: -- Summary: Files may be closed before streamer is done Key: HDFS-12142 URL: https://issues.apache.org/jira/browse/HDFS-12142 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12141: Attachment: diff-checkstyle-hadoop-hdfs-project.txt > [SPS]: Fix checkstyle warnings >

[jira] [Created] (HDFS-12141) [SPS]: Fix checkstyle warnings

2017-07-14 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12141: --- Summary: [SPS]: Fix checkstyle warnings Key: HDFS-12141 URL: https://issues.apache.org/jira/browse/HDFS-12141 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12140: --- Attachment: HDFS-12140.branch-2.8.patch Trunk applies to branch-2 as well. Just need 2.8 change. >

[jira] [Updated] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12140: --- Status: Patch Available (was: Open) > Remove BPOfferService lock contention to get block pool id >

[jira] [Commented] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087437#comment-16087437 ] Daryn Sharp commented on HDFS-12140: Also avoids a silly double fetch/penalty for a precondition's

[jira] [Updated] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12140: --- Attachment: HDFS-12140.trunk.patch Simply sets/clears a volatile for the bp id when the ns info is

[jira] [Created] (HDFS-12140) Remove BPOfferService lock contention to get block pool id

2017-07-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12140: -- Summary: Remove BPOfferService lock contention to get block pool id Key: HDFS-12140 URL: https://issues.apache.org/jira/browse/HDFS-12140 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12137) DN dataset lock should be fair

2017-07-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-12137: --- Attachment: HDFS-12137.trunk.patch Reposting trunk to kick precommit just to be thorough. > DN

  1   2   >