[jira] [Commented] (HDFS-11432) Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands

2017-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889556#comment-15889556 ] Hudson commented on HDFS-11432: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11325 (See

[jira] [Updated] (HDFS-11432) Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands

2017-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11432: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Commented] (HDFS-11432) Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands

2017-02-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889520#comment-15889520 ] Vinayakumar B commented on HDFS-11432: -- +1 for latest patch. Thanks [~brahmareddy] for the

[jira] [Commented] (HDFS-11428) Change setErasureCodingPolicy to take a required string EC policy name

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889519#comment-15889519 ] Hadoop QA commented on HDFS-11428: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889514#comment-15889514 ] Arpit Agarwal commented on HDFS-11476: -- +1 for the patch. Thanks for fixing this. [~xiaobingo],

[jira] [Commented] (HDFS-11432) Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands

2017-02-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889511#comment-15889511 ] Brahma Reddy Battula commented on HDFS-11432: - {{Testfailures}} are unrelated..[~vinayrpet]

[jira] [Updated] (HDFS-11478) Update EC commands in HDFSCommands.md

2017-02-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11478: - Description: The EC commands in {{HDFSCommands.md}} is out of date. There are some places need to

[jira] [Created] (HDFS-11478) Update EC commands in HDFSCommands.md

2017-02-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11478: Summary: Update EC commands in HDFSCommands.md Key: HDFS-11478 URL: https://issues.apache.org/jira/browse/HDFS-11478 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11432) Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889460#comment-15889460 ] Hadoop QA commented on HDFS-11432: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11477) Combine FileIO Profiling Enable and Sampling Fraction Config Key into one

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889452#comment-15889452 ] Hadoop QA commented on HDFS-11477: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889389#comment-15889389 ] Hadoop QA commented on HDFS-11447: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-02-28 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889362#comment-15889362 ] Yuanbo Liu commented on HDFS-11336: --- [~umamaheswararao] Thanks for sharing your ideas. I will try them

[jira] [Commented] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889338#comment-15889338 ] Hadoop QA commented on HDFS-11196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889307#comment-15889307 ] Hadoop QA commented on HDFS-11476: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889303#comment-15889303 ] Anu Engineer commented on HDFS-11447: - one more comment: This patch conflicts with HDFS-11451, so let

[jira] [Commented] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889275#comment-15889275 ] Anu Engineer commented on HDFS-11447: - A bunch of check style warnings: Checkstyle found 20 item(s) in

[jira] [Updated] (HDFS-11477) Combine FileIO Profiling Enable and Sampling Fraction Config Key into one

2017-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11477: -- Status: Patch Available (was: Open) > Combine FileIO Profiling Enable and Sampling Fraction

[jira] [Updated] (HDFS-11477) Combine FileIO Profiling Enable and Sampling Fraction Config Key into one

2017-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11477: -- Attachment: HDFS-11477.000.patch > Combine FileIO Profiling Enable and Sampling Fraction Config

[jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889252#comment-15889252 ] Hadoop QA commented on HDFS-11461: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be {0 - DefaultReplication}

2017-02-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889251#comment-15889251 ] Manoj Govindassamy commented on HDFS-11412: --- [~mingma], any thoughts on the above comment ? >

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be {0 - DefaultReplication}

2017-02-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889250#comment-15889250 ] Manoj Govindassamy commented on HDFS-11412: --- [~mingma], any thoughts on the above comment ? >

[jira] [Issue Comment Deleted] (HDFS-11412) Maintenance minimum replication config value allowable range should be {0 - DefaultReplication}

2017-02-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11412: -- Comment: was deleted (was: [~mingma], any thoughts on the above comment ?) >

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889247#comment-15889247 ] Hadoop QA commented on HDFS-11425: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11476: - Target Version/s: 2.8.0 Component/s: datanode > Fix NPE in FsDatasetImpl#checkAndUpdate

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889221#comment-15889221 ] Hadoop QA commented on HDFS-11425: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11477) Combine FileIO Profiling Enable and Sampling Fraction Config Key into one

2017-02-28 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11477: - Summary: Combine FileIO Profiling Enable and Sampling Fraction Config Key into one Key: HDFS-11477 URL: https://issues.apache.org/jira/browse/HDFS-11477 Project:

[jira] [Commented] (HDFS-11356) figure out what to do about hadoop-hdfs-project/hadoop-hdfs/src/main/native

2017-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889208#comment-15889208 ] Allen Wittenauer commented on HDFS-11356: - hdfs-client was rushed in order to hide the fact that

[jira] [Comment Edited] (HDFS-11356) figure out what to do about hadoop-hdfs-project/hadoop-hdfs/src/main/native

2017-02-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889208#comment-15889208 ] Allen Wittenauer edited comment on HDFS-11356 at 3/1/17 12:37 AM: --

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Attachment: HDFS-11447-HDFS-7240.001.patch Update the name of the patch based [~anu]'s suggestion.

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Attachment: (was: HDFS-11447.01.patch) > Ozone: SCM: Send node report along with heartbeat to SCM >

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Attachment: HDFS-11196-HDFS-7240.001.patch > Ozone: Improve logging and error handling in the

[jira] [Commented] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889160#comment-15889160 ] Anu Engineer commented on HDFS-11447: - [~xyao] Can you please rename this patch as

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889159#comment-15889159 ] Mingliang Liu commented on HDFS-11476: -- That's interesting. Even the log is checking if the

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11476: - Status: Patch Available (was: Open) > Fix NPE in FsDatasetImpl#checkAndUpdate >

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11476: - Attachment: HDFS-11476.000.patch Posted v0 patch for reviews. > Fix NPE in

[jira] [Commented] (HDFS-11466) Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms

2017-02-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889156#comment-15889156 ] Andrew Wang commented on HDFS-11466: Thanks Zhe for the quick review and commit! > Change

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889152#comment-15889152 ] Hadoop QA commented on HDFS-11425: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Status: Patch Available (was: Open) > Ozone: Improve logging and error handling in the container

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Attachment: (was: HDFS-11196-HDFS-7240.001.patch) > Ozone: Improve logging and error handling

[jira] [Commented] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889144#comment-15889144 ] Hadoop QA commented on HDFS-11447: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Attachment: HDFS-11447.01.patch Update patch fixing a new file missing ASF license. > Ozone: SCM:

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Attachment: (was: HDFS-11447.01.patch) > Ozone: SCM: Send node report along with heartbeat to SCM >

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Status: Patch Available (was: Open) > Ozone: SCM: Send node report along with heartbeat to SCM >

[jira] [Created] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-02-28 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11476: Summary: Fix NPE in FsDatasetImpl#checkAndUpdate Key: HDFS-11476 URL: https://issues.apache.org/jira/browse/HDFS-11476 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Attachment: HDFS-11447.01.patch Attach a initial patch that 1. Define SCM node report protobuf message

[jira] [Updated] (HDFS-11428) Change setErasureCodingPolicy to take a required string EC policy name

2017-02-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11428: --- Attachment: HDFS-11428.005.patch New patch attached to fix rebase issues, thanks for reviewing! >

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: HDFS-11425-HDFS-7240.005.patch That is a good catch, thanks [~eddyxu]! fixed in v005 patch

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889082#comment-15889082 ] Lei (Eddy) Xu commented on HDFS-11425: -- I haven't read through the patch yet. But I just noticed that

[jira] [Comment Edited] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889060#comment-15889060 ] Arpit Agarwal edited comment on HDFS-11461 at 2/28/17 11:09 PM: +1 for the

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: HDFS-11425-HDFS-7240.004.patch uploaded v004 patch to fix some checkstyle warnings I found

[jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889060#comment-15889060 ] Arpit Agarwal commented on HDFS-11461: -- +1 for the v3 patch. I will hold off committing for a couple

[jira] [Comment Edited] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889023#comment-15889023 ] Hanisha Koneru edited comment on HDFS-11461 at 2/28/17 10:51 PM: - Thank

[jira] [Updated] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11461: -- Attachment: HDFS-11461.002.patch Thank you [~arpitagarwal]. I have addressed your comments in

[jira] [Created] (HDFS-11475) Unit Test for DataNode Disk Outlier Detection

2017-02-28 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11475: - Summary: Unit Test for DataNode Disk Outlier Detection Key: HDFS-11475 URL: https://issues.apache.org/jira/browse/HDFS-11475 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888985#comment-15888985 ] Arpit Agarwal commented on HDFS-11450: -- Thanks for this improvement [~vagarychen]. The patch looks

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888975#comment-15888975 ] Anu Engineer commented on HDFS-11425: - [~vagarychen] Thanks for the patch. +1 for v3, pending Jenkins.

[jira] [Work started] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11424 started by Chen Liang. - > Block Storage : add container representation to meta data >

[jira] [Commented] (HDFS-11451) Ozone: Add protobuf definitions for container reports

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888971#comment-15888971 ] Anu Engineer commented on HDFS-11451: - Filed HDFS-11474 to track and fix asflicense failures. >

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Status: Patch Available (was: In Progress) > Ozone : add client-facing container APIs and container

[jira] [Created] (HDFS-11474) Ozone: Tests needs to cleanup levelDB files

2017-02-28 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11474: --- Summary: Ozone: Tests needs to cleanup levelDB files Key: HDFS-11474 URL: https://issues.apache.org/jira/browse/HDFS-11474 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11451) Ozone: Add protobuf definitions for container reports

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888966#comment-15888966 ] Anu Engineer commented on HDFS-11451: - * Test failures are not related to this patch. * Findbugs is

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: HDFS-11425-HDFS-7240.003.patch > Ozone : add client-facing container APIs and container

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: HDFS-11425-HDFS-7240.002.patch > Ozone : add client-facing container APIs and container

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: HDFS-11450.002.patch v001 patch mistakenly included changes that do not belong to Ozone.

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Attachment: (was: HDFS-11450.002.patch) > Ozone : add client-facing container APIs and container

[jira] [Reopened] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reopened HDFS-11424: --- Did not realize that this JIRA and HDFS-11425 are for Ozone are SCM pieces respectively. Still need to

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Description: This JIRA adds the container APIs, such as create container, delete container etc exposed

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Description: This JIRA adds the container APIs, such as create container, delete container etc exposed

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Summary: Ozone : add client-facing container APIs and container references (was: Ozone : add

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11425: -- Description: This JIRA adds the container APIs, such as create container, delete container etc exposed

[jira] [Comment Edited] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-02-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886479#comment-15886479 ] Uma Maheswara Rao G edited comment on HDFS-11336 at 2/28/17 9:28 PM: -

[jira] [Resolved] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11424. --- Resolution: Duplicate Given the recently checked changes, it will be difficult to make the separation

[jira] [Commented] (HDFS-11395) RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1559#comment-1559 ] Hadoop QA commented on HDFS-11395: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1556#comment-1556 ] Hadoop QA commented on HDFS-11461: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1530#comment-1530 ] Arpit Agarwal edited comment on HDFS-11461 at 2/28/17 8:41 PM: --- Thanks

[jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1530#comment-1530 ] Arpit Agarwal commented on HDFS-11461: -- Thanks [~hanishakoneru]. The patch looks good. A few more

[jira] [Updated] (HDFS-11036) Ozone : reuse Xceiver connection

2017-02-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11036: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888772#comment-15888772 ] Chen Liang commented on HDFS-11036: --- Thanks for the review [~xyao]! Filed HDFS-11473 to keep track of

[jira] [Created] (HDFS-11473) Ozone : exclude protobuf files from findbugs check

2017-02-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11473: - Summary: Ozone : exclude protobuf files from findbugs check Key: HDFS-11473 URL: https://issues.apache.org/jira/browse/HDFS-11473 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-02-28 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888766#comment-15888766 ] Benoy Antony commented on HDFS-11384: - [~zhaoyunjiong], If there are blocks to balance, then there

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11472: --- Priority: Critical (was: Major) > Fix inconsistent replica size after a data pipeline failure >

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11472: --- Target Version/s: 2.7.4, 3.0.0-alpha3, 2.8.1 (was: 2.7.4, 3.0.0-alpha3) > Fix inconsistent replica

[jira] [Updated] (HDFS-11461) DataNode Disk Outlier Detection

2017-02-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11461: -- Attachment: HDFS-11461.001.patch Thank you [~arpitagarwal] for reviewing the patch. I have

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888655#comment-15888655 ] Wei-Chiu Chuang commented on HDFS-11472: Inviting folks to comment. It may not be a good idea to

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11472: --- Attachment: HDFS-11472.testcase.patch IMHO, this boils down to that replica recovery does not

[jira] [Created] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11472: -- Summary: Fix inconsistent replica size after a data pipeline failure Key: HDFS-11472 URL: https://issues.apache.org/jira/browse/HDFS-11472 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11414) Ozone : move StorageContainerLocation protocol to hdfs-client

2017-02-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11414: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Created] (HDFS-11471) KMSTokenRenewer should renew token from the service address in token.

2017-02-28 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-11471: - Summary: KMSTokenRenewer should renew token from the service address in token. Key: HDFS-11471 URL: https://issues.apache.org/jira/browse/HDFS-11471 Project:

[jira] [Commented] (HDFS-11395) RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode

2017-02-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888565#comment-15888565 ] Nandakumar commented on HDFS-11395: --- [~arpitagarwal], based on the suggestions/comments new patch is

[jira] [Updated] (HDFS-11395) RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode

2017-02-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11395: -- Attachment: HDFS-11395.001.patch > RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides

[jira] [Commented] (HDFS-11466) Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms

2017-02-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888514#comment-15888514 ] Hudson commented on HDFS-11466: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11319 (See

[jira] [Updated] (HDFS-11466) Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms

2017-02-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11466: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 3.0.0-alpha3

[jira] [Commented] (HDFS-11455) Fix javac warnings in HDFS that caused by deprecated FileSystem APIs

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888436#comment-15888436 ] Mingliang Liu commented on HDFS-11455: -- Failing tests seem unrelated. I'm +1 on this. Let's hold on

[jira] [Updated] (HDFS-11470) Ozone: SCM: Add SCM CLI to access node and container information

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11470: -- Summary: Ozone: SCM: Add SCM CLI to access node and container information (was: Ozone: Add SCM CLI to

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Summary: Ozone: SCM: Container allocation based on node report (was: Ozone: Container allocation based

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11468: -- Summary: Ozone: SCM: Add Node Metrics for SCM (was: Ozone: Add Node Metrics for SCM) > Ozone: SCM:

[jira] [Updated] (HDFS-11447) Ozone: SCM: Send node report along with heartbeat to SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11447: -- Summary: Ozone: SCM: Send node report along with heartbeat to SCM (was: Ozone: Send node report along

[jira] [Created] (HDFS-11470) Ozone: Add SCM CLI to access node and container information

2017-02-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11470: - Summary: Ozone: Add SCM CLI to access node and container information Key: HDFS-11470 URL: https://issues.apache.org/jira/browse/HDFS-11470 Project: Hadoop HDFS

[jira] [Created] (HDFS-11469) Ozone: Container allocation based on node report

2017-02-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11469: - Summary: Ozone: Container allocation based on node report Key: HDFS-11469 URL: https://issues.apache.org/jira/browse/HDFS-11469 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11468) Ozone: Add Node Metrics for SCM

2017-02-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11468: - Summary: Ozone: Add Node Metrics for SCM Key: HDFS-11468 URL: https://issues.apache.org/jira/browse/HDFS-11468 Project: Hadoop HDFS Issue Type: Sub-task

  1   2   >