[jira] [Assigned] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12235: -- Assignee: Yuanbo Liu (was: Weiwei Yang) > Ozone: DeleteKey-3: KSM SCM block deletion message

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.004.patch Thanks [~anu]. Rebased to latest code base. > Ozone:

[jira] [Updated] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12250: - Attachment: HDFS-12250.002.patch > Reduce usage of FsPermissionExtension in HDFS unit tests >

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119411#comment-16119411 ] Hadoop QA commented on HDFS-12273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: (was: HDFS-12221.05.patch) > Replace xcerces in XmlEditsVisitor >

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2017-08-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119398#comment-16119398 ] Chao Sun commented on HDFS-6440: Would love to see this feature in branch-2. How much work is involved to

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: HDFS-12221.05.patch > Replace xcerces in XmlEditsVisitor >

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: (was: HDFS-12221.05.patch) > Replace xcerces in XmlEditsVisitor >

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: HDFS-12221.05.patch > Replace xcerces in XmlEditsVisitor >

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119374#comment-16119374 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119338#comment-16119338 ] Ajay Yadav edited comment on HDFS-12221 at 8/9/17 3:03 AM: --- i checked the

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119341#comment-16119341 ] Anu Engineer commented on HDFS-12196: - [~cheersyang] Sorry for the delay. I will get to this latest by

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119338#comment-16119338 ] Ajay Yadav commented on HDFS-12221: --- i checked the findbugs, hadoop-hdfs,yarn, mapreduce errors. They

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-08-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119332#comment-16119332 ] Weiwei Yang commented on HDFS-12196: Hi [~anu], [~vagarychen], please let me know your thoughts to the

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Attachment: HDFS-12273-HDFS-10467-001.patch Fixed most Jenkins comments. I'm leaving the comparator

[jira] [Updated] (HDFS-11975) Provide a system-default EC policy

2017-08-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11975: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-11975) Provide a system-default EC policy

2017-08-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119314#comment-16119314 ] Kai Zheng commented on HDFS-11975: -- The latest patch LGTM and +1. Will commit it shortly. > Provide a

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119307#comment-16119307 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119299#comment-16119299 ] Hadoop QA commented on HDFS-12250: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-06.patch Attached new patch fixing checkstyle, findbug warnings. bq. can

[jira] [Issue Comment Deleted] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Comment: was deleted (was: checked the test failures for hdfs,yarn and hdfs. They are not related to

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119269#comment-16119269 ] Ajay Yadav commented on HDFS-12221: --- checked the test failures for hdfs,yarn and hdfs. They are not

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-08 Thread Alexander Behm (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119259#comment-16119259 ] Alexander Behm commented on HDFS-1: --- Impala also relies on the BlockLocation array returned from

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119258#comment-16119258 ] Hadoop QA commented on HDFS-12273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119251#comment-16119251 ] Andrew Wang commented on HDFS-12277: Hi Michael, thanks for working on this. I think the current

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119249#comment-16119249 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11554) [Documentation] Router-based federation documentation

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119248#comment-16119248 ] Hadoop QA commented on HDFS-11554: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119246#comment-16119246 ] Hadoop QA commented on HDFS-12277: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119224#comment-16119224 ] Hadoop QA commented on HDFS-12221: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11554) [Documentation] Router-based federation documentation

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-11554: --- Attachment: HDFS-11554-HDFS-10467-003.patch Added architecture. > [Documentation] Router-based

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119219#comment-16119219 ] Chris Douglas commented on HDFS-12273: -- Really minor: * If the comparator isn't used except for JSON

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119207#comment-16119207 ] Wei-Chiu Chuang commented on HDFS-11160: Hi [~wheat9] an alternative approach is add a retry at

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119198#comment-16119198 ] Anu Engineer commented on HDFS-12268: - +1, on this change. Thanks for catching this issue. Do you

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119199#comment-16119199 ] Wei-Chiu Chuang commented on HDFS-11882: IMO this is an EC must do item rather than a nice-to-have

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11882: --- Labels: hdfs-ec-3.0-must-do (was: ) > Client fails if acknowledged size is greater than

[jira] [Commented] (HDFS-11554) [Documentation] Router-based federation documentation

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119196#comment-16119196 ] Hadoop QA commented on HDFS-11554: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119190#comment-16119190 ] Wei-Chiu Chuang commented on HDFS-12117: +1 the test looks good to me too. Thanks [~wchevreuil]!

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11882: --- Labels: (was: hdfs-ec-3.0-nice-to-have) > Client fails if acknowledged size is greater than

[jira] [Updated] (HDFS-11554) [Documentation] Router-based federation documentation

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-11554: - Attachment: HDFS-11554.002.patch Proposed some really minor edits in v002, but +1 either way >

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12281: -- Tags: Ozone > Ozone: Ozone-default.xml has 3 properties that do not match the default > Config value >

[jira] [Updated] (HDFS-12281) Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12281: Issue Type: Sub-task (was: Improvement) Parent: HDFS-7240 > Ozone-default.xml has 3

[jira] [Updated] (HDFS-12281) Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12281: Summary: Ozone: Ozone-default.xml has 3 properties that do not match the default Config value

[jira] [Created] (HDFS-12281) Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-08 Thread Ajay Yadav (JIRA)
Ajay Yadav created HDFS-12281: - Summary: Ozone-default.xml has 3 properties that do not match the default Config value Key: HDFS-12281 URL: https://issues.apache.org/jira/browse/HDFS-12281 Project:

[jira] [Assigned] (HDFS-12281) Ozone-default.xml has 3 properties that do not match the default Config value

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav reassigned HDFS-12281: - Assignee: Ajay Yadav > Ozone-default.xml has 3 properties that do not match the default Config

[jira] [Comment Edited] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2017-08-08 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118235#comment-16118235 ] Andras Bokor edited comment on HDFS-10429 at 8/8/17 11:06 PM: -- I am not

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Description: Add the Web UI to the Router to expose the status of the federated cluster. It includes

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Status: Patch Available (was: Open) > Federation UI > - > > Key:

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.004.patch) > [READ] Merge

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Attachment: HDFS-12273-HDFS-10467-000.patch Web UI with metrics. > Federation UI > - > >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.004.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Summary: Ozone: Container : Add key versioning support-1 (was: Ozone: Container : Add key versioning

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support

2017-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Status: Patch Available (was: Open) > Ozone: Container : Add key versioning support >

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support

2017-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.001.patch Versioning is going to be a rather complex change, a number

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support -1

2017-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Summary: Ozone: Container : Add key versioning support -1 (was: Ozone: Container : Add key versioning

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119142#comment-16119142 ] Mingliang Liu commented on HDFS-10326: -- Thanks [~wheat9] for taking care of this. > Disable setting

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-08-08 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119138#comment-16119138 ] Ravi Prakash commented on HDFS-6489: Hi [~brahmareddy]! Could you please update us on this issue? Also,

[jira] [Updated] (HDFS-12250) Reduce usage of FsPermissionExtension in HDFS unit tests

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12250: - Attachment: HDFS-12250.001.patch Rebased after HADOOP-14730 > Reduce usage of

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119134#comment-16119134 ] Haohui Mai commented on HDFS-10326: --- Committed to from trunk to branch-2.8.2. Thanks [~daryn] for the

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-10326: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 Release Note: The size of

[jira] [Updated] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Michael Han (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Han updated HDFS-12277: --- Attachment: HDFS-12277.001.patch Address checkstyle issue (line longer than 80 chars). Failed UT and

[jira] [Commented] (HDFS-10646) Federation admin tool

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119080#comment-16119080 ] Íñigo Goiri commented on HDFS-10646: Committed to HDFS-10467, thank you for the review

[jira] [Updated] (HDFS-10646) Federation admin tool

2017-08-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10646: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status:

[jira] [Commented] (HDFS-10646) Federation admin tool

2017-08-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119064#comment-16119064 ] Chris Douglas commented on HDFS-10646: -- +1 lgtm > Federation admin tool > - > >

[jira] [Commented] (HDFS-12259) Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client

2017-08-08 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119053#comment-16119053 ] Nandakumar commented on HDFS-12259: --- Thanks for the commit [~xyao].

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-08 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12280: -- Description:

[jira] [Commented] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119052#comment-16119052 ] Hadoop QA commented on HDFS-12277: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-08 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12280: -- Environment: (was:

[jira] [Created] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-08 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12280: - Summary: Ozone: TestOzoneContainer#testCreateOzoneContainer fails Key: HDFS-12280 URL: https://issues.apache.org/jira/browse/HDFS-12280 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12279) TestPipelinesFailover#testPipelineRecoveryStress fails due to race condition

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12279: -- Summary: TestPipelinesFailover#testPipelineRecoveryStress fails due to race condition Key: HDFS-12279 URL: https://issues.apache.org/jira/browse/HDFS-12279

[jira] [Commented] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119035#comment-16119035 ] Wei-Chiu Chuang commented on HDFS-12278: updated target version based on HDFS-6757 fix version, so

[jira] [Updated] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12278: --- Target Version/s: 3.0.0-beta1, 2.8.2 (was: 2.8.2) > LeaseManager#removeLease operation is

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-08-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119030#comment-16119030 ] Haohui Mai commented on HDFS-11160: --- Our clusters are around ~2000 nodes and disks failures are quite

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119007#comment-16119007 ] Wei-Chiu Chuang commented on HDFS-12182: Failed tests do not reproduce for me. +1. Will commit

[jira] [Updated] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-08 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12278: -- Description: After HDFS-6757, LeaseManager #removeLease became expensive. HDFS-6757 changed

[jira] [Created] (HDFS-12278) LeaseManager#removeLease operation is inefficient in 2.8.

2017-08-08 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12278: - Summary: LeaseManager#removeLease operation is inefficient in 2.8. Key: HDFS-12278 URL: https://issues.apache.org/jira/browse/HDFS-12278 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12259) Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client

2017-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12259: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-12259) Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client

2017-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118977#comment-16118977 ] Xiaoyu Yao commented on HDFS-12259: --- Thanks for the update. +1 for latest patch and I will commit it

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118936#comment-16118936 ] Sean Mackrory commented on HDFS-11096: -- Just pushed some more updates. HDFS-12151 is fixed, and I'm

[jira] [Updated] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-08-08 Thread Ajay Yadav (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Yadav updated HDFS-12221: -- Attachment: HDFS-12221.04.patch > Replace xcerces in XmlEditsVisitor >

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118920#comment-16118920 ] Hadoop QA commented on HDFS-12182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12259) Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client

2017-08-08 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118911#comment-16118911 ] Nandakumar commented on HDFS-12259: --- [~xyao], {{TestXceiverClientManager.testFreeByReference}} failure

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118907#comment-16118907 ] Hadoop QA commented on HDFS-12182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118882#comment-16118882 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118873#comment-16118873 ] Hadoop QA commented on HDFS-12238: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Michael Han (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Han updated HDFS-12277: --- Attachment: HDFS-12277.000.patch > NNThroughputBenchmark should use cumulativeTime to calculate ops

[jira] [Updated] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Michael Han (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Han updated HDFS-12277: --- Status: Patch Available (was: Open) > NNThroughputBenchmark should use cumulativeTime to calculate

[jira] [Created] (HDFS-12277) NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

2017-08-08 Thread Michael Han (JIRA)
Michael Han created HDFS-12277: -- Summary: NNThroughputBenchmark should use cumulativeTime to calculate ops per second. Key: HDFS-12277 URL: https://issues.apache.org/jira/browse/HDFS-12277 Project:

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-08-08 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118867#comment-16118867 ] Virajith Jalaparti commented on HDFS-9806: -- Hi [~mackrorysd], If this feature is included but not

[jira] [Commented] (HDFS-12259) Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client

2017-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118853#comment-16118853 ] Xiaoyu Yao commented on HDFS-12259: --- Thanks [~nandakumar131] for the detailed update. From the latest

[jira] [Commented] (HDFS-12237) libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source

2017-08-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118783#comment-16118783 ] James Clampffer commented on HDFS-12237: Disregard my last comment, I misread the patch and

[jira] [Assigned] (HDFS-12276) libhdfs++: uri parser has clang warnings that break external projects

2017-08-08 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-12276: Assignee: Anatoli Shein > libhdfs++: uri parser has clang warnings that break external

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118764#comment-16118764 ] Manoj Govindassamy commented on HDFS-11912: --- Sorry for the delay. Will get back after taking a

[jira] [Commented] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118759#comment-16118759 ] Wei-Chiu Chuang commented on HDFS-12249: Yes that is correct. To be more specific, the column for

[jira] [Assigned] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-11096: -- Assignee: Sean Mackrory (was: Lei (Eddy) Xu) > Support rolling upgrade between 2.x and 3.x >

[jira] [Comment Edited] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118750#comment-16118750 ] Wei-Chiu Chuang edited comment on HDFS-12182 at 8/8/17 5:53 PM: -+1 for

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118750#comment-16118750 ] Wei-Chiu Chuang commented on HDFS-12182: +1 for rev 004. Will commit soon. >

  1   2   >