[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673058#comment-15673058 ] Ming Ma commented on HDFS-10206: Thank [~nandakumar131]! * When the conditions {{reader.equals(node) &

[jira] [Updated] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2016-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11100: -- Status: Patch Available (was: Open) > Recursively deleting file protected by sticky bit should fail >

[jira] [Updated] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

2016-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11100: -- Status: Open (was: Patch Available) > Recursively deleting file protected by sticky bit should fail >

[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11152: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Labels:

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-11-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672895#comment-15672895 ] Andrew Wang commented on HDFS-10996: 1. Correct, users will not use ClientProtocol directly. 2.

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-16 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672891#comment-15672891 ] SammiChen commented on HDFS-10994: -- Thanks [~andrew.wang] and [~drankye] for raising the issue and

[jira] [Created] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-16 Thread SammiChen (JIRA)
SammiChen created HDFS-11152: Summary: Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors Key: HDFS-11152 URL: https://issues.apache.org/jira/browse/HDFS-11152

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-11-16 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672855#comment-15672855 ] SammiChen commented on HDFS-10996: -- Hi Andrew, thanks for reviewing the patch! Yes. it seems the new

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672774#comment-15672774 ] Hadoop QA commented on HDFS-10802: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11151) [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier

2016-11-16 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11151: --- Summary: [SPS]: Handle unable to choose target node for the required storage type by StoragePolicySatisfier Key: HDFS-11151 URL: https://issues.apache.org/jira/browse/HDFS-11151

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672736#comment-15672736 ] Rakesh R commented on HDFS-11150: - Thanks for volunteering [~yuanbo]. > [SPS]: Provide persistence when

[jira] [Commented] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672714#comment-15672714 ] Akira Ajisaka commented on HDFS-11134: -- Thanks [~vinayrpet], [~brahmareddy], and [~linyiqun] for the

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-16 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672623#comment-15672623 ] Yuanbo Liu commented on HDFS-11150: --- Prepare a patch next week, feel free to assign it to yourself if

[jira] [Created] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-16 Thread Yuanbo Liu (JIRA)
Yuanbo Liu created HDFS-11150: - Summary: [SPS]: Provide persistence when satisfying storage policy. Key: HDFS-11150 URL: https://issues.apache.org/jira/browse/HDFS-11150 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-16 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672573#comment-15672573 ] Yuanbo Liu commented on HDFS-10802: --- [~umamaheswararao] Thanks for your comments, upload v6 patch to

[jira] [Updated] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-16 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10802: -- Attachment: HDFS-10802-HDFS-10285.006.patch > [SPS]: Add satisfyStoragePolicy API in HdfsAdmin >

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672478#comment-15672478 ] Hadoop QA commented on HDFS-11148: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7717) Erasure Coding: distribute replication to EC conversion work to DataNode

2016-11-16 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672475#comment-15672475 ] Rui Gao commented on HDFS-7717: --- Duplicated by HDFS-11075, so closed HDFS-11075, and reassigned this issue to

[jira] [Resolved] (HDFS-11075) Provide a tool to help covert existing file of default 3x replication to EC striped layout

2016-11-16 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Gao resolved HDFS-11075. Resolution: Duplicate Duplicated with HDFS-7717 , reassigned it to [~Sammi] > Provide a tool to help

[jira] [Commented] (HDFS-11075) Provide a tool to help covert existing file of default 3x replication to EC striped layout

2016-11-16 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672460#comment-15672460 ] Rui Gao commented on HDFS-11075: Had reassigned HDFS-7717 to you. Have fun :D > Provide a tool to

[jira] [Updated] (HDFS-7717) Erasure Coding: distribute replication to EC conversion work to DataNode

2016-11-16 Thread Rui Gao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Gao updated HDFS-7717: -- Assignee: SammiChen (was: Rui Gao) > Erasure Coding: distribute replication to EC conversion work to DataNode >

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672424#comment-15672424 ] Hadoop QA commented on HDFS-11138: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672360#comment-15672360 ] Yiqun Lin commented on HDFS-11105: -- Thanks [~liuml07] for the review and commit. >

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672322#comment-15672322 ] Arpit Agarwal commented on HDFS-11148: -- Thank you for the feedback [~anu]. I have reduced the

[jira] [Updated] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11138: -- Attachment: HDFS-11138-HDFS-7240.003.patch Upload v003 patch to for a minor fix > Block Storage : add

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672174#comment-15672174 ] Hadoop QA commented on HDFS-11058: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672133#comment-15672133 ] Arpit Agarwal commented on HDFS-11148: -- The test failures look related to the patch. I will update

[jira] [Commented] (HDFS-11108) Ozone: use containers with the state machine

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672130#comment-15672130 ] Hadoop QA commented on HDFS-11108: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672125#comment-15672125 ] Hadoop QA commented on HDFS-11138: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672093#comment-15672093 ] ASF GitHub Bot commented on HDFS-11148: --- Github user arp7 commented on a diff in the pull request:

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672084#comment-15672084 ] ASF GitHub Bot commented on HDFS-11148: --- Github user arp7 commented on a diff in the pull request:

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672069#comment-15672069 ] Anu Engineer commented on HDFS-11148: - +1, LGTM. > Update DataNode to use StorageLocationChecker at

[jira] [Commented] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672048#comment-15672048 ] Hudson commented on HDFS-11147: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10850 (See

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672045#comment-15672045 ] Hadoop QA commented on HDFS-11058: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672040#comment-15672040 ] Hadoop QA commented on HDFS-11148: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672026#comment-15672026 ] ASF GitHub Bot commented on HDFS-11148: --- Github user anuengineer commented on a diff in the pull

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672025#comment-15672025 ] ASF GitHub Bot commented on HDFS-11148: --- Github user anuengineer commented on a diff in the pull

[jira] [Updated] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11147: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671916#comment-15671916 ] Arpit Agarwal commented on HDFS-11147: -- +1 will commit it shortly. > Remove confusing log output in

[jira] [Commented] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671906#comment-15671906 ] Chen Liang commented on HDFS-11147: --- The failed tests are unrelated. > Remove confusing log output in

[jira] [Updated] (HDFS-11108) Ozone: use containers with the state machine

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11108: Status: Patch Available (was: Open) > Ozone: use containers with the state machine >

[jira] [Updated] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11081: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11145) Implement getTrashRoot() for ViewFileSystem

2016-11-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11145: -- Labels: viewfs (was: ) Component/s: (was: federation) > Implement

[jira] [Updated] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11138: -- Attachment: HDFS-11138-HDFS-7240.002.patch Uploaded v002 patch to address [~anu]'s comments. I decided

[jira] [Created] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-16 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11149: Summary: Support for parallel checking of FsVolumes Key: HDFS-11149 URL: https://issues.apache.org/jira/browse/HDFS-11149 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9896) WebHDFS API may return invalid JSON

2016-11-16 Thread Lucas Lustosa Madureira (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671740#comment-15671740 ] Lucas Lustosa Madureira commented on HDFS-9896: --- Hey there, I was also able to reproduce

[jira] [Updated] (HDFS-11114) Support for running async disk checks in DataNode

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4: - Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671719#comment-15671719 ] Hadoop QA commented on HDFS-11147: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11148: - Description: The DataNode can use the {{StorageLocationChecker}} introduced by HDFS-9 to

[jira] [Updated] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11148: - Issue Type: Sub-task (was: Bug) Parent: HDFS-11086 > Update DataNode to use

[jira] [Commented] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671690#comment-15671690 ] ASF GitHub Bot commented on HDFS-11148: --- GitHub user arp7 opened a pull request:

[jira] [Updated] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11148: - Status: Patch Available (was: Open) > Update DataNode to use StorageLocationChecker at startup >

[jira] [Created] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2016-11-16 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11148: Summary: Update DataNode to use StorageLocationChecker at startup Key: HDFS-11148 URL: https://issues.apache.org/jira/browse/HDFS-11148 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671677#comment-15671677 ] Hudson commented on HDFS-11105: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10847 (See

[jira] [Resolved] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-11105. -- Resolution: Fixed > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Reopened] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-11105: -- > TestRBWBlockInvalidation#testRWRInvalidation fails intermittently >

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Affects Version/s: (was: 3.0.0-alpha1) 2.8.0 Component/s:

[jira] [Updated] (HDFS-11105) TestRBWBlockInvalidation#testRWRInvalidation fails intermittently

2016-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11105: - Resolution: Cannot Reproduce Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Attachment: (was: HDFS-11058.03.patch) > Implement 'hadoop fs -df' command for

[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Attachment: HDFS-11058.03.patch > Implement 'hadoop fs -df' command for ViewFileSystem

[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Attachment: (was: HDFS-11058.03.patch) > Implement 'hadoop fs -df' command for

[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Attachment: HDFS-11058.03.patch > Implement 'hadoop fs -df' command for ViewFileSystem

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671496#comment-15671496 ] Anu Engineer commented on HDFS-11138: - Thought this might help you, checkstyle warnings: {noformat}

[jira] [Updated] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11147: -- Attachment: HDFS-11147.001.patch > Remove confusing log output in

[jira] [Updated] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11147: -- Status: Patch Available (was: Open) > Remove confusing log output in

[jira] [Created] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11147: - Summary: Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos Key: HDFS-11147 URL: https://issues.apache.org/jira/browse/HDFS-11147 Project: Hadoop

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671319#comment-15671319 ] Anu Engineer commented on HDFS-11138: - bq. I actually do not have any strong opinion on this, if it is

[jira] [Comment Edited] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671324#comment-15671324 ] Chen Liang edited comment on HDFS-11138 at 11/16/16 7:10 PM: - bq. I think if

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671324#comment-15671324 ] Chen Liang commented on HDFS-11138: --- bq. I think if user specifies it we should use it, that is like

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671311#comment-15671311 ] Chen Liang commented on HDFS-11138: --- I actually do not have any strong opinion on this, if it is making

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671293#comment-15671293 ] Anu Engineer commented on HDFS-11138: - bq. The idea is that the force flag is only an optional flag,

[jira] [Commented] (HDFS-11138) Block Storage : add block storage server

2016-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671281#comment-15671281 ] Chen Liang commented on HDFS-11138: --- Thanks [~anu] for the comments! Here were my thoughts on some of

[jira] [Commented] (HDFS-10966) Enhance Dispatcher logic on deciding when to give up a source DataNode

2016-11-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671089#comment-15671089 ] Kihwal Lee commented on HDFS-10966: --- the patch looks reasonable in general. - It is replacing the logic

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670873#comment-15670873 ] Hadoop QA commented on HDFS-6262: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-10534: -- Attachment: HDFS-10534.09.patch > NameNode WebUI should display DataNode usage histogram >

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670676#comment-15670676 ] Kai Sasaki commented on HDFS-10534: --- [~zhz] Thanks for checking. I updated the patch and screenshot.

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage histogram

2016-11-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-10534: -- Attachment: Screen Shot 2016-11-17 at 0.14.06.png > NameNode WebUI should display DataNode usage

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670530#comment-15670530 ] Eric Badger commented on HDFS-11094: The test failures are unrelated to the patch and do not fail for

[jira] [Commented] (HDFS-11144) TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670351#comment-15670351 ] Hadoop QA commented on HDFS-11144: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670322#comment-15670322 ] Hadoop QA commented on HDFS-11134: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11144) TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-11144: --- Assignee: Brahma Reddy Battula >

[jira] [Updated] (HDFS-11144) TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11144: Attachment: HDFS-11144.patch Uploaded the patch..Kindly Review. >

[jira] [Updated] (HDFS-11144) TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11144: Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670179#comment-15670179 ] Brahma Reddy Battula commented on HDFS-11134: - Thanks for updating patch. LGTM, will hold for

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670132#comment-15670132 ] Brahma Reddy Battula commented on HDFS-11146: - Anythoughts on this..? > Excess replicas will

[jira] [Comment Edited] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670132#comment-15670132 ] Brahma Reddy Battula edited comment on HDFS-11146 at 11/16/16 10:50 AM:

[jira] [Updated] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11134: - Description: I found two bind exceptions causing the unit tests fails in history Jenkins buildings. One

[jira] [Created] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-16 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-11146: --- Summary: Excess replicas will not be deleted until all storages's FBR received after failover Key: HDFS-11146 URL: https://issues.apache.org/jira/browse/HDFS-11146

[jira] [Updated] (HDFS-11134) Fix bind exception threw in TestRenameWhileOpen

2016-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11134: - Summary: Fix bind exception threw in TestRenameWhileOpen (was: Fix bind exceptions in

[jira] [Updated] (HDFS-11134) Fix bind exceptions in TestRenameWhileOpen and TestPendingInvalidateBlock

2016-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11134: - Attachment: HDFS-11134.003.patch > Fix bind exceptions in TestRenameWhileOpen and

[jira] [Commented] (HDFS-11134) Fix bind exceptions in TestRenameWhileOpen and TestPendingInvalidateBlock

2016-11-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670117#comment-15670117 ] Yiqun Lin commented on HDFS-11134: -- Thanks [~vinayrpet] and [~brahmareddy] for the great comments. The

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669922#comment-15669922 ] Hadoop QA commented on HDFS-10368: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11134) Fix bind exceptions in TestRenameWhileOpen and TestPendingInvalidateBlock

2016-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669894#comment-15669894 ] Brahma Reddy Battula commented on HDFS-11134: - Thanks [~vinayrpet] taking a look into this

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669887#comment-15669887 ] Uma Maheswara Rao G commented on HDFS-10802: [~yuanbo] , Thank you for all your work. Almost

[jira] [Commented] (HDFS-11126) Ozone: Add small file support RPC

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669785#comment-15669785 ] Hadoop QA commented on HDFS-11126: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||