[jira] [Updated] (HDFS-11373) Backport HDFS-11258 and HDFS-11272 to branch-2.7

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11373: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4

[jira] [Commented] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004092#comment-16004092 ] Hadoop QA commented on HDFS-11757: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11795) Fix ASF Licence warnings in branch-2.7

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004082#comment-16004082 ] Hadoop QA commented on HDFS-11795: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11783) Ozone: Fix spotbugs warnings

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004068#comment-16004068 ] Hadoop QA commented on HDFS-11783: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11765) Fix:Performance regression due to incorrect use of DataChecksum

2017-05-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004062#comment-16004062 ] Masatake Iwasaki commented on HDFS-11765: - I will commit this shortly. Before that, I'm going to

[jira] [Updated] (HDFS-11768) Ozone: KSM: Create Key Space manager service

2017-05-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11768: Status: Patch Available (was: Open) > Ozone: KSM: Create Key Space manager service >

[jira] [Updated] (HDFS-11768) Ozone: KSM: Create Key Space manager service

2017-05-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11768: Attachment: HDFS-11768-HDFS-7240.001.patch > Ozone: KSM: Create Key Space manager service >

[jira] [Updated] (HDFS-11680) Ozone: SCM CLI: Implement info container command

2017-05-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11680: -- Attachment: HDFS-11680-HDFS-7240.006.patch [~cheersyang] Thanks for your comments. Your env seems out

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003997#comment-16003997 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-05-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003980#comment-16003980 ] Weiwei Yang commented on HDFS-11601: Thanks [~anu] for the heads up, I will keep an eye on the statues

[jira] [Commented] (HDFS-11783) Ozone: Fix spotbugs warnings

2017-05-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003976#comment-16003976 ] Weiwei Yang commented on HDFS-11783: Uploaded v2 patch to fix the findbugs warning in

[jira] [Comment Edited] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003966#comment-16003966 ] SammiChen edited comment on HDFS-11757 at 5/10/17 3:21 AM: --- Sure. Initial patch

[jira] [Updated] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11757: - Status: Patch Available (was: Open) > Query StreamCapabilities when creating balancer's lock file >

[jira] [Updated] (HDFS-11783) Ozone: Fix spotbugs warnings

2017-05-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11783: --- Attachment: HDFS-11783-HDFS-7240.002.patch > Ozone: Fix spotbugs warnings >

[jira] [Updated] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11757: - Attachment: HDFS-11757.001.patch Initial patch > Query StreamCapabilities when creating balancer's lock

[jira] [Updated] (HDFS-11795) Fix ASF Licence warnings in branch-2.7

2017-05-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11795: - Description: There are some ASF warnings appeared in branch-2.7 due to test files being created in

[jira] [Updated] (HDFS-11795) Fix ASF Licence warnings in branch-2.7

2017-05-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11795: - Attachment: HDFS-11795-branch-2.7.001.patch > Fix ASF Licence warnings in branch-2.7 >

[jira] [Updated] (HDFS-11795) Fix ASF Licence warnings in branch-2.7

2017-05-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11795: - Status: Patch Available (was: Open) Attach a simple fix to get a quick fix. > Fix ASF Licence warnings

[jira] [Created] (HDFS-11795) Fix ASF Licence warnings in branch-2.7

2017-05-09 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11795: Summary: Fix ASF Licence warnings in branch-2.7 Key: HDFS-11795 URL: https://issues.apache.org/jira/browse/HDFS-11795 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11783) Ozone: Fix spotbugs warnings

2017-05-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003949#comment-16003949 ] Weiwei Yang commented on HDFS-11783: Hi [~linyiqun] sure, I thought that was from cblock so I did not

[jira] [Created] (HDFS-11794) Add ec sub command -listCodec to show currently supported ec codecs

2017-05-09 Thread SammiChen (JIRA)
SammiChen created HDFS-11794: Summary: Add ec sub command -listCodec to show currently supported ec codecs Key: HDFS-11794 URL: https://issues.apache.org/jira/browse/HDFS-11794 Project: Hadoop HDFS

[jira] [Created] (HDFS-11793) Dfs configuration key dfs.namenode.ec.policies.enabled support user defined erasure coding policy

2017-05-09 Thread SammiChen (JIRA)
SammiChen created HDFS-11793: Summary: Dfs configuration key dfs.namenode.ec.policies.enabled support user defined erasure coding policy Key: HDFS-11793 URL: https://issues.apache.org/jira/browse/HDFS-11793

[jira] [Assigned] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11757: Assignee: SammiChen > Query StreamCapabilities when creating balancer's lock file >

[jira] [Commented] (HDFS-11783) Ozone: Fix spotbugs warnings

2017-05-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003917#comment-16003917 ] Yiqun Lin commented on HDFS-11783: -- Hi [~cheersyang], thanks for fixing this! I am thinking we might

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-010.patch Fixed: * Unit tests * Findbugs * Check styles >

[jira] [Commented] (HDFS-11644) Support for querying outputstream capabilities

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003907#comment-16003907 ] Hadoop QA commented on HDFS-11644: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11792) [READ] Additional test cases for ProvidedVolumeImpl

2017-05-09 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-11792: - Summary: [READ] Additional test cases for ProvidedVolumeImpl Key: HDFS-11792 URL: https://issues.apache.org/jira/browse/HDFS-11792 Project: Hadoop HDFS

[jira] [Created] (HDFS-11791) [READ] Test for increasing replication of provided files.

2017-05-09 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-11791: - Summary: [READ] Test for increasing replication of provided files. Key: HDFS-11791 URL: https://issues.apache.org/jira/browse/HDFS-11791 Project: Hadoop

[jira] [Commented] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003885#comment-16003885 ] Hadoop QA commented on HDFS-11788: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11790) Decommissioning of a DataNode after MaintenanceState takes a very long time to complete

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003869#comment-16003869 ] Manoj Govindassamy commented on HDFS-11790: --- [~mingma], Please take a look at the problem

[jira] [Updated] (HDFS-11790) Decommissioning of a DataNode after MaintenanceState takes a very long time to complete

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11790: -- Description: *Problem:* When a DataNode is requested for Decommissioning after it

[jira] [Created] (HDFS-11790) Decommissioning of a DataNode after MaintenanceState takes a very long time to complete

2017-05-09 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11790: - Summary: Decommissioning of a DataNode after MaintenanceState takes a very long time to complete Key: HDFS-11790 URL: https://issues.apache.org/jira/browse/HDFS-11790

[jira] [Assigned] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HDFS-11681: Assignee: Virajith Jalaparti > DatanodeStorageInfo#getBlockIterator() should return an

[jira] [Commented] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003779#comment-16003779 ] Xiaoyu Yao commented on HDFS-11788: --- Thanks [~vagarychen] for working on this. Patch v2 looks pretty

[jira] [Commented] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003781#comment-16003781 ] Hadoop QA commented on HDFS-11788: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003776#comment-16003776 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11789) Maintain Short-Circuit Read Statistics

2017-05-09 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11789: - Summary: Maintain Short-Circuit Read Statistics Key: HDFS-11789 URL: https://issues.apache.org/jira/browse/HDFS-11789 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-11780: - Assignee: Xiaoyu Yao > Ozone: KSM : Add putKey > --- > >

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003697#comment-16003697 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11788: -- Attachment: HDFS-11788-HDFS-7240.002.patch Missing close db in v001 patch, fix in v002 patch. > Ozone

[jira] [Commented] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003678#comment-16003678 ] Hadoop QA commented on HDFS-11784: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003654#comment-16003654 ] Arpit Agarwal commented on HDFS-11745: -- Thanks for committing it [~jlowe]. I wrongly assumed Eric had

[jira] [Commented] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003650#comment-16003650 ] Hadoop QA commented on HDFS-11785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003627#comment-16003627 ] Hadoop QA commented on HDFS-11681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003619#comment-16003619 ] Wei-Chiu Chuang commented on HDFS-11741: [~zhz] [~shahrs87] mind to chime in on this observation?

[jira] [Commented] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003597#comment-16003597 ] Jason Lowe commented on HDFS-11745: --- Thanks for the patch! I noticed that

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003596#comment-16003596 ] Manoj Govindassamy commented on HDFS-10999: --- Above test failures are not related to the patch.

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-009.patch * Improving {{ConnectionManager}} * Fixing

[jira] [Updated] (HDFS-11644) Support for querying outputstream capabilities

2017-05-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11644: --- Status: Patch Available (was: Reopened) > Support for querying outputstream capabilities >

[jira] [Reopened] (HDFS-11644) Support for querying outputstream capabilities

2017-05-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11644: > Support for querying outputstream capabilities > -- > >

[jira] [Updated] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11788: -- Status: Patch Available (was: Open) > Ozone : add DEBUG CLI support for nodepool db file >

[jira] [Updated] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11788: -- Attachment: HDFS-11788-HDFS-7240.001.patch Post v001 patch to add converting of nodepool db. > Ozone :

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003575#comment-16003575 ] Hadoop QA commented on HDFS-10999: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11788: - Summary: Ozone : add DEBUG CLI support for nodepool db file Key: HDFS-11788 URL: https://issues.apache.org/jira/browse/HDFS-11788 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11756) Ozone : add DEBUG CLI support of blockDB file

2017-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11756: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone : add DEBUG CLI support of

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003564#comment-16003564 ] Anatoli Shein commented on HDFS-10785: -- Thanks [~James C] for the review. I have addressed your

[jira] [Commented] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003554#comment-16003554 ] Hadoop QA commented on HDFS-11755: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11644) Support for querying outputstream capabilities

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11644: -- Attachment: HDFS-11644-branch-2.01.patch Thanks for the review and commit help

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-09 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.003.patch New patch attached. > libhdfs++: Implement the rest

[jira] [Updated] (HDFS-11742) Improve balancer usability after HDFS-8818

2017-05-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11742: --- Target Version/s: 2.7.4, 3.0.0-beta1, 2.8.1 (was: 2.7.4, 2.8.1) > Improve balancer usability after

[jira] [Commented] (HDFS-11756) Ozone : add DEBUG CLI support of blockDB file

2017-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003522#comment-16003522 ] Chen Liang commented on HDFS-11756: --- Thanks [~anu] for the review! I've committed to the feature branch.

[jira] [Commented] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003459#comment-16003459 ] Nathan Roberts commented on HDFS-11755: --- bq. Do you know which one makes more sense? Not an expert

[jira] [Commented] (HDFS-11644) Support for querying outputstream capabilities

2017-05-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003441#comment-16003441 ] Andrew Wang commented on HDFS-11644: Talked with Manoj offline, we think this would be good to get

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003435#comment-16003435 ] Virajith Jalaparti commented on HDFS-11681: --- Thanks a taking a look [~chris.douglas]. The

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Status: Patch Available (was: Open) > DatanodeStorageInfo#getBlockIterator() should

[jira] [Assigned] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-05-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HDFS-11096: Assignee: Lei (Eddy) Xu > Support rolling upgrade between 2.x and 3.x >

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Attachment: HDFS-11681.002.patch > DatanodeStorageInfo#getBlockIterator() should return

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-05-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Status: Open (was: Patch Available) > DatanodeStorageInfo#getBlockIterator() should

[jira] [Created] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11787: -- Summary: After HDFS-11515, -du still throws ConcurrentModificationException Key: HDFS-11787 URL: https://issues.apache.org/jira/browse/HDFS-11787 Project: Hadoop

[jira] [Commented] (HDFS-11515) -du throws ConcurrentModificationException

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003366#comment-16003366 ] Wei-Chiu Chuang commented on HDFS-11515: Sure. I filed HDFS-11787 to follow up. > -du throws

[jira] [Resolved] (HDFS-11515) -du throws ConcurrentModificationException

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11515. Resolution: Fixed > -du throws ConcurrentModificationException >

[jira] [Commented] (HDFS-6949) Add NFS-ACL protocol support

2017-05-09 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003342#comment-16003342 ] Ruslan Dautkhanov commented on HDFS-6949: - https://tools.ietf.org/html/rfc3530#section-5.11 NFS

[jira] [Commented] (HDFS-11786) Add a new command for multi threaded Put/CopyFromLocal

2017-05-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003340#comment-16003340 ] Anu Engineer commented on HDFS-11786: - [~msingh] Thanks for the initial patch. I would think that this

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003341#comment-16003341 ] Akira Ajisaka commented on HDFS-11687: -- Hi [~eddyxu], would you backport this to branch-2.8.1 as

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1600#comment-1600 ] Lei (Eddy) Xu commented on HDFS-11687: -- [~shahrs87] Backported to branch-2.8. > Add new public

[jira] [Updated] (HDFS-11786) Add a new command for multi threaded Put/CopyFromLocal

2017-05-09 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11786: - Attachment: HDFS-11786.001.patch Initial patch, I am working on a unit test, will add it

[jira] [Updated] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11785: Description: As per discussussion in [mailling

[jira] [Updated] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11785: Status: Patch Available (was: Open) > Backport HDFS-9902 to branch-2.7: Support

[jira] [Created] (HDFS-11786) Add a new command for multi threaded Put/CopyFromLocal

2017-05-09 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-11786: Summary: Add a new command for multi threaded Put/CopyFromLocal Key: HDFS-11786 URL: https://issues.apache.org/jira/browse/HDFS-11786 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11785: Attachment: HDFS-11785-branch-2.7.patch Uploaded the patch.kindly Review. >

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Attachment: HDFS-10999.03.patch Thanks [~tasanuma0829] and [~andrew.wang] for the

[jira] [Comment Edited] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-05-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003294#comment-16003294 ] Manoj Govindassamy edited comment on HDFS-10999 at 5/9/17 6:52 PM: ---

[jira] [Created] (HDFS-11785) Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type

2017-05-09 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-11785: --- Summary: Backport HDFS-9902 to branch-2.7: Support different values of dfs.datanode.du.reserved per storage type Key: HDFS-11785 URL:

[jira] [Updated] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11784: Attachment: HDFS-11784-branch-2.7.patch > Backport HDFS-8312 to branch-2.7: Trash

[jira] [Updated] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11784: Attachment: (was: HDFS-11784-branch-2.7.patch.patch) > Backport HDFS-8312 to

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003280#comment-16003280 ] Naveen Gangam commented on HDFS-11687: -- [~shahrs87] Confirmed. No references in hive code. Appears

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003279#comment-16003279 ] Brahma Reddy Battula commented on HDFS-10987: - [~kihwal] can you please review the branch-2.7

[jira] [Comment Edited] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003268#comment-16003268 ] Naveen Gangam edited comment on HDFS-11687 at 5/9/17 6:45 PM: -- Thanks

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003268#comment-16003268 ] Naveen Gangam commented on HDFS-11687: -- Thanks [~rushabh.shah]. I believe this is being logged by the

[jira] [Updated] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated HDFS-11755: -- Status: Patch Available (was: Open) v1 of trunk patch. branch 2 will require a separate

[jira] [Updated] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11784: Attachment: HDFS-11784-branch-2.7.patch.patch Uploaded the patch ,kindly

[jira] [Updated] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11784: Status: Patch Available (was: Open) > Backport HDFS-8312 to branch-2.7: Trash does

[jira] [Updated] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated HDFS-11755: -- Attachment: HDFS-11755.001.patch > Underconstruction blocks can be considered missing >

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003251#comment-16003251 ] Rushabh S Shah commented on HDFS-11687: --- bq. Wouldnt we see the same log message again if we use

[jira] [Created] (HDFS-11784) Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions

2017-05-09 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-11784: --- Summary: Backport HDFS-8312 to branch-2.7: Trash does not descent into child directories to check for permissions Key: HDFS-11784 URL:

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003243#comment-16003243 ] Daryn Sharp commented on HDFS-11661: Sorry, thought I commented last week. I agree we should just

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003239#comment-16003239 ] Wei-Chiu Chuang commented on HDFS-11661: [~shahrs87] My bad. You're absolutely correct. >

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003235#comment-16003235 ] Rushabh S Shah commented on HDFS-11661: --- bq. I suggest we revert both HDFS-11515 and HDFS-11661 to

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003225#comment-16003225 ] Wei-Chiu Chuang commented on HDFS-11661: I don't want to have this one blocking Hadoop 3 alpha3. I

[jira] [Commented] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003216#comment-16003216 ] Wei-Chiu Chuang commented on HDFS-11732: I'd like to review the patch later. Thanks [~zhz] for

  1   2   >