[jira] [Commented] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980764#comment-15980764 ] Hadoop QA commented on HDFS-11605: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-04-24 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-006.patch Trying to get Jenkins to run and some minor updates: *

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-04-24 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Attachment: HDFS-11546-HDFS-10467-006.patch * Adding more methods to {{RouterRpcServer}} * Stub

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-04-24 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Attachment: (was: HDFS-11546-HDFS-10467-006.patch) > Router-based HDFS federation >

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981551#comment-15981551 ] Zhe Zhang commented on HDFS-11384: -- Thanks [~shv] for the update. The added Javadoc looks good. The unit

[jira] [Commented] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981506#comment-15981506 ] Weiwei Yang commented on HDFS-11493: Hi [~anu] Thanks for replying my questions, I am glad to see

[jira] [Commented] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981573#comment-15981573 ] Chen Liang commented on HDFS-11627: --- Thanks [~msingh] for working on this. v001 patch looks good to me,

[jira] [Commented] (HDFS-7541) Upgrade Domains in HDFS

2017-04-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981993#comment-15981993 ] Kihwal Lee commented on HDFS-7541: -- [~mingma] Since you guys have been using it in production for a while,

[jira] [Updated] (HDFS-11700) testBackupNodePorts doesn't pass on Windows machine

2017-04-24 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbang Hu updated HDFS-11700: - Description: In TestHDFSServerPorts.testBackupNodePorts, there are two attempts at starting backup node.

[jira] [Created] (HDFS-11700) testBackupNodePorts doesn't pass on Windows machine

2017-04-24 Thread Anbang Hu (JIRA)
Anbang Hu created HDFS-11700: Summary: testBackupNodePorts doesn't pass on Windows machine Key: HDFS-11700 URL: https://issues.apache.org/jira/browse/HDFS-11700 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11699) Ozone:SCM: Add support for close containers in SCM

2017-04-24 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11699: --- Summary: Ozone:SCM: Add support for close containers in SCM Key: HDFS-11699 URL: https://issues.apache.org/jira/browse/HDFS-11699 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-594) Add support for byte-ranges to hsftp

2017-04-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-594. - Resolution: Won't Fix Release Note: As hftp / hsftp have been deprecated a long time a ago. Closing

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982055#comment-15982055 ] Chen Liang commented on HDFS-11580: --- Hi [~linyiqun], Thanks for working on this! But I'm not sure this

[jira] [Commented] (HDFS-7541) Upgrade Domains in HDFS

2017-04-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982121#comment-15982121 ] Zhe Zhang commented on HDFS-7541: - This feature would be very useful for our clusters. We'd love to see it

[jira] [Moved] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-04-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved HADOOP-14337 to HDFS-11696: --- Affects Version/s: (was: 3.0.0-alpha3)

[jira] [Created] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-04-24 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11698: --- Summary: Ozone: SCM: CLI: Add Debug command Key: HDFS-11698 URL: https://issues.apache.org/jira/browse/HDFS-11698 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: HDFS-11663-HDFS-9806.002.patch Fixed failing test

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: (was: HDFS-11663-HDFS-9806.002.patch) > [READ] Fix NullPointerException

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

2017-04-24 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-007.patch * Switched to {{Logger}} * Minor style changes >

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Status: Open (was: Patch Available) > [READ] Fix NullPointerException in

[jira] [Comment Edited] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981659#comment-15981659 ] Chen Liang edited comment on HDFS-11627 at 4/24/17 8:32 PM: Actually, some

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: (was: HDFS-11663-HDFS-9806.003.patch) > [READ] Fix NullPointerException

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: HDFS-11663-HDFS-9806.003.patch > [READ] Fix NullPointerException in

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Status: Patch Available (was: Open) > [READ] Fix NullPointerException in

[jira] [Comment Edited] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981659#comment-15981659 ] Chen Liang edited comment on HDFS-11627 at 4/24/17 6:46 PM: Actually, in

[jira] [Commented] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981659#comment-15981659 ] Chen Liang commented on HDFS-11627: --- Actually, in {{ContainerCacheFlusher}}: 1. in {code}

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-04-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7240: --- Attachment: HDFS-11493-HDFS-7240.003.patch [~cheersyang] Thanks for the review comments. This update

[jira] [Issue Comment Deleted] (HDFS-7240) Object store in HDFS

2017-04-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7240: --- Comment: was deleted (was: [~cheersyang] Thanks for the review comments. This update addresses most

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-04-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7240: --- Attachment: (was: HDFS-11493-HDFS-7240.003.patch) > Object store in HDFS > >

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Status: Patch Available (was: Open) > [READ] Fix NullPointerException in

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Attachment: HDFS-11663-HDFS-9806.003.patch > [READ] Fix NullPointerException in

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-04-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Status: Open (was: Patch Available) > [READ] Fix NullPointerException in

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Attachment: HDFS-11493-HDFS-7240.003.patch [~cheersyang] Thanks for the review comments. This patch

[jira] [Assigned] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-04-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-11698: - Assignee: Chen Liang > Ozone: SCM: CLI: Add Debug command > ---

[jira] [Commented] (HDFS-11417) Add datanode admin command to get the storage info.

2017-04-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980995#comment-15980995 ] Akira Ajisaka commented on HDFS-11417: -- LGTM, +1 > Add datanode admin command to get the storage

[jira] [Commented] (HDFS-7850) distribute-excludes and refresh-namenodes update to new shell framework

2017-04-24 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981003#comment-15981003 ] Andras Bokor commented on HDFS-7850: [~aw], What do you mean with "use new shell framework"? >

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982375#comment-15982375 ] Mukul Kumar Singh commented on HDFS-11580: -- Thanks for working on this [~linyiqun], 1) As

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2017-04-24 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-11394: -- Attachment: HDFS-11394.02.patch > Add method for getting erasure coding policy through WebHDFS >

[jira] [Created] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-24 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-11697: - Summary: Javadoc of erasure coding policy in file status Key: HDFS-11697 URL: https://issues.apache.org/jira/browse/HDFS-11697 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-24 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-11697: -- Status: Patch Available (was: Open) - Add javadoc for storage policy and erasure coding policy - Fix

[jira] [Updated] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-24 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-11697: -- Attachment: HDFS-11697.01.patch > Javadoc of erasure coding policy in file status >

[jira] [Comment Edited] (HDFS-11697) Javadoc of erasure coding policy in file status

2017-04-24 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981121#comment-15981121 ] Kai Sasaki edited comment on HDFS-11697 at 4/24/17 12:56 PM: - Updated for -

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2017-04-24 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981732#comment-15981732 ] Ruslan Dautkhanov commented on HDFS-8131: - Thanks for this great improvement! When using

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-04-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981902#comment-15981902 ] Anu Engineer commented on HDFS-11580: - [~linyiqun] Thanks for the patch. I am still reading thru the

[jira] [Commented] (HDFS-11700) testBackupNodePorts doesn't pass on Windows machine

2017-04-24 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982266#comment-15982266 ] Anbang Hu commented on HDFS-11700: -- The proposed solution is to reset namenode backup address before the

[jira] [Commented] (HDFS-11700) testBackupNodePorts doesn't pass on Windows machine

2017-04-24 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982289#comment-15982289 ] Anbang Hu commented on HDFS-11700: -- {{DFS_NAMENODE_BACKUP_ADDRESS_KEY}} is set in

[jira] [Updated] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11627: - Status: Patch Available (was: Open) > Block Storage: Cblock cache should register with

[jira] [Updated] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11627: - Status: Open (was: Patch Available) > Block Storage: Cblock cache should register with

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.008.patch # Took some time to reproduce failures. I did not

[jira] [Commented] (HDFS-11691) Add a proper scheme to the datanode links in NN web UI

2017-04-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981281#comment-15981281 ] Weiwei Yang commented on HDFS-11691: Hi [~kihwal] Thanks for catching and fixing this. I have one

[jira] [Commented] (HDFS-11691) Add a proper scheme to the datanode links in NN web UI

2017-04-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981295#comment-15981295 ] Kihwal Lee commented on HDFS-11691: --- bq. this way datanode link field on UI will also display

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-04-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981299#comment-15981299 ] Weiwei Yang commented on HDFS-10480: Hi [~shahrs87] Just curious, what's the difference of this

[jira] [Commented] (HDFS-11700) testBackupNodePorts doesn't pass on Windows machine

2017-04-24 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982278#comment-15982278 ] Inigo Goiri commented on HDFS-11700: [~huanbang1993] do you mind mentioning where the

[jira] [Commented] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982294#comment-15982294 ] Mukul Kumar Singh commented on HDFS-11627: -- Hi Chen, Thanks for the review. I have addressed most

[jira] [Updated] (HDFS-11627) Block Storage: Cblock cache should register with flusher to upload blocks to containers

2017-04-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11627: - Attachment: HDFS-11627-HDFS-7240.002.patch > Block Storage: Cblock cache should register