[jira] [Commented] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934134#comment-15934134 ] Hudson commented on HDFS-11545: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11432 (See

[jira] [Commented] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934133#comment-15934133 ] Hadoop QA commented on HDFS-11492: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11545: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11358) DiskBalancer: Report command supports reading nodes from host file

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934080#comment-15934080 ] Hadoop QA commented on HDFS-11358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11132: -- Resolution: Fixed Fix Version/s: 2.8.1 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934067#comment-15934067 ] Hadoop QA commented on HDFS-11492: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Attachment: HDFS-11492-HDFS-7240.003.patch Thank you for your comments [~xyao]. The new patch

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Attachment: HDFS-11492-HDFS-7240.002.patch > Ozone: Add the ability to handle sendContainerReport

[jira] [Commented] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934038#comment-15934038 ] Xiaoyu Yao commented on HDFS-11492: --- Thanks [~anu] for working on this. The latest patch looks pretty

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

2017-03-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934030#comment-15934030 ] SammiChen commented on HDFS-11541: -- Hi Nagy, thanks for report this! If you don't mind I will take this.

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Attachment: (was: HDFS-11492-HDFS-7240.002.patch) > Ozone: Add the ability to handle

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

2017-03-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934024#comment-15934024 ] Kai Zheng commented on HDFS-11541: -- Yes, this would be better to have, as exactly as the issue

[jira] [Commented] (HDFS-8387) Erasure Coding: Revisit the long and int datatypes usage in striping logic

2017-03-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934021#comment-15934021 ] Kai Zheng commented on HDFS-8387: - It would be great if we could have some relevant sample codes here in

[jira] [Commented] (HDFS-11358) DiskBalancer: Report command supports reading nodes from host file

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934015#comment-15934015 ] Anu Engineer commented on HDFS-11358: - [~linyiqun] Thanks for updating the patch. +1, pending jenkins.

[jira] [Updated] (HDFS-11358) DiskBalancer: Report command supports reading nodes from host file

2017-03-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11358: - Attachment: HDFS-11358.002.patch Thanks [~anu] for taking the review. The comments make sense to me.

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934003#comment-15934003 ] Anu Engineer commented on HDFS-11519: - [~szetszwo] I tried to apply the patch v3 on the current top of

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Attachment: HDFS-11492-HDFS-7240.002.patch [~yuanbo] Thank you for your kind comments. This patch

[jira] [Commented] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933998#comment-15933998 ] Hadoop QA commented on HDFS-11132: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-03-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933994#comment-15933994 ] Kai Zheng commented on HDFS-7337: - [~andrew.wang], [~zhz], [~rakeshr] or anybody Trying not to be

[jira] [Commented] (HDFS-11361) Block Storage : add cache interface

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933986#comment-15933986 ] Hadoop QA commented on HDFS-11361: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933985#comment-15933985 ] Hadoop QA commented on HDFS-11519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933980#comment-15933980 ] Hadoop QA commented on HDFS-11545: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Status: Patch Available (was: Open) > Ozone: Implement XceiverServerSpi and

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170320.patch After RATIS-47, both guava and netty

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933920#comment-15933920 ] Manoj Govindassamy commented on HDFS-10530: --- Filed HDFS-11552 and HDFS-11552 to track the

[jira] [Created] (HDFS-11554) Federation Router documentation

2017-03-20 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11554: -- Summary: Federation Router documentation Key: HDFS-11554 URL: https://issues.apache.org/jira/browse/HDFS-11554 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8201) Refactor the end to end test for stripping file writing and reading

2017-03-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933916#comment-15933916 ] Kai Zheng commented on HDFS-8201: - Just did a check and found below tests that all can serve the end to end

[jira] [Resolved] (HDFS-8201) Refactor the end to end test for stripping file writing and reading

2017-03-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8201. - Resolution: Duplicate Marking this as duplicate as the desired work was already done elsewhere. >

[jira] [Comment Edited] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933899#comment-15933899 ] John Zhuge edited comment on HDFS-11132 at 3/21/17 12:55 AM: - Re-open to

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11132: -- Status: Patch Available (was: Reopened) Trigger pre-commit tests on branch-2 > Allow

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11132: -- Attachment: HDFS-11132.branch-2.001.patch > Allow AccessControlException in contract tests when

[jira] [Reopened] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-11132: --- Re-open to attach HDFS-11132.branch-2.001.patch > Allow AccessControlException in contract tests when

[jira] [Created] (HDFS-11553) Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks

2017-03-20 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11553: - Summary: Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks Key: HDFS-11553 URL: https://issues.apache.org/jira/browse/HDFS-11553

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is undefined

2017-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933859#comment-15933859 ] Hudson commented on HDFS-6648: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11431 (See

[jira] [Created] (HDFS-11552) Erasure Coding: Support Parity Blocks placement onto same nodes hosting Data Blocks when DataNodes are insufficient

2017-03-20 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11552: - Summary: Erasure Coding: Support Parity Blocks placement onto same nodes hosting Data Blocks when DataNodes are insufficient Key: HDFS-11552 URL:

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is undefined

2017-03-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6648: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Release Note: I

[jira] [Assigned] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is undefined

2017-03-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HDFS-6648: --- Assignee: Inigo Goiri > Order of namenodes in ConfiguredFailoverProxyProvider is undefined >

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.003.patch Resolved checkstyle errors in patch v03. > Propagate

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is undefined

2017-03-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6648: Summary: Order of namenodes in ConfiguredFailoverProxyProvider is undefined (was: Order of

[jira] [Updated] (HDFS-11361) Block Storage : add cache interface

2017-03-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11361: -- Attachment: HDFS-11361-HDFS-7240.004.patch Thanks [~anu] for the comments! Post v004 patch to include a

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933801#comment-15933801 ] Hadoop QA commented on HDFS-11544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11162) Block Storage : add command line tool

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933793#comment-15933793 ] Hadoop QA commented on HDFS-11162: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933774#comment-15933774 ] Hadoop QA commented on HDFS-11545: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933771#comment-15933771 ] Andrew Wang commented on HDFS-11170: Hi Sammi, thanks for the rev, Inspired by Stack's comment, I

[jira] [Updated] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11544: --- Attachment: HDFS-11544.HDFS-8707.001.patch Thanks for the review @Xiaowei zhu! I noticed a

[jira] [Commented] (HDFS-11361) Block Storage : add cache interface

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933737#comment-15933737 ] Anu Engineer commented on HDFS-11361: - [~vagarychen] Thanks for contributing this patch. From code

[jira] [Updated] (HDFS-11162) Block Storage : add command line tool

2017-03-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11162: -- Attachment: HDFS-11162-HDFS-7240.008.patch Thanks [~msingh] for the comments! Repost v007 patch as v008

[jira] [Commented] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933642#comment-15933642 ] Mingliang Liu commented on HDFS-11132: -- Hi [~jzhuge], yes, this should belong to Hadoop Common. I

[jira] [Commented] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933606#comment-15933606 ] Arpit Agarwal commented on HDFS-11545: -- +1 for the v2 patch pending Jenkins. > Propagate DataNode's

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-20 Thread Dan Hecht (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933605#comment-15933605 ] Dan Hecht commented on HDFS-11529: -- Hi [~sailesh], it'd be good to document the memory ownership/lifetime

[jira] [Commented] (HDFS-11540) PeerCache sync overhead

2017-03-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933595#comment-15933595 ] Ravi Prakash commented on HDFS-11540: - Thanks for your contribution Ravikumar! :-) Could you please

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-20 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.002.patch Thank you [~arpitagarwal] for reviewing the patch. I have

[jira] [Created] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-20 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11551: - Summary: Handle SlowDiskReport from DataNode at the NameNode Key: HDFS-11551 URL: https://issues.apache.org/jira/browse/HDFS-11551 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11358) DiskBalancer: Report command supports reading nodes from host file

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933495#comment-15933495 ] Anu Engineer commented on HDFS-11358: - [~linyiqun] My apologies for the time it took me to get to this

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933486#comment-15933486 ] Tsz Wo Nicholas Sze commented on HDFS-11535: Thank [~linyiqun] for testing it! {quote} Suppose

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11444: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-20 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933429#comment-15933429 ] Inigo Goiri commented on HDFS-10629: [~subru], the new patch only includes the core of the Router. The

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933417#comment-15933417 ] Xiaowei Zhu commented on HDFS-11544: +1. Changes look good to me. > libhdfs++: Improve C API error

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11444: -- Fix Version/s: (was: HDFS-7240) Status: Patch Available (was: Open) > Ozone: Fix

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11444: -- Status: Open (was: Patch Available) > Ozone: Fix datanode ID handling in MiniOzoneCluster >

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-20 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933354#comment-15933354 ] yunjiong zhao commented on HDFS-11384: -- Thanks [~shv] for review. Only when you set

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-20 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933354#comment-15933354 ] yunjiong zhao edited comment on HDFS-11384 at 3/20/17 7:26 PM: --- Thanks

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933341#comment-15933341 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933260#comment-15933260 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933253#comment-15933253 ] John Zhuge commented on HDFS-11132: --- This JIRA belongs to Hadoop Common. Is it too late to change its

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933250#comment-15933250 ] Konstantin Shvachko commented on HDFS-11384: Hey [~zhaoyunjiong], [~benoyantony]. This seems

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-03-20 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Component/s: (was: fs) hdfs > Federation Router RPC server >

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-03-20 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Affects Version/s: (was: 2.7.2) 2.8.1 > Router-based HDFS federation >

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2017-03-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11132: -- Component/s: fs/adl > Allow AccessControlException in contract tests when getFileStatus on >

[jira] [Commented] (HDFS-11537) Block Storage : add cache layer

2017-03-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933178#comment-15933178 ] Chen Liang commented on HDFS-11537: --- Thanks [~xyao] for the comments! But this patch still requires

[jira] [Updated] (HDFS-11550) Ozone: Add a check to prevent removing a container that has keys in it

2017-03-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11550: --- Issue Type: Sub-task (was: Task) Parent: HDFS-7240 > Ozone: Add a check to prevent removing

[jira] [Updated] (HDFS-11550) Ozone: Add a check to prevent removing a container that has keys in it

2017-03-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11550: --- Affects Version/s: HDFS-7240 > Ozone: Add a check to prevent removing a container that has keys in it

[jira] [Created] (HDFS-11550) Ozone: Add a check to prevent removing a container that has keys in it

2017-03-20 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11550: -- Summary: Ozone: Add a check to prevent removing a container that has keys in it Key: HDFS-11550 URL: https://issues.apache.org/jira/browse/HDFS-11550 Project: Hadoop

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933130#comment-15933130 ] Hadoop QA commented on HDFS-11170: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10629) Federation Router

2017-03-20 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10629: --- Attachment: HDFS-10629-HDFS-10467-010.patch Removing more references to RPC server and fixing

[jira] [Commented] (HDFS-11537) Block Storage : add cache layer

2017-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933100#comment-15933100 ] Hadoop QA commented on HDFS-11537: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11537) Block Storage : add cache layer

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933090#comment-15933090 ] Xiaoyu Yao commented on HDFS-11537: --- Thanks [~vagarychen] for updating the patch. +1 for v2 pending

[jira] [Updated] (HDFS-11537) Block Storage : add cache layer

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11537: -- Status: Patch Available (was: Open) > Block Storage : add cache layer >

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-03-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933076#comment-15933076 ] Surendra Singh Lilhore commented on HDFS-11163: --- Checkstyle warnings and test failures are

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933068#comment-15933068 ] Xiaoyu Yao commented on HDFS-11444: --- Thanks [~cheersyang] for addressing the review comments. +1 for

[jira] [Commented] (HDFS-11162) Block Storage : add command line tool

2017-03-20 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932675#comment-15932675 ] Mukul Kumar Singh commented on HDFS-11162: -- +1, For the patch > Block Storage : add command line

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932564#comment-15932564 ] SammiChen commented on HDFS-11170: -- Hi [~andrew.wang], do you mind take a look at the new uploaded patch?

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-04.patch > Add create API in filesystem public class to support assign parameter

[jira] [Updated] (HDFS-11549) Tool to migrate disk datanodes from one cluster to another

2017-03-20 Thread Kleber Povoacao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kleber Povoacao updated HDFS-11549: --- Description: Propose to create a tool to export/deattach hdfs disks from a

[jira] [Created] (HDFS-11549) Tool to migrate disk datanodes from one cluster to another

2017-03-20 Thread Kleber Povoacao (JIRA)
Kleber Povoacao created HDFS-11549: -- Summary: Tool to migrate disk datanodes from one cluster to another Key: HDFS-11549 URL: https://issues.apache.org/jira/browse/HDFS-11549 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932465#comment-15932465 ] Yiqun Lin edited comment on HDFS-11535 at 3/20/17 10:37 AM: Thanks [~szetszwo]

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11535: - Attachment: HDFS-11535.002.patch Thanks [~szetszwo] for sharing your thought! I agree on that the

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11444: --- Attachment: HDFS-11444-HDFS-7240.007.patch Fixed checkstyle issues introduced by this patch. >

[jira] [Updated] (HDFS-11540) PeerCache sync overhead

2017-03-20 Thread Ravikumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravikumar updated HDFS-11540: - Attachment: PeerCache.diff Please check the patch attached, based on trunk... Replaced blocking multimap

[jira] [Comment Edited] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932380#comment-15932380 ] Yuanbo Liu edited comment on HDFS-11492 at 3/20/17 9:32 AM: [~anu] Thanks for

[jira] [Commented] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932380#comment-15932380 ] Yuanbo Liu commented on HDFS-11492: --- [~anu] Thanks for your patch. Nice pattern to use dispatcher to