[jira] [Commented] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057029#comment-16057029 ] Kai Zheng commented on HDFS-11943: -- Thanks [~liaoyuxiangqin] for the update. 1. Please also check and do

[jira] [Updated] (HDFS-11933) Arguments check for ErasureCodingPolicy->composePolicyName

2017-06-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11933: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 Target

[jira] [Updated] (HDFS-11989) Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis

2017-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11989: --- Summary: Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis (was:

[jira] [Updated] (HDFS-11989) Ozone: add TestKeysRatis and TestBucketsRatis

2017-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11989: --- Attachment: HDFS-11989-HDFS-7240.20170621.patch HDFS-11989-HDFS-7240.20170621.patch:

[jira] [Updated] (HDFS-11933) Arguments check for ErasureCodingPolicy->composePolicyName

2017-06-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11933: - Summary: Arguments check for ErasureCodingPolicy->composePolicyName (was: The function composePolicyName

[jira] [Commented] (HDFS-11933) The function composePolicyName should judge arguments not NULL

2017-06-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057020#comment-16057020 ] Kai Zheng commented on HDFS-11933: -- It's good to have the check and added tests. +1. > The function

[jira] [Assigned] (HDFS-11933) The function composePolicyName should judge arguments not NULL

2017-06-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-11933: Assignee: lufei > The function composePolicyName should judge arguments not NULL >

[jira] [Commented] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057015#comment-16057015 ] Hadoop QA commented on HDFS-11493: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-20 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056971#comment-16056971 ] hu xiaodong commented on HDFS-11992: thanks [~ajisakaa], I will create a patch for branch-2 after

[jira] [Commented] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056951#comment-16056951 ] Hadoop QA commented on HDFS-11943: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056900#comment-16056900 ] Hudson commented on HDFS-11992: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11899 (See

[jira] [Updated] (HDFS-11983) Ozone: Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11983: - Summary: Ozone: Add documentation for metrics in KSMMetrics to OzoneMetrics.md (was: Add documentation

[jira] [Updated] (HDFS-11983) Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11983: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11963: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~anu] for the review.

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11963: - Fix Version/s: HDFS-7240 > Ozone: Documentation: Add getting started page >

[jira] [Updated] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11992: - Target Version/s: 2.9.0, 3.0.0-alpha4 Fix Version/s: 3.0.0-alpha4 Thanks! Committed this

[jira] [Commented] (HDFS-11933) The function composePolicyName should judge arguments not NULL

2017-06-20 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056862#comment-16056862 ] lufei commented on HDFS-11933: -- Hi [~drankye] ,Can you do me a faver to review this code. Thanks. > The

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056855#comment-16056855 ] Akira Ajisaka commented on HDFS-11992: -- +1, checking this in. > Replace commons-logging APIs with

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056845#comment-16056845 ] Yiqun Lin commented on HDFS-11998: -- Hi [~vagarychen], thanks for filing this. In the next patch, please

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Status: Patch Available (was: Open) > Warn log frequently print to screen in doEncode function

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Attachment: HDFS-11943.003.patch > Warn log frequently print to screen in doEncode function on

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Status: Open (was: Patch Available) > Warn log frequently print to screen in doEncode function

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Attachment: (was: HDFS-11943.003.patch) > Warn log frequently print to screen in doEncode

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Attachment: HDFS-11493-HDFS-7240.004.patch updated the patch to make sure all test failures are

[jira] [Commented] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056748#comment-16056748 ] Hadoop QA commented on HDFS-12002: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11125) [SPS]: Use smaller batches of BlockMovingInfo into the block storage movement command

2017-06-20 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056712#comment-16056712 ] Ewan Higgs commented on HDFS-11125: --- The Provided Storage system is looking to use the SPS for

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056705#comment-16056705 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fails because

[jira] [Updated] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11999: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-06-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056679#comment-16056679 ] Manoj Govindassamy commented on HDFS-11988: --- Above unit test failures are not related to the

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056668#comment-16056668 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fail seems related,

[jira] [Commented] (HDFS-12005) Ozone: Web interface for SCM

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056660#comment-16056660 ] Anu Engineer commented on HDFS-12005: - [~elek] Thanks for filing this JIRA. I am fine with any

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:15 PM: - Post initial

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056637#comment-16056637 ] Hadoop QA commented on HDFS-11998: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:06 PM: - Post initial

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Status: Patch Available (was: Open) > Ozone : SCM cli misc fixes/improvements >

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Attachment: HDFS-12002-HDFS-7240.001.patch Post initial patch. Thanks [~elek] for the comments! Added

[jira] [Created] (HDFS-12005) Ozone: Web interface for SCM

2017-06-20 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12005: --- Summary: Ozone: Web interface for SCM Key: HDFS-12005 URL: https://issues.apache.org/jira/browse/HDFS-12005 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056626#comment-16056626 ] Anu Engineer commented on HDFS-11999: - I will commit this shortly. There is a checkstyle warning issue

[jira] [Commented] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056618#comment-16056618 ] Hadoop QA commented on HDFS-11999: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056613#comment-16056613 ] Elek, Marton commented on HDFS-12002: - +1: I suggest to print out the exception message in case of any

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056600#comment-16056600 ] Manoj Govindassamy commented on HDFS-11881: --- Thanks for the review [~jojochuang]. bq. It looks

[jira] [Commented] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

2017-06-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056598#comment-16056598 ] Erik Krogen commented on HDFS-12004: Ping [~tanping], [~wheat9], [~jingzhao], [~szetszwo] who were

[jira] [Created] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

2017-06-20 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12004: -- Summary: Namenode UI continues to list DNs that have been removed from include and exclude Key: HDFS-12004 URL: https://issues.apache.org/jira/browse/HDFS-12004 Project:

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056592#comment-16056592 ] Hadoop QA commented on HDFS-10702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-06-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-11575: Status: Open (was: Patch Available) > Supporting HDFS NFS gateway with Federated

[jira] [Updated] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-06-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-11575: Status: Patch Available (was: Open) > Supporting HDFS NFS gateway with Federated

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c

[jira] [Assigned] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-06-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HDFS-10702: Assignee: Sean Mackrory (was: Jiayi Zhou) > Add a Client API and Proxy Provider to enable

[jira] [Commented] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056453#comment-16056453 ] Chen Liang commented on HDFS-11679: --- Thanks [~yuanbo] for working on this, v003 patch looks pretty good

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056447#comment-16056447 ] Wei-Chiu Chuang commented on HDFS-11881: So for example, {{Diff#insert}} uses ArrayList to store

[jira] [Created] (HDFS-12003) Ozone: Misc : Cleanup error messages

2017-06-20 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12003: --- Summary: Ozone: Misc : Cleanup error messages Key: HDFS-12003 URL: https://issues.apache.org/jira/browse/HDFS-12003 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11782: Component/s: (was: HDFS-7240) ozone > Ozone: KSM: Add listKey >

[jira] [Updated] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11873: Component/s: (was: HDFS-7240) ozone > Ozone: Object store handler cannot serve

[jira] [Updated] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8457: --- Component/s: ozone > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into >

[jira] [Updated] (HDFS-8392) DataNode support for multiple datasets

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8392: --- Component/s: ozone > DataNode support for multiple datasets > -- >

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056424#comment-16056424 ] Wei-Chiu Chuang commented on HDFS-11881: I am not sure if it's necessary to add new tests. It

[jira] [Updated] (HDFS-11970) Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11970: Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > Ozone:

[jira] [Comment Edited] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056397#comment-16056397 ] Anu Engineer edited comment on HDFS-11991 at 6/20/17 8:26 PM: -- [~cheersyang]

[jira] [Comment Edited] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056397#comment-16056397 ] Anu Engineer edited comment on HDFS-11991 at 6/20/17 8:22 PM: -- [~cheersyang]

[jira] [Comment Edited] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056397#comment-16056397 ] Anu Engineer edited comment on HDFS-11991 at 6/20/17 8:21 PM: -- [~cheersyang]

[jira] [Comment Edited] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056397#comment-16056397 ] Anu Engineer edited comment on HDFS-11991 at 6/20/17 8:21 PM: -- [~cheersyang]

[jira] [Commented] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056397#comment-16056397 ] Anu Engineer commented on HDFS-11991: - [~cheersyang] Let us talk when you are back from vacation.

[jira] [Commented] (HDFS-11983) Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056380#comment-16056380 ] Anu Engineer commented on HDFS-11983: - +1, I am going to let you commit since you have the

[jira] [Updated] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11999: Attachment: HDFS-11999-HDFS-7240.001.patch Renaming the patch into format that is needed by Jenkins

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Attachment: HDFS-11998.001.patch Post initial patch to set the config value to true by default. >

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Status: Patch Available (was: Open) > Enable DFSNetworkTopology as default >

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056351#comment-16056351 ] Wei-Chiu Chuang commented on HDFS-11881: Ah never mind... I saw your comment. > NameNode consumes

[jira] [Created] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12002: - Summary: Ozone : SCM cli misc fixes/improvements Key: HDFS-12002 URL: https://issues.apache.org/jira/browse/HDFS-12002 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11971) libhdfs++: A few portability issues

2017-06-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11971: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: A few

[jira] [Commented] (HDFS-11971) libhdfs++: A few portability issues

2017-06-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056313#comment-16056313 ] James Clampffer commented on HDFS-11971: Thanks for the explanation and the extra fix for install

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056311#comment-16056311 ] Hudson commented on HDFS-11647: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11897 (See

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11647: - Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11518) libhdfs++: Add a build option to skip building examples, tests, and tools

2017-06-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11518: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Add a build

[jira] [Commented] (HDFS-11518) libhdfs++: Add a build option to skip building examples, tests, and tools

2017-06-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056269#comment-16056269 ] James Clampffer commented on HDFS-11518: +1, Thanks contributing the patch and including followup

[jira] [Updated] (HDFS-11585) Ozone: Support force update a container

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11585: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11585) Ozone: Support force update a container

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056202#comment-16056202 ] Anu Engineer commented on HDFS-11585: - +1, I will commit this shortly. One small nit: In the tests we

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056188#comment-16056188 ] Anu Engineer commented on HDFS-11963: - +1, please feel free to commit. > Ozone: Documentation: Add

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Fix Version/s: 2.8.2 3.0.0-alpha4 2.9.0 > Successfully closed

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056111#comment-16056111 ] Kihwal Lee commented on HDFS-11960: --- HDFS-9754 was needed for the test. Cherry-picked HDFS-9754 and this

[jira] [Updated] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9754: - Fix Version/s: 2.8.2 > Avoid unnecessary getBlockCollection calls in BlockManager >

[jira] [Commented] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056107#comment-16056107 ] Kihwal Lee commented on HDFS-9754: -- Cherry-picked to branch-2.8. > Avoid unnecessary getBlockCollection

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056091#comment-16056091 ] Wei-Chiu Chuang commented on HDFS-11881: Hi Manoj, thanks for working on this patch. Good finding

[jira] [Commented] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc

2017-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056085#comment-16056085 ] Hudson commented on HDFS-11978: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11896 (See

[jira] [Updated] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11978: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Updated] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11978: --- Summary: Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies'

[jira] [Commented] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs'

2017-06-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056047#comment-16056047 ] Wei-Chiu Chuang commented on HDFS-11978: No, you are good. I will commit the patch shortly. >

[jira] [Updated] (HDFS-11575) Supporting HDFS NFS gateway with Federated HDFS

2017-06-20 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11575: - Attachment: HDFS-11575.007.patch > Supporting HDFS NFS gateway with Federated HDFS >

[jira] [Commented] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-06-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055871#comment-16055871 ] Erik Krogen commented on HDFS-11345: Thanks [~ajisakaa]! > Document the configuration key for

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055866#comment-16055866 ] Hudson commented on HDFS-11960: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11894 (See

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055843#comment-16055843 ] Kihwal Lee commented on HDFS-11960: --- Thanks for the review, Daryn. I've committed this to trunk and

[jira] [Commented] (HDFS-11989) Ozone: add TestKeysRatis and TestBucketsRatis

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055820#comment-16055820 ] Hadoop QA commented on HDFS-11989: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055768#comment-16055768 ] Daryn Sharp commented on HDFS-11960: +1 Looks good. It's great to have finally solved this vexing

[jira] [Commented] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055705#comment-16055705 ] Hadoop QA commented on HDFS-11943: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055695#comment-16055695 ] Hadoop QA commented on HDFS-11992: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11989) Ozone: add TestKeysRatis and TestBucketsRatis

2017-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11989: --- Summary: Ozone: add TestKeysRatis and TestBucketsRatis (was: Ozone: add TestKeys

[jira] [Updated] (HDFS-11989) Ozone: add TestKeys with Ratis

2017-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11989: --- Attachment: HDFS-11989-HDFS-7240.20170620c.patch

[jira] [Commented] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055621#comment-16055621 ] liaoyuxiangqin commented on HDFS-11943: --- Thanks for your review and suggestions on this patch

[jira] [Updated] (HDFS-11943) Warn log frequently print to screen in doEncode function on AbstractNativeRawEncoder class

2017-06-20 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-11943: -- Attachment: HDFS-11943.003.patch > Warn log frequently print to screen in doEncode function on

  1   2   >