[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686177#comment-16686177 ] Jiandan Yang commented on HDFS-13915: -- I add a case in [^HDFS-13915.001.patch] based on trunk to

[jira] [Commented] (HDDS-774) Remove OpenContainerBlockMap from datanode

2018-11-13 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686174#comment-16686174 ] Jitendra Nath Pandey commented on HDDS-774: --- +1 for the patch. > Remove OpenContainerBlockMap

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2018-11-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686147#comment-16686147 ] Weiwei Yang commented on HDFS-6874: --- Hi [~elgoiri] The changes in webHdfsFileSystem was for the

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686140#comment-16686140 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:49 AM: There are

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686140#comment-16686140 ] Jiandan Yang commented on HDFS-14045: -- There are many "[ERROR] Error occurred in starting fork,

[jira] [Created] (HDFS-14076) NameNodeResourceChecker#isResourceAvailable() should check the linux filesystem inode usage.

2018-11-13 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-14076: - Summary: NameNodeResourceChecker#isResourceAvailable() should check the linux filesystem inode usage. Key: HDFS-14076 URL:

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.010.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686136#comment-16686136 ] Hadoop QA commented on HDFS-14045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:41 AM: Thanks

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:38 AM: Thanks

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang commented on HDFS-14045: -- Thanks [~elgoiri] for you comments. {quota}

[jira] [Updated] (HDFS-14075) NPE while Edit Logging

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14075: Priority: Critical (was: Major) > NPE while Edit Logging > -- > >

[jira] [Commented] (HDFS-14075) NPE while Edit Logging

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686126#comment-16686126 ] Ayush Saxena commented on HDFS-14075: - Solution :: dfs.namenode.edits.dir.minimum configuration

[jira] [Updated] (HDFS-14075) NPE while Edit Logging (Minimum Redundant Count )

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14075: Summary: NPE while Edit Logging (Minimum Redundant Count ) (was: NPE while Edit Logging ) > NPE

[jira] [Updated] (HDFS-14075) NPE while Edit Logging

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14075: Summary: NPE while Edit Logging (was: NPE while Edit Logging (Minimum Redundant Count )) > NPE

[jira] [Created] (HDFS-14075) NPE while Edit Logging

2018-11-13 Thread Ayush Saxena (JIRA)
Ayush Saxena created HDFS-14075: --- Summary: NPE while Edit Logging Key: HDFS-14075 URL: https://issues.apache.org/jira/browse/HDFS-14075 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDDS-813) [JDK11] mvn javadoc:javadoc -Phdds fails

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686119#comment-16686119 ] Hadoop QA commented on HDDS-813: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-801) Quasi close the container when close is not executed via Ratis

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686120#comment-16686120 ] Hadoop QA commented on HDDS-801: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-801) Quasi close the container when close is not executed via Ratis

2018-11-13 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-801: - Status: Patch Available (was: In Progress) > Quasi close the container when close is not executed via

[jira] [Updated] (HDDS-801) Quasi close the container when close is not executed via Ratis

2018-11-13 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-801: - Attachment: HDDS-801.001.patch > Quasi close the container when close is not executed via Ratis >

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686105#comment-16686105 ] Hadoop QA commented on HDDS-836: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-813) [JDK11] mvn javadoc:javadoc -Phdds fails

2018-11-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-813: --- Labels: javadoc (was: ) > [JDK11] mvn javadoc:javadoc -Phdds fails >

[jira] [Updated] (HDDS-813) [JDK11] mvn javadoc:javadoc -Phdds fails

2018-11-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-813: --- Summary: [JDK11] mvn javadoc:javadoc -Phdds fails (was: [JDK11] mvn javadoc:javadoc fails) >

[jira] [Updated] (HDDS-813) [JDK11] mvn javadoc:javadoc fails

2018-11-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-813: --- Attachment: HDDS-813.001.patch Status: Patch Available (was: Open) [~ajisakaa] san -

[jira] [Commented] (HDDS-816) Create OM metrics for bucket, volume, keys

2018-11-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686088#comment-16686088 ] Bharat Viswanadham commented on HDDS-816: - I have attached a proposal approach, and I am currently

[jira] [Updated] (HDDS-816) Create OM metrics for bucket, volume, keys

2018-11-13 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-816: Attachment: Proposed Approach.pdf > Create OM metrics for bucket, volume, keys >

[jira] [Commented] (HDDS-813) [JDK11] mvn javadoc:javadoc fails

2018-11-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686083#comment-16686083 ] Akira Ajisaka commented on HDDS-813: [~ljain], this issue is not fixed in hadoop-hdds-common module.

[jira] [Commented] (HDDS-813) [JDK11] mvn javadoc:javadoc fails

2018-11-13 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686072#comment-16686072 ] Lokesh Jain commented on HDDS-813: -- [~dineshchitlangia] I think the issue has already been fixed by

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686055#comment-16686055 ] Ajay Kumar commented on HDDS-836: - [~xyao] thanks for review. patch v1 to address comments and jenkins

[jira] [Updated] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-836: Attachment: HDDS-836-HDDS-4.01.patch > Create Ozone identifier for delegation token and block token >

[jira] [Updated] (HDFS-14064) WEBHDFS: Support Enable/Disable EC Policy

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14064: Attachment: HDFS-14064-04.patch > WEBHDFS: Support Enable/Disable EC Policy >

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686028#comment-16686028 ] Hadoop QA commented on HDFS-14035: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14069) Better debuggability for datanode decommissioning

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686025#comment-16686025 ] Hadoop QA commented on HDFS-14069: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

2018-11-13 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.009.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685997#comment-16685997 ] Hadoop QA commented on HDFS-14017: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685993#comment-16685993 ] Hadoop QA commented on HDDS-836: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685992#comment-16685992 ] Konstantin Shvachko commented on HDFS-14067: OK sounds like changing server side is too much

[jira] [Commented] (HDDS-8) Add OzoneManager Delegation Token support

2018-11-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685983#comment-16685983 ] Xiaoyu Yao commented on HDDS-8: --- [~jnp], AbstractDelegationTokenSecretManager has assumption on using symmetric

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685976#comment-16685976 ] Xiaoyu Yao commented on HDDS-836: - Thanks [~ajayydv] for the patch. It looks good to me overall. Just have

[jira] [Comment Edited] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685962#comment-16685962 ] Konstantin Shvachko edited comment on HDFS-14017 at 11/14/18 1:06 AM:

[jira] [Comment Edited] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685962#comment-16685962 ] Konstantin Shvachko edited comment on HDFS-14017 at 11/14/18 1:06 AM:

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685962#comment-16685962 ] Konstantin Shvachko commented on HDFS-14017: For the record, my assumptions in the comment

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685956#comment-16685956 ] Chao Sun commented on HDFS-14067: - bq. Chao, I was going to say that the .000 patch only fixes client and

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685954#comment-16685954 ] Chen Liang commented on HDFS-14035: --- Somehow missed Erik's comment, the suppress warning is not needed

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.016.patch > NN status discovery does not leverage delegation token >

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: (was: HDFS-14035-HDFS-12943.016.patch) > NN status discovery does not leverage

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.016.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDDS-8) Add OzoneManager Delegation Token support

2018-11-13 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685943#comment-16685943 ] Jitendra Nath Pandey commented on HDDS-8: - # Did you consider {{OzoneSecretManager}} extending 

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685933#comment-16685933 ] Konstantin Shvachko commented on HDFS-14067: ??if we manually transition a standby to

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685930#comment-16685930 ] Plamen Jeliazkov commented on HDFS-14067: - Thanks [~csun] and [~xkrogen], I understand better

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685920#comment-16685920 ] Ajay Kumar commented on HDDS-836: - cc: [~xyao] > Create Ozone identifier for delegation token and block

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685924#comment-16685924 ] Hadoop QA commented on HDFS-14035: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-836: Status: Patch Available (was: Open) > Create Ozone identifier for delegation token and block token >

[jira] [Commented] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685917#comment-16685917 ] Hadoop QA commented on HDFS-14015: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685912#comment-16685912 ] Konstantin Shvachko commented on HDFS-14067: ??we are already calling {{HAServiceProtocol}}

[jira] [Updated] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-836: Attachment: HDDS-836-HDDS-4.00.patch > Create Ozone identifier for delegation token and block token >

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685910#comment-16685910 ] Chao Sun commented on HDFS-14067: - [~zero45] observer state is not currently an extension of standby,

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685901#comment-16685901 ] Erik Krogen commented on HDFS-14067: {quote} In our case, I do see some potential inconsistency.

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685894#comment-16685894 ] Plamen Jeliazkov commented on HDFS-14067: - Hey guys, Just want to throw in my thoughts here

[jira] [Updated] (HDFS-14069) Better debuggability for datanode decommissioning

2018-11-13 Thread Danny Becker (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Becker updated HDFS-14069: Attachment: HDFS-14069.001.patch > Better debuggability for datanode decommissioning >

[jira] [Updated] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-11-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-14015: Attachment: HDFS-14015.010.patch > Improve error handling in hdfsThreadDestructor in

[jira] [Updated] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-836: Description: Create Ozone identifier for delegation token and block token. (was: Add delegation token

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685870#comment-16685870 ] Chao Sun commented on HDFS-14067: - Thanks for the clarification [~xkrogen]. I think the check was

[jira] [Commented] (HDFS-14064) WEBHDFS: Support Enable/Disable EC Policy

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685869#comment-16685869 ] Hadoop QA commented on HDFS-14064: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDDS-836: --- Summary: Create Ozone identifier for delegation token and block token Key: HDDS-836 URL: https://issues.apache.org/jira/browse/HDDS-836 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685861#comment-16685861 ] Hadoop QA commented on HDFS-14017: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-14067: Comment: was deleted (was: Thanks for the clarification [~xkrogen]. I think the check was introduced

[jira] [Commented] (HDDS-816) Create OM metrics for bucket, volume, keys

2018-11-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685843#comment-16685843 ] Arpit Agarwal commented on HDDS-816: bq. 2. Independent from the selected approach I hope that it can

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685842#comment-16685842 ] Chen Liang commented on HDFS-14035: --- Thanks for the review [~csun], fixing check style with v015 patch.

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.015.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDFS-14067) Allow manual failover between standby and observer

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685840#comment-16685840 ] Chao Sun commented on HDFS-14067: - Thanks for the clarification [~xkrogen]. I think the check was

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685811#comment-16685811 ] Chen Liang commented on HDFS-14017: --- Thanks for the the detailed suggestions and post sharing

[jira] [Updated] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14017: -- Attachment: HDFS-14017-HDFS-12943.010.patch > ObserverReadProxyProviderWithIPFailover should work with

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685772#comment-16685772 ] Chao Sun commented on HDFS-14035: - LGTM too. Some minor nits though: 1. there's an unused import in

[jira] [Commented] (HDDS-835) Use storageSize instead of Long for buffer size configs in Ozone Client

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685749#comment-16685749 ] Hadoop QA commented on HDDS-835: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13972) RBF: Support for Delegation Token (WebHDFS)

2018-11-13 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685741#comment-16685741 ] CR Hota commented on HDFS-13972: [~elgoiri] [~brahmareddy] Could you help rebase HDFS-13891 branch with

[jira] [Commented] (HDDS-816) Create OM metrics for bucket, volume, keys

2018-11-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685740#comment-16685740 ] Arpit Agarwal commented on HDDS-816: Approach #4 (traverse all keys) cannot work in practice. It may

[jira] [Commented] (HDFS-14006) RBF: Support to get Router object from web context instead of Namenode

2018-11-13 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685736#comment-16685736 ] CR Hota commented on HDFS-14006: [~elgoiri] Agree with you. Definitely reusability is something we will

[jira] [Commented] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

2018-11-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685726#comment-16685726 ] Hudson commented on HDFS-13732: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15421 (See

[jira] [Reopened] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

2018-11-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-13732: -- > ECAdmin should print the policy name when an EC policy is set >

[jira] [Commented] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

2018-11-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685731#comment-16685731 ] Xiao Chen commented on HDFS-13732: -- Also ping [~arpitagarwal] as an FYI since you helped on backporting.

[jira] [Updated] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

2018-11-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13732: - Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) Fix Version/s: (was: 3.1.2) See

[jira] [Commented] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

2018-11-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685723#comment-16685723 ] Xiao Chen commented on HDFS-13998: -- bq. admin commands. -setPolicy is _not_ an admin command. Users who

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685715#comment-16685715 ] Hadoop QA commented on HDFS-14035: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-774) Remove OpenContainerBlockMap from datanode

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685699#comment-16685699 ] Hadoop QA commented on HDDS-774: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685679#comment-16685679 ] Erik Krogen commented on HDFS-14035: v014 patch LGTM. Is the {{MagicConstant}} warning that you

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-13 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685665#comment-16685665 ] Dinesh Chitlangia commented on HDDS-120: mvninstall and test failures are unrelated to the patch.  

[jira] [Commented] (HDFS-14006) RBF: Support to get Router object from web context instead of Namenode

2018-11-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685633#comment-16685633 ] Íñigo Goiri commented on HDFS-14006: Eventually we may want to take some of JspHelper and make it

[jira] [Commented] (HDDS-834) Datanode goes OOM based because of segment size

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685621#comment-16685621 ] Hadoop QA commented on HDDS-834: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685620#comment-16685620 ] Chen Liang commented on HDFS-14035: --- Discussed with [~xkrogen] offline, seems we can also resolve race

[jira] [Updated] (HDDS-835) Use storageSize instead of Long for buffer size configs in Ozone Client

2018-11-13 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-835: - Description: As per [~msingh] review comments in HDDS-675 , for streamBufferFlushSize,

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.014.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDDS-835) Use storageSize instead of Long for buffer size configs in Ozone Client

2018-11-13 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685617#comment-16685617 ] Shashikant Banerjee commented on HDDS-835: -- [~msingh], please have a look. > Use storageSize

[jira] [Updated] (HDDS-835) Use storageSize instead of Long for buffer size configs in Ozone Client

2018-11-13 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-835: - Attachment: HDDS-835.000.patch > Use storageSize instead of Long for buffer size configs

[jira] [Updated] (HDDS-835) Use storageSize instead of Long for buffer size configs in Ozone Client

2018-11-13 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-835: - Status: Patch Available (was: Open) > Use storageSize instead of Long for buffer size

[jira] [Commented] (HDFS-14006) RBF: Support to get Router object from web context instead of Namenode

2018-11-13 Thread CR Hota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685614#comment-16685614 ] CR Hota commented on HDFS-14006: [~elgoiri]  [~brahmareddy] For this refactoring, after the analysis I

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685609#comment-16685609 ] Hadoop QA commented on HDDS-120: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14064) WEBHDFS: Support Enable/Disable EC Policy

2018-11-13 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14064: Attachment: HDFS-14064-04.patch > WEBHDFS: Support Enable/Disable EC Policy >

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685603#comment-16685603 ] Erik Krogen commented on HDFS-14017: Hey [~vagarychen], v009 patch LGTM as long as we have a

[jira] [Updated] (HDDS-774) Remove OpenContainerBlockMap from datanode

2018-11-13 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-774: - Status: Patch Available (was: Open) > Remove OpenContainerBlockMap from datanode >

  1   2   >