[GitHub] [hadoop-ozone] esahekmat edited a comment on pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-06-11 Thread GitBox
esahekmat edited a comment on pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#issuecomment-643073937 I agree the change can be postponed until the version support implementation, however storing different version in a heterogeneous List, and filter it for

[GitHub] [hadoop-ozone] esahekmat commented on pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-06-11 Thread GitBox
esahekmat commented on pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#issuecomment-643073937 I agree the change can be postponed until the version support implementation, however storing different version in a heterogeneous List, and filter it for specific

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1054: Hdds 3772. Add LOG to S3ErrorTable for easier problem locating.

2020-06-11 Thread GitBox
bharatviswa504 commented on a change in pull request #1054: URL: https://github.com/apache/hadoop-ozone/pull/1054#discussion_r439211764 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/exception/S3ErrorTable.java ## @@ -106,6 +111,7 @@ public

[jira] [Commented] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133932#comment-17133932 ] Bharat Viswanadham commented on HDDS-3765: -- Just trying to understand is this fluentd issue, or

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1054: Hdds 3772. Add LOG to S3ErrorTable for easier problem locating.

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #1054: URL: https://github.com/apache/hadoop-ozone/pull/1054#issuecomment-642411148 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1054?src=pr=h1) Report > Merging

[jira] [Updated] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3765: - Affects Version/s: (was: 0.6.0) 0.5.0 > Fluentd writing to

[jira] [Updated] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3765: - Target Version/s: 0.6.0 (was: 0.7.0) > Fluentd writing to secure Ozone S3 API fails with

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1066: HDDS-3770. Improve getPipelines performance

2020-06-11 Thread GitBox
codecov-commenter commented on pull request #1066: URL: https://github.com/apache/hadoop-ozone/pull/1066#issuecomment-643062826 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1066?src=pr=h1) Report > Merging

[jira] [Assigned] (HDDS-3610) Test Recon works with MySQL and Postgres

2020-06-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3610: --- Assignee: Aravindan Vijayan > Test Recon works with MySQL and Postgres >

[jira] [Assigned] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3765: --- Assignee: Aravindan Vijayan > Fluentd writing to secure Ozone S3 API fails with 500

[jira] [Updated] (HDDS-3787) Make CSI command configurable.

2020-06-11 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3787: - Description: It doesn't have to use goofys as the mountable tools to access Ozone BTW. It would be

[jira] [Created] (HDDS-3787) Make CSI command configurable.

2020-06-11 Thread maobaolong (Jira)
maobaolong created HDDS-3787: Summary: Make CSI command configurable. Key: HDDS-3787 URL: https://issues.apache.org/jira/browse/HDDS-3787 Project: Hadoop Distributed Data Store Issue Type:

[GitHub] [hadoop-ozone] captainzmc commented on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-06-11 Thread GitBox
captainzmc commented on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-643052684 Status updates: This PR can continue to be reviewed. In addition, batch Rename will also implement in the same way as this PR.

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
timmylicheng commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439189923 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -310,102 +315,69 @@

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
timmylicheng commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439189989 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -420,10 +392,50 @@

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1054: Hdds 3772. Add LOG to S3ErrorTable for easier problem locating.

2020-06-11 Thread GitBox
ChenSammi commented on a change in pull request #1054: URL: https://github.com/apache/hadoop-ozone/pull/1054#discussion_r439177427 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/exception/S3ErrorTable.java ## @@ -29,6 +31,9 @@ */ public final

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#issuecomment-643027469 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1065?src=pr=h1) Report > Merging

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-11 Thread GitBox
codecov-commenter commented on pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#issuecomment-643027469 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1065?src=pr=h1) Report > Merging

[jira] [Commented] (HDDS-3669) SCM Infinite loop in BlockManagerImpl.allocateBlock

2020-06-11 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133837#comment-17133837 ] maobaolong commented on HDDS-3669: -- [~nanda] Sorry, i don't keep the full log, if you think the solution

[jira] [Updated] (HDDS-3770) Improve getPipelines performance

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3770: - Labels: pull-request-available (was: ) > Improve getPipelines performance >

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #1066: HDDS-3770. Improve getPipelines performance

2020-06-11 Thread GitBox
runzhiwang opened a new pull request #1066: URL: https://github.com/apache/hadoop-ozone/pull/1066 ## What changes were proposed in this pull request? 1. getPipelines is in the critical path of allocateBlock, and discardPipeline is the hot spot in getPipelines. 2. Change `List` to

[jira] [Updated] (HDDS-3680) Add a retry to the scm allocateblock process

2020-06-11 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3680: - Attachment: screenshot-1.png > Add a retry to the scm allocateblock process >

[jira] [Commented] (HDDS-3680) Add a retry to the scm allocateblock process

2020-06-11 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133831#comment-17133831 ] maobaolong commented on HDDS-3680: -- [~arp] Not sure if the master branch will met my failure, i met my

[jira] [Assigned] (HDDS-3680) Add a retry to the scm allocateblock process

2020-06-11 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong reassigned HDDS-3680: Assignee: maobaolong > Add a retry to the scm allocateblock process >

[jira] [Updated] (HDDS-3770) Improve getPipelines performance

2020-06-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3770: - Summary: Improve getPipelines performance (was: Improve discardPipeline performance) > Improve

[GitHub] [hadoop-ozone] runzhiwang commented on pull request #1053: HDDS-3737. Avoid serialization between UUID and String

2020-06-11 Thread GitBox
runzhiwang commented on pull request #1053: URL: https://github.com/apache/hadoop-ozone/pull/1053#issuecomment-643017217 @elek @xiaoyuyao Could you help review this patch ? Thank you very much. This is an automated message

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1053: [WIP]HDDS-3737. Avoid serialization between UUID and String

2020-06-11 Thread GitBox
codecov-commenter commented on pull request #1053: URL: https://github.com/apache/hadoop-ozone/pull/1053#issuecomment-643015878 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1053?src=pr=h1) Report > Merging

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1064: HDDS-3769. hadoop-hdds interface-client fail to build with JDK11.

2020-06-11 Thread GitBox
codecov-commenter commented on pull request #1064: URL: https://github.com/apache/hadoop-ozone/pull/1064#issuecomment-643013385 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1064?src=pr=h1) Report > Merging

[jira] [Updated] (HDDS-3777) Reduce recon UI build time

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3777: - Labels: pull-request-available (was: ) > Reduce recon UI build time > --

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-11 Thread GitBox
vivekratnavel opened a new pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065 ## What changes were proposed in this pull request? - Replace yarn as the default package manager to pnpm - Replace -Dskip.yarn flag with -Dskip.npx - Use caching in Github

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1044: HDDS-3743. Avoid NetUtils#normalize when get DatanodeDetails from proto

2020-06-11 Thread GitBox
runzhiwang commented on a change in pull request #1044: URL: https://github.com/apache/hadoop-ozone/pull/1044#discussion_r439151595 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/net/NetUtils.java ## @@ -59,9 +64,12 @@ public static String

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-06-11 Thread GitBox
xiaoyuyao commented on pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#issuecomment-643004950 I agree the structure pass over the wire does not change with this PR. However, given the version support is not fully added, we should have only limited(one) version

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1044: HDDS-3743. Avoid NetUtils#normalize when get DatanodeDetails from proto

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1044: URL: https://github.com/apache/hadoop-ozone/pull/1044#discussion_r439149023 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/net/NetUtils.java ## @@ -59,9 +64,12 @@ public static String

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
bharatviswa504 commented on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642999728 > @elek @nandakumar131 @bharatviswa504 Hi, Thanks for review. The problem of getServiceInfo is that it contains all the datanodes' information which cost too much

[GitHub] [hadoop-ozone] runzhiwang commented on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
runzhiwang commented on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642997309 @xiaoyuyao Thanks for explanation, I agree and I will clean that up. This is an automated message

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
xiaoyuyao commented on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642991229 @runzhiwang the reason the serviceinfo request retrieve all the DNs is for the DN REST service address. After the Ozone REST support was removed a while back, those

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439130260 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -310,102 +315,69 @@

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439132746 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -420,10 +392,50 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439132593 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -310,102 +315,69 @@

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439132303 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -420,10 +392,50 @@ public

[jira] [Commented] (HDDS-3786) Tone down failover message

2020-06-11 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133790#comment-17133790 ] Wei-Chiu Chuang commented on HDDS-3786: --- (It shouldn't go without saying that this is an OM HA

[GitHub] [hadoop-ozone] runzhiwang edited a comment on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
runzhiwang edited a comment on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642985694 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop-ozone] runzhiwang edited a comment on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
runzhiwang edited a comment on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642985694 @nandakumar131 @bharatviswa504 Hi, the problem of getServiceInfo is that it contains all the datanodes' information which cost too much if the cluster is big.

[GitHub] [hadoop-ozone] runzhiwang commented on pull request #1031: HDDS-3745. Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-11 Thread GitBox
runzhiwang commented on pull request #1031: URL: https://github.com/apache/hadoop-ozone/pull/1031#issuecomment-642985694 @nandakumar131 @bharatviswa504 Hi, the problem of getServiceInfo is that it include all the datanodes' information.

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1049: HDDS-3662 Decouple finalizeAndDestroyPipeline.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1049: URL: https://github.com/apache/hadoop-ozone/pull/1049#discussion_r439130260 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -310,102 +315,69 @@

[jira] [Created] (HDDS-3786) Tone down failover message

2020-06-11 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-3786: - Summary: Tone down failover message Key: HDDS-3786 URL: https://issues.apache.org/jira/browse/HDDS-3786 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Assigned] (HDDS-3769) hadoop-hdds interface-client fail to build with JDK11

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-3769: Assignee: Xiaoyu Yao > hadoop-hdds interface-client fail to build with JDK11 >

[jira] [Updated] (HDDS-3769) hadoop-hdds interface-client fail to build with JDK11

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3769: - Labels: pull-request-available (was: ) > hadoop-hdds interface-client fail to build with JDK11 >

[GitHub] [hadoop-ozone] xiaoyuyao opened a new pull request #1064: HDDS-3769. hadoop-hdds interface-client fail to build with JDK11.

2020-06-11 Thread GitBox
xiaoyuyao opened a new pull request #1064: URL: https://github.com/apache/hadoop-ozone/pull/1064 ## What changes were proposed in this pull request? Fix build issue with JDK11. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-3769

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #164: URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r439123407 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneVolume.java ## @@ -103,21 +106,52 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #164: URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r439123458 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneVolume.java ## @@ -103,21 +106,52 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #164: URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r439123184 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneBucket.java ## @@ -166,6 +188,25 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #164: URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r439123061 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneBucket.java ## @@ -144,6 +150,22 @@ public

[jira] [Updated] (HDDS-2052) Separate the metadata directories to store security certificates and keys for different services

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2052: - Labels: Triage (was: TriagePending) > Separate the metadata directories to store security certificates

[jira] [Updated] (HDDS-2052) Separate the metadata directories to store security certificates and keys for different services

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2052: - Target Version/s: 0.7.0 (was: 0.6.0) > Separate the metadata directories to store security certificates

[jira] [Commented] (HDDS-1976) Ozone manager init fails when certificate is missing in a kerberized cluster

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133727#comment-17133727 ] Xiaoyu Yao commented on HDDS-1976: -- This is a intentional design to handler recovery of OM more seriously

[jira] [Resolved] (HDDS-2951) Improve usability issues of ozone.administrators

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2951. -- Fix Version/s: 0.6.0 Resolution: Fixed > Improve usability issues of ozone.administrators >

[jira] [Updated] (HDDS-2951) Improve usability issues of ozone.administrators

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2951: - Labels: Triaged (was: TriagePending) > Improve usability issues of ozone.administrators >

[jira] [Updated] (HDDS-2954) Support admin group

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2954: - Parent: (was: HDDS-2951) Issue Type: New Feature (was: Sub-task) > Support admin group >

[jira] [Updated] (HDDS-2954) Support admin group

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2954: - Summary: Support admin group (was: Support admin user and admin user group) > Support admin group >

[jira] [Created] (HDDS-3785) Update topology.aware.read parameter in ozone-topology compose config

2020-06-11 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-3785: --- Summary: Update topology.aware.read parameter in ozone-topology compose config Key: HDDS-3785 URL: https://issues.apache.org/jira/browse/HDDS-3785 Project:

[jira] [Updated] (HDDS-2993) KeyManagerImpl#getFileStatus shouldn't always return null for permission, owner and group

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2993: - Target Version/s: 0.7.0 (was: 0.6.0) > KeyManagerImpl#getFileStatus shouldn't always return null for

[jira] [Commented] (HDDS-2993) KeyManagerImpl#getFileStatus shouldn't always return null for permission, owner and group

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133675#comment-17133675 ] Xiaoyu Yao commented on HDDS-2993: -- Ozone internally does not track owner/group at per key level. Move to

[jira] [Commented] (HDDS-2697) SCM log is flooded with block deletion txId mismatch messages

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133670#comment-17133670 ] Nanda kumar commented on HDDS-2697: --- [~pifta], are you planning on fixing this for 0.6.0? > SCM log is

[jira] [Commented] (HDDS-3669) SCM Infinite loop in BlockManagerImpl.allocateBlock

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133665#comment-17133665 ] Nanda kumar commented on HDDS-3669: --- [~maobaolong] The proposed solution looks good. We don't need the

[jira] [Commented] (HDDS-1765) destroyPipeline scheduled from finalizeAndDestroyPipeline fails for short dead node interval

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133655#comment-17133655 ] Nanda kumar commented on HDDS-1765: --- This is not causing any issue other than logging an error message.

[jira] [Updated] (HDDS-1765) destroyPipeline scheduled from finalizeAndDestroyPipeline fails for short dead node interval

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1765: -- Target Version/s: 0.7.0 (was: 0.6.0) > destroyPipeline scheduled from finalizeAndDestroyPipeline fails

[jira] [Updated] (HDDS-2819) Timeout threshold is too small to exit Safemode when security enabled

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2819: -- Labels: pull-request-available (was: Triaged pull-request-available) > Timeout threshold is too small

[jira] [Updated] (HDDS-2819) Timeout threshold is too small to exit Safemode when security enabled

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2819: -- Target Version/s: 0.7.0 (was: 0.6.0) > Timeout threshold is too small to exit Safemode when security

[jira] [Commented] (HDDS-2819) Timeout threshold is too small to exit Safemode when security enabled

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133652#comment-17133652 ] Nanda kumar commented on HDDS-2819: --- [~runzhiwang], is this issue still valid? I see that the PR is also

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #986: HDDS-3476. Use persisted transaction info during OM startup in OM StateMachine.

2020-06-11 Thread GitBox
bharatviswa504 commented on pull request #986: URL: https://github.com/apache/hadoop-ozone/pull/986#issuecomment-642900989 Thank You @hanishakoneru for the review. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #986: HDDS-3476. Use persisted transaction info during OM startup in OM StateMachine.

2020-06-11 Thread GitBox
bharatviswa504 merged pull request #986: URL: https://github.com/apache/hadoop-ozone/pull/986 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HDDS-3317) replication manager failing to re-replicate under replicated containers

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3317: -- Labels: (was: TriagePending) > replication manager failing to re-replicate under replicated

[jira] [Resolved] (HDDS-3317) replication manager failing to re-replicate under replicated containers

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar resolved HDDS-3317. --- Resolution: Duplicate > replication manager failing to re-replicate under replicated containers >

[jira] [Commented] (HDDS-3317) replication manager failing to re-replicate under replicated containers

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133647#comment-17133647 ] Nanda kumar commented on HDDS-3317: --- There are a couple of issues here. 1. Container state is reported

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #986: HDDS-3476. Use persisted transaction info during OM startup in OM StateMachine.

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #986: URL: https://github.com/apache/hadoop-ozone/pull/986#issuecomment-642271726 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/986?src=pr=h1) Report > Merging

[jira] [Assigned] (HDDS-3317) replication manager failing to re-replicate under replicated containers

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-3317: - Assignee: Nanda kumar > replication manager failing to re-replicate under replicated containers

[jira] [Updated] (HDDS-1899) DeleteBlocksCommandHandler is unable to find the container in SCM

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1899: -- Target Version/s: 0.7.0 (was: 0.6.0) > DeleteBlocksCommandHandler is unable to find the container in

[jira] [Updated] (HDDS-1899) DeleteBlocksCommandHandler is unable to find the container in SCM

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1899: -- Labels: (was: MiniOzoneChaosCluster TriagePending) > DeleteBlocksCommandHandler is unable to find the

[jira] [Updated] (HDDS-1336) Better block allocation policy in SCM

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1336: -- Target Version/s: 0.7.0 (was: 0.6.0) > Better block allocation policy in SCM >

[jira] [Assigned] (HDDS-1249) Fix TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-1249: - Assignee: Nanda kumar > Fix TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer >

[jira] [Updated] (HDDS-3103) Have multi-raft pipeline calculator to recommend best pipeline number per datanode

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3103: -- Target Version/s: 0.7.0 (was: 0.6.0) > Have multi-raft pipeline calculator to recommend best pipeline

[jira] [Commented] (HDDS-3103) Have multi-raft pipeline calculator to recommend best pipeline number per datanode

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133636#comment-17133636 ] Nanda kumar commented on HDDS-3103: --- [~timmylicheng] Moving it out of 0.6.0, please move it back if you

[jira] [Updated] (HDDS-3103) Have multi-raft pipeline calculator to recommend best pipeline number per datanode

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3103: -- Labels: (was: TriagePending) > Have multi-raft pipeline calculator to recommend best pipeline number

[jira] [Updated] (HDDS-2720) Ozone Failure injection Service

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2720: -- Target Version/s: 0.7.0 (was: 0.6.0) > Ozone Failure injection Service >

[jira] [Commented] (HDDS-2215) SCM should exclude datanode if the pipeline initialization fails

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133633#comment-17133633 ] Nanda kumar commented on HDDS-2215: --- Resolving this, let's reopen it if we run into the same issue

[jira] [Resolved] (HDDS-2215) SCM should exclude datanode if the pipeline initialization fails

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar resolved HDDS-2215. --- Resolution: Cannot Reproduce > SCM should exclude datanode if the pipeline initialization fails >

[jira] [Resolved] (HDDS-1289) get Key failed on SCM restart

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar resolved HDDS-1289. --- Resolution: Not A Problem > get Key failed on SCM restart > - > >

[jira] [Updated] (HDDS-1289) get Key failed on SCM restart

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1289: -- Labels: (was: TriagePending) > get Key failed on SCM restart > - > >

[jira] [Commented] (HDDS-1289) get Key failed on SCM restart

2020-06-11 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133630#comment-17133630 ] Nanda kumar commented on HDDS-1289: --- Resolving this, we can reopen it if we run into the issue again. >

[jira] [Assigned] (HDDS-3619) OzoneManager fails with IllegalArgumentException for cmdType RenameKey

2020-06-11 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-3619: Assignee: Hanisha Koneru > OzoneManager fails with IllegalArgumentException for cmdType

[jira] [Assigned] (HDDS-3619) OzoneManager fails with IllegalArgumentException for cmdType RenameKey

2020-06-11 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-3619: Assignee: (was: Hanisha Koneru) > OzoneManager fails with IllegalArgumentException for

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1002: HDDS-3642. Stop/Pause Background services while replacing OM DB with checkpoint from Leader

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #1002: URL: https://github.com/apache/hadoop-ozone/pull/1002#issuecomment-642325738 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1002?src=pr=h1) Report > Merging

[jira] [Resolved] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-1354. -- Resolution: Not A Problem > Kerberos principal configuration of OzoneManager doesn't use FQDN >

[jira] [Commented] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133611#comment-17133611 ] Xiaoyu Yao commented on HDDS-1354: -- I took another look at the issue. Seems that it is not an issue as CM

[jira] [Updated] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1354: - Target Version/s: (was: 0.6.0) > Kerberos principal configuration of OzoneManager doesn't use FQDN >

[jira] [Updated] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1354: - Labels: Triaged regression-test (was: TriagePending regression-test) > Kerberos principal configuration

[jira] [Updated] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-11 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1354: - Labels: Triaged (was: Triaged regression-test) > Kerberos principal configuration of OzoneManager

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1054: Hdds 3772. Add LOG to S3ErrorTable for easier problem locating.

2020-06-11 Thread GitBox
xiaoyuyao commented on a change in pull request #1054: URL: https://github.com/apache/hadoop-ozone/pull/1054#discussion_r438998025 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OzoneAclUtil.java ## @@ -53,15 +54,15 @@ private

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1063: HDDS-3784. Use matrix build for integration test

2020-06-11 Thread GitBox
codecov-commenter commented on pull request #1063: URL: https://github.com/apache/hadoop-ozone/pull/1063#issuecomment-642867586 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1063?src=pr=h1) Report > Merging

  1   2   3   >