[jira] [Updated] (HDDS-3509) Closing container with unhealthy replica on open pipeline

2020-07-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3509: - Target Version/s: 0.7.0 (was: 0.6.0) > Closing container with unhealthy replica on open pipeline >

[jira] [Commented] (HDDS-3509) Closing container with unhealthy replica on open pipeline

2020-07-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159682#comment-17159682 ] Xiaoyu Yao commented on HDDS-3509: -- Move to 0.7.0 for comprehensive design on how to close containers on

[jira] [Updated] (HDDS-3907) Topology related acceptance test is flaky

2020-07-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3907: - Target Version/s: 0.7.0 (was: 0.6.0) > Topology related acceptance test is flaky >

[jira] [Updated] (HDDS-3952) Merge small container

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3952: - Summary: Merge small container (was: Make container could be reopened) > Merge small container >

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659851288 Thanks @arp7, @elek for high-level review, @bharatviswa504 for the detailed reviews, @ChenSammi for testing and committing it.

[jira] [Resolved] (HDDS-3977) Add design doc link of OM HA to ozone docs

2020-07-16 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-3977. -- Resolution: Duplicate > Add design doc link of OM HA to ozone docs >

[jira] [Created] (HDDS-3977) Add design doc link of OM HA to ozone docs

2020-07-16 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3977: Summary: Add design doc link of OM HA to ozone docs Key: HDDS-3977 URL: https://issues.apache.org/jira/browse/HDDS-3977 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3967) Remove leftover debug setting

2020-07-16 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159664#comment-17159664 ] Bharat Viswanadham commented on HDDS-3967: -- [~Sammi] This is committed only to apache main. I

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1211: HDDS-3969. Add validName check for FileSystem requests

2020-07-16 Thread GitBox
bharatviswa504 commented on a change in pull request #1211: URL: https://github.com/apache/hadoop-ozone/pull/1211#discussion_r456210475 ## File path: hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicOzoneFileSystem.java ## @@ -721,7 +723,13 @@ public

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1210: HDDS-3965. SCM failed to start up for duplicated pipeline detected.

2020-07-16 Thread GitBox
avijayanhwx commented on pull request #1210: URL: https://github.com/apache/hadoop-ozone/pull/1210#issuecomment-659832842 cc @fapifta This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1211: HDDS-3969. Add validName check for FileSystem requests

2020-07-16 Thread GitBox
avijayanhwx commented on a change in pull request #1211: URL: https://github.com/apache/hadoop-ozone/pull/1211#discussion_r456206292 ## File path: hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicOzoneFileSystem.java ## @@ -721,7 +723,13 @@ public

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3612: - Fix Version/s: 0.6.0 > Allow mounting bucket under other volume >

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3612: - Resolution: Fixed Status: Resolved (was: Patch Available) > Allow mounting bucket under other

[GitHub] [hadoop-ozone] ChenSammi merged pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
ChenSammi merged pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
ChenSammi commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659831676 Thanks @adoroszlai for the contribution and @bharatviswa504 for the review. This is an automated message

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-16 Thread GitBox
ChenSammi commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r456203522 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight:

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1185: HDDS-3933. Fix memory leak because of too many Datanode State Machine Thread

2020-07-16 Thread GitBox
ChenSammi commented on a change in pull request #1185: URL: https://github.com/apache/hadoop-ozone/pull/1185#discussion_r456200241 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/StateContext.java ## @@ -415,7

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1185: HDDS-3933. Fix memory leak because of too many Datanode State Machine Thread

2020-07-16 Thread GitBox
runzhiwang commented on a change in pull request #1185: URL: https://github.com/apache/hadoop-ozone/pull/1185#discussion_r456195255 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/StateContext.java ## @@ -415,7

[jira] [Updated] (HDDS-3946) s3g multi-upload failed with partName check

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3946: - Target Version/s: 0.7.0 (was: 0.6.0) > s3g multi-upload failed with partName check >

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:02 AM: [~msingh] Hi,

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1033: HDDS-3667. If we gracefully stop datanode it would be better to notify scm and r…

2020-07-16 Thread GitBox
maobaolong commented on pull request #1033: URL: https://github.com/apache/hadoop-ozone/pull/1033#issuecomment-659808668 @leosunli After you are ready for review, please use `/ready` to restore this PR. This is an automated

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:01 AM: [~msingh] Hi,

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:00 AM: [~msingh] Hi,

[jira] [Commented] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang commented on HDDS-3952: -- [~msingh] Hi, Thanks for review. The backgroud of this jira is our

[jira] [Updated] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3952: - Attachment: screenshot-1.png > Make container could be reopened > > >

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1164: HDDS-3824: OM read requests should make SCM#refreshPipeline outside BUCKET_LOCK

2020-07-16 Thread GitBox
rakeshadr commented on pull request #1164: URL: https://github.com/apache/hadoop-ozone/pull/1164#issuecomment-659786368 Thanks @xiaoyuyao and @bharatviswa504 for the reviews and committing the PR. This is an automated

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1149: HDDS-3878. Make OMHA serviceID optional if one (but only one) is defined in the config

2020-07-16 Thread GitBox
xiaoyuyao commented on pull request #1149: URL: https://github.com/apache/hadoop-ozone/pull/1149#issuecomment-659766847 I agree with @elek that the scope of this change is very limited to where client only has one om service id configured. So accidentally access wrong om cluster when

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-16 Thread GitBox
xiaoyuyao commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r456156802 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-16 Thread GitBox
xiaoyuyao commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r456156398 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1185: HDDS-3933. Fix memory leak because of too many Datanode State Machine Thread

2020-07-16 Thread GitBox
xiaoyuyao commented on a change in pull request #1185: URL: https://github.com/apache/hadoop-ozone/pull/1185#discussion_r456153310 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/StateContext.java ## @@ -415,7

[jira] [Updated] (HDDS-3969) Validate KeyNames created in FileSystem requests.

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3969: - Labels: pull-request-available (was: ) > Validate KeyNames created in FileSystem requests. >

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1211: HDDS-3969. Add validName check for FileSystem requests

2020-07-16 Thread GitBox
bharatviswa504 opened a new pull request #1211: URL: https://github.com/apache/hadoop-ozone/pull/1211 ## What changes were proposed in this pull request? This Jira is to validate KeyNames which are created with OzoneFileSystem. Similar to how hdfs handles using DFSUtil.

[jira] [Updated] (HDDS-3969) Validate KeyNames created in FileSystem requests.

2020-07-16 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3969: - Summary: Validate KeyNames created in FileSystem requests. (was: Validate KeyNames

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 edited a comment on pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#issuecomment-659696446 Thank You @arp7 and @avijayanhwx for the review. I have addressed review comments. This PR only modifies behavior of KeyCreate when

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 edited a comment on pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#issuecomment-659696446 Thank You @arp7 and @avijayanhwx for the review. I have addressed review comments. This PR only handles KeyCreate when

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 edited a comment on pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#issuecomment-659696446 Thank You @arp7 and @avijayanhwx for the review. I have addressed review comments. This PR only modifies behavior of KeyCreate when

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 commented on pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#issuecomment-659696446 Thank You @arp7 and @avijayanhwx for the review. I have addressed review comments. This is an

[jira] [Resolved] (HDDS-3924) Move away from proto serialization for RocksDB keys in Ozone

2020-07-16 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-3924. - Resolution: Fixed > Move away from proto serialization for RocksDB keys in Ozone >

[jira] [Commented] (HDDS-3924) Move away from proto serialization for RocksDB keys in Ozone

2020-07-16 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159496#comment-17159496 ] Aravindan Vijayan commented on HDDS-3924: - Thank you [~pifta], [~ppogde] & [~xyao]. Closing this

[jira] [Resolved] (HDDS-3926) Ozone Manager Token Identifier table should use in-house serialization rather than rely on proto serialization for key.

2020-07-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3926. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~ppogde] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-16 Thread GitBox
xiaoyuyao merged pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-3824) OM read requests should make SCM#refreshPipeline outside the BUCKET_LOCK

2020-07-16 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3824. -- Fix Version/s: 0.7.0 Resolution: Fixed Thanks [~rakeshr] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1164: HDDS-3824: OM read requests should make SCM#refreshPipeline outside BUCKET_LOCK

2020-07-16 Thread GitBox
xiaoyuyao merged pull request #1164: URL: https://github.com/apache/hadoop-ozone/pull/1164 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-3976) KeyValueBlockIterator#nextBlock skips valid blocks

2020-07-16 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-3976: - Description: HDDS-3854 fixed a bug in KeyValueBlockIterator#hasNext, but introduced another one in

[jira] [Updated] (HDDS-3976) KeyValueBlockIterator#nextBlock skips valid blocks

2020-07-16 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-3976: - Description: HDDS-3854 fixed a bug in KeyValueBlockIterator#hasNext, but introduced another one in

[jira] [Created] (HDDS-3976) KeyValueBlockIterator#nextBlock skips valid blocks

2020-07-16 Thread Ethan Rose (Jira)
Ethan Rose created HDDS-3976: Summary: KeyValueBlockIterator#nextBlock skips valid blocks Key: HDDS-3976 URL: https://issues.apache.org/jira/browse/HDDS-3976 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] avijayanhwx removed a comment on pull request #1210: HDDS-3965. SCM failed to start up for duplicated pipeline detected.

2020-07-16 Thread GitBox
avijayanhwx removed a comment on pull request #1210: URL: https://github.com/apache/hadoop-ozone/pull/1210#issuecomment-659593212 First Restart with HDDS-3925. `2020-07-16 18:22:21,133 [main] INFO pipeline.SCMPipelineManager: Processing pipeline

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1210: HDDS-3965. SCM failed to start up for duplicated pipeline detected.

2020-07-16 Thread GitBox
avijayanhwx commented on pull request #1210: URL: https://github.com/apache/hadoop-ozone/pull/1210#issuecomment-659593212 First Restart with HDDS-3925. `2020-07-16 18:22:21,133 [main] INFO pipeline.SCMPipelineManager: Processing pipeline PipelineID=096c944b-07d9-4a5b-af11-1102b46cf457

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #1210: HDDS-3965. SCM failed to start up for duplicated pipeline detected.

2020-07-16 Thread GitBox
avijayanhwx opened a new pull request #1210: URL: https://github.com/apache/hadoop-ozone/pull/1210 ## What changes were proposed in this pull request? After the patch from HDDS-3925, SCM failed to start up for duplicated pipeline detected. ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3965: - Labels: pull-request-available upgrade-p0 (was: upgrade-p0) > SCM failed to start up for

[GitHub] [hadoop-ozone] prashantpogde commented on pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-16 Thread GitBox
prashantpogde commented on pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#issuecomment-659580090 Made the changes as suggested by @xiaoyuyao . This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] prashantpogde commented on a change in pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-16 Thread GitBox
prashantpogde commented on a change in pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#discussion_r455974965 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java ## @@ -42,8 +42,9 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455968767 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -79,15 +79,11 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
bharatviswa504 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455968524 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -79,15 +79,11 @@

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
arp7 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455961310 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -79,15 +79,11 @@ public static

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
arp7 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455960385 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -79,15 +79,11 @@ public static

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-16 Thread GitBox
arp7 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455955940 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/OMClientRequest.java ## @@ -265,4 +272,30 @@ public

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-07-16 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r455950095 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3041,58 +3047,74 @@ public TermIndex

[jira] [Assigned] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-16 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3965: - Assignee: Aravindan Vijayan (was: Prashant Pogde) [~avijayan] Can you take this up

[jira] [Updated] (HDDS-3877) Do not fail CI check for log upload failure

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3877: - Labels: pull-request-available (was: ) > Do not fail CI check for log upload failure >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1209: HDDS-3877. Do not fail CI check for log upload failure

2020-07-16 Thread GitBox
adoroszlai opened a new pull request #1209: URL: https://github.com/apache/hadoop-ozone/pull/1209 ## What changes were proposed in this pull request? Consider CI successful even if `upload-artifact` step fails, to save time and resources. Examples where this happened:

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1204: HDDS-3964. Ratis config key mismatch

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1204: URL: https://github.com/apache/hadoop-ozone/pull/1204#issuecomment-659519673 > > I was considering changing the parameter to `Duration` > yeah...that seems like a better approach. Created HDDS-3975 for this.

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659518247 > I take back this comment. This feature helps to expose buckets created via shell/ofs to S3. So making it configurable is not needed. (As by default if user decides to

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659517803 > I have one suggestion, can we make this mount configurable option, as this is required only when old S3 buckets needs to be exposed via O3fs/ofs. In this way, we can

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659515813 > I have one suggestion, can we make this mount configurable option, as this is required only when old S3 buckets needs to be exposed via O3fs/ofs. In this way, we

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659503325 I have one suggestion, can we make this mount configurable option, as this is required only when old S3 buckets needs to be exposed via O3fs/ofs. In this way, we

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-16 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659501553 > > > > When deleting a bucket, we check bucket is empty or not. Do we need to check resolvedBucket is empty or not? > > > > > > > > > Link can be deleted

[jira] [Commented] (HDDS-698) Support Topology Awareness for Ozone

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159256#comment-17159256 ] Stephen O'Donnell commented on HDDS-698: [~Sammi] I think we can close this overall Jira now. Any

[jira] [Commented] (HDDS-1930) Test Topology Aware Job scheduling with Ozone Topology

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159255#comment-17159255 ] Stephen O'Donnell commented on HDDS-1930: - I believe this is not an issue, or no longer an issue

[jira] [Resolved] (HDDS-1930) Test Topology Aware Job scheduling with Ozone Topology

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDDS-1930. - Resolution: Not A Problem > Test Topology Aware Job scheduling with Ozone Topology >

[jira] [Created] (HDDS-3975) Use Duration for time in RatisClientConfig

2020-07-16 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3975: -- Summary: Use Duration for time in RatisClientConfig Key: HDDS-3975 URL: https://issues.apache.org/jira/browse/HDDS-3975 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3907) Topology related acceptance test is flaky

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159235#comment-17159235 ] Sammi Chen commented on HDDS-3907: -- [~elek], do you think we should fix this in 0.6.0? > Topology

[GitHub] [hadoop-ozone] elek commented on pull request #1208: HDDS-3755. Storage-class support for Ozone

2020-07-16 Thread GitBox
elek commented on pull request #1208: URL: https://github.com/apache/hadoop-ozone/pull/1208#issuecomment-659404852 > Would you like to merge apache#920 to make it possible to accept any number of replication which specified by StorageClass or rebase that works to this storageClass POC?

[jira] [Updated] (HDDS-3755) Storage-class support for Ozone

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3755: - Labels: pull-request-available (was: ) > Storage-class support for Ozone >

[GitHub] [hadoop-ozone] elek opened a new pull request #1208: HDDS-3755. Storage-class support for Ozone

2020-07-16 Thread GitBox
elek opened a new pull request #1208: URL: https://github.com/apache/hadoop-ozone/pull/1208 Created together with @maobaolong (thanks the help) ## What changes were proposed in this pull request? This is the initial draft for storage-class support. It introduces the

[GitHub] [hadoop-ozone] lokeshj1703 commented on pull request #1204: HDDS-3964. Ratis config key mismatch

2020-07-16 Thread GitBox
lokeshj1703 commented on pull request #1204: URL: https://github.com/apache/hadoop-ozone/pull/1204#issuecomment-659388287 > I was considering changing the parameter to `Duration`, similar to > >

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1207: HDDS-3973. Update main feature design status.

2020-07-16 Thread GitBox
elek commented on a change in pull request #1207: URL: https://github.com/apache/hadoop-ozone/pull/1207#discussion_r455754639 ## File path: hadoop-hdds/docs/content/design/decommissioning.md ## @@ -3,7 +3,7 @@ title: Decommissioning in Ozone summary: Formal process to shut

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #917: HDDS-3002. Make the Mountd work for Ozone.

2020-07-16 Thread GitBox
github-actions[bot] closed pull request #917: URL: https://github.com/apache/hadoop-ozone/pull/917 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #917: HDDS-3002. Make the Mountd work for Ozone.

2020-07-16 Thread GitBox
github-actions[bot] commented on pull request #917: URL: https://github.com/apache/hadoop-ozone/pull/917#issuecomment-659381579 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author.

[GitHub] [hadoop-ozone] elek commented on pull request #917: HDDS-3002. Make the Mountd work for Ozone.

2020-07-16 Thread GitBox
elek commented on pull request #917: URL: https://github.com/apache/hadoop-ozone/pull/917#issuecomment-659381363 /close This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1204: HDDS-3964. Ratis config key mismatch

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1204: URL: https://github.com/apache/hadoop-ozone/pull/1204#issuecomment-659376896 Thanks @lokeshj1703 for the review. > Minor comment - We can add suffix like "InMs" for time based configs in classes like RatisClientConfig. > We can do it as

[jira] [Updated] (HDDS-3964) Ratis config key mismatch

2020-07-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3964: --- Target Version/s: 0.6.0 (was: 0.7.0) > Ratis config key mismatch > -

[jira] [Updated] (HDDS-3964) Ratis config key mismatch

2020-07-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3964: --- Status: Patch Available (was: In Progress) > Ratis config key mismatch >

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1142: HDDS-3855. Add upgrade smoketest

2020-07-16 Thread GitBox
adoroszlai commented on pull request #1142: URL: https://github.com/apache/hadoop-ozone/pull/1142#issuecomment-659356744 > Overall it looks good to me, and really impressive approach. I have a few comments -- none of them are blocker, but i like to discuss technical details...

[jira] [Created] (HDDS-3974) StateContext::addPipelineActionIfAbsent does not work as expected.

2020-07-16 Thread Glen Geng (Jira)
Glen Geng created HDDS-3974: --- Summary: StateContext::addPipelineActionIfAbsent does not work as expected. Key: HDDS-3974 URL: https://issues.apache.org/jira/browse/HDDS-3974 Project: Hadoop Distributed

[jira] [Resolved] (HDDS-3807) Propagate raft log disks info to SCM from datanode

2020-07-16 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3807. --- Fix Version/s: 0.6.0 Resolution: Fixed > Propagate raft log disks info to SCM from datanode >

[GitHub] [hadoop-ozone] elek merged pull request #1107: HDDS-3807. Propagate raft log disks info to SCM from datanode.

2020-07-16 Thread GitBox
elek merged pull request #1107: URL: https://github.com/apache/hadoop-ozone/pull/1107 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop-ozone] elek commented on pull request #1107: HDDS-3807. Propagate raft log disks info to SCM from datanode.

2020-07-16 Thread GitBox
elek commented on pull request #1107: URL: https://github.com/apache/hadoop-ozone/pull/1107#issuecomment-659327881 Merging it as checkstyle issues are fixed. Thanks @bshashikant the contribution. This is an automated

[GitHub] [hadoop-ozone] elek edited a comment on pull request #1107: HDDS-3807. Propagate raft log disks info to SCM from datanode.

2020-07-16 Thread GitBox
elek edited a comment on pull request #1107: URL: https://github.com/apache/hadoop-ozone/pull/1107#issuecomment-651678810 Checkstyle violation seems to be related. This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3967) Remove leftover debug setting

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3967: - Fix Version/s: (was: 0.7.0) 0.6.0 > Remove leftover debug setting >

[jira] [Resolved] (HDDS-3968) LDB scan fails to read from transactionInfoTable

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-3968. -- Resolution: Fixed > LDB scan fails to read from transactionInfoTable >

[jira] [Updated] (HDDS-3968) LDB scan fails to read from transactionInfoTable

2020-07-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3968: - Fix Version/s: 0.6.0 > LDB scan fails to read from transactionInfoTable >

[GitHub] [hadoop-ozone] elek commented on pull request #983: HDDS-3584. Support write 2 replication

2020-07-16 Thread GitBox
elek commented on pull request #983: URL: https://github.com/apache/hadoop-ozone/pull/983#issuecomment-659297817 /pending more discussion is requested by @arp7 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] elek commented on pull request #1028: HDDS-3735. Improve SCM performance with 3.7% by remove unnecessary lock and unlock

2020-07-16 Thread GitBox
elek commented on pull request #1028: URL: https://github.com/apache/hadoop-ozone/pull/1028#issuecomment-659297555 > @elek I think this case can not be avoided by only add read lock Agree. It seems to be necessary. But it means that we can't remove the lock in the ContainerStateMap

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1207: HDDS-3973. Update main feature design status.

2020-07-16 Thread GitBox
ChenSammi commented on pull request #1207: URL: https://github.com/apache/hadoop-ozone/pull/1207#issuecomment-659293549 @nandakumar131 Could you take a look at this JIRA, make sure I have your name correctly spelled. This

[jira] [Updated] (HDDS-3973) Update main feature design status

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3973: - Labels: pull-request-available (was: ) > Update main feature design status >

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1207: HDDS-3973. Update main feature design status.

2020-07-16 Thread GitBox
ChenSammi opened a new pull request #1207: URL: https://github.com/apache/hadoop-ozone/pull/1207 https://issues.apache.org/jira/browse/HDDS-3973 This is an automated message from the Apache Git Service. To respond to the

[jira] [Created] (HDDS-3973) Update main feature design status

2020-07-16 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3973: Summary: Update main feature design status Key: HDDS-3973 URL: https://issues.apache.org/jira/browse/HDDS-3973 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-3972) Add option to limit number of items while displaying through ldb tool.

2020-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3972: - Labels: pull-request-available (was: ) > Add option to limit number of items while displaying

[GitHub] [hadoop-ozone] sadanand48 opened a new pull request #1206: HDDS-3972. Add option to limit number of items displaying through ldb tool.

2020-07-16 Thread GitBox
sadanand48 opened a new pull request #1206: URL: https://github.com/apache/hadoop-ozone/pull/1206 ## What changes were proposed in this pull request? The change here is to add an option to the ldb tool scan command to limit number of displayed items. ## What is the link to the

  1   2   >