[GitHub] [hadoop-ozone] smengcl commented on pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
smengcl commented on pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#issuecomment-651539858 Thanks @xiaoyuyao for the review and comment. I have updated the doc. Please take another look. This is

[GitHub] [hadoop-ozone] smengcl merged pull request #1134: HDDS-3868. Implement getTrashRoot and getTrashRoots in o3fs

2020-06-29 Thread GitBox
smengcl merged pull request #1134: URL: https://github.com/apache/hadoop-ozone/pull/1134 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
smengcl commented on a change in pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#discussion_r447411835 ## File path: hadoop-hdds/docs/content/design/ofs.md ## @@ -22,12 +22,140 @@ author: Siyao Meng # Abstract - Existing scheme:

[GitHub] [hadoop-ozone] smengcl commented on pull request #1134: HDDS-3868. Implement getTrashRoot and getTrashRoots in o3fs

2020-06-29 Thread GitBox
smengcl commented on pull request #1134: URL: https://github.com/apache/hadoop-ozone/pull/1134#issuecomment-651537831 Thanks @xiaoyuyao for the review. Will commit shortly. This is an automated message from the Apache Git

[jira] [Created] (HDDS-3901) [OFS] Add a dfsadmin command for temp volume provisioning

2020-06-29 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-3901: Summary: [OFS] Add a dfsadmin command for temp volume provisioning Key: HDDS-3901 URL: https://issues.apache.org/jira/browse/HDDS-3901 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
smengcl commented on a change in pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#discussion_r447411059 ## File path: hadoop-hdds/docs/content/design/ofs.md ## @@ -22,12 +22,140 @@ author: Siyao Meng # Abstract - Existing scheme:

[jira] [Commented] (HDDS-3894) Noisy log at OM when the requested sequence is not written into DB

2020-06-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148310#comment-17148310 ] Mukul Kumar Singh commented on HDDS-3894: - cc [~avijayan] > Noisy log at OM when the requested

[jira] [Assigned] (HDDS-3897) OM startup failing to replay ratis log entries when configuring a different segment size

2020-06-29 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3897: --- Assignee: Tsz-wo Sze > OM startup failing to replay ratis log entries when

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1147: HDDS-3892. Datanode initialization is too slow when there are thousan…

2020-06-29 Thread GitBox
ChenSammi commented on pull request #1147: URL: https://github.com/apache/hadoop-ozone/pull/1147#issuecomment-651514206 @bharatviswa504 we have HDDS-3217 deployed. This is an automated message from the Apache Git Service.

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447383235 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public void

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-651495214 > Question: Now when list at the root "/" with ofs filesystem, for link buckets they will be displayed as a new entry of only resolved buckets will be shown. What

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447378831 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java ## @@ -149,6

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447376939 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2197,20 +2234,25 @@ public void

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447374977 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447373492 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public void

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1147: HDDS-3892. Datanode initialization is too slow when there are thousan…

2020-06-29 Thread GitBox
bharatviswa504 commented on pull request #1147: URL: https://github.com/apache/hadoop-ozone/pull/1147#issuecomment-651480464 Hi @ChenSammi Thanks for the PR. I too have the same comment as @sodonnel. I think we need to close the DB instance if we get an instance from the cache.

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-651426116 Question: Now when list at the root "/" with ofs filesystem, for link buckets they will be displayed as a new entry of only resolved buckets will be shown. What

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447318712 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447318712 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#discussion_r447316328 ## File path: hadoop-hdds/docs/content/design/ofs.md ## @@ -22,12 +22,140 @@ author: Siyao Meng # Abstract - Existing scheme:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#discussion_r447316226 ## File path: hadoop-hdds/docs/content/design/ofs.md ## @@ -22,12 +22,140 @@ author: Siyao Meng # Abstract - Existing scheme:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1144: HDDS-3803. [OFS] Add User Guide

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1144: URL: https://github.com/apache/hadoop-ozone/pull/1144#discussion_r447315619 ## File path: hadoop-hdds/docs/content/design/ofs.md ## @@ -22,12 +22,140 @@ author: Siyao Meng # Abstract - Existing scheme:

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1124: HDDS-3865. Export the SCM client IPC port in docker-compose

2020-06-29 Thread GitBox
maobaolong commented on pull request #1124: URL: https://github.com/apache/hadoop-ozone/pull/1124#issuecomment-651419464 @elek Thanks you for your review. This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447313113 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java ## @@ -149,6

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447313113 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java ## @@ -149,6

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447312649 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMAllocateBlockRequest.java ## @@ -174,6

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447311657 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447311657 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447302394 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2197,20 +2234,25 @@ public void

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447301716 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447301716 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447301716 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2145,37 +2168,51 @@ public

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1134: HDDS-3868. Implement getTrashRoot and getTrashRoots in o3fs

2020-06-29 Thread GitBox
smengcl commented on a change in pull request #1134: URL: https://github.com/apache/hadoop-ozone/pull/1134#discussion_r447295269 ## File path: hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicOzoneFileSystem.java ## @@ -606,6 +607,52 @@ public String

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447292219 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2020,60 +2026,72 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447291849 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-06-29 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r447284712 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3040,45 +3024,61 @@ public TermIndex

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-06-29 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r447280689 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3040,45 +3024,61 @@ public TermIndex

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-06-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r447279299 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -136,54 +137,49 @@ public

[GitHub] [hadoop-ozone] umamaheswararao commented on a change in pull request #1115: HDDS-3632. starter scripts can't manage Ozone and HDFS datandodes on the same machine

2020-06-29 Thread GitBox
umamaheswararao commented on a change in pull request #1115: URL: https://github.com/apache/hadoop-ozone/pull/1115#discussion_r447274784 ## File path: hadoop-ozone/dist/src/shell/hdds/hadoop-functions.sh ## @@ -2702,11 +2702,11 @@ function hadoop_generic_java_subcmd_handler

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-06-29 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r447272528 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -2999,32 +3000,15 @@ public TermIndex

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1145: HDDS-3895. Implement container related operations in ContainerManagerImpl

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1145: URL: https://github.com/apache/hadoop-ozone/pull/1145#discussion_r447268958 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ContainerManagerImpl.java ## @@ -279,6 +257,24 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1145: HDDS-3895. Implement container related operations in ContainerManagerImpl

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1145: URL: https://github.com/apache/hadoop-ozone/pull/1145#discussion_r447269086 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ContainerManagerImpl.java ## @@ -279,6 +257,24 @@ public

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1115: HDDS-3632. starter scripts can't manage Ozone and HDFS datandodes on the same machine

2020-06-29 Thread GitBox
arp7 commented on a change in pull request #1115: URL: https://github.com/apache/hadoop-ozone/pull/1115#discussion_r447260017 ## File path: hadoop-ozone/dist/src/shell/hdds/hadoop-functions.sh ## @@ -2702,11 +2702,11 @@ function hadoop_generic_java_subcmd_handler

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1134: HDDS-3868. Implement getTrashRoot and getTrashRoots in o3fs

2020-06-29 Thread GitBox
xiaoyuyao commented on a change in pull request #1134: URL: https://github.com/apache/hadoop-ozone/pull/1134#discussion_r447251957 ## File path: hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicOzoneFileSystem.java ## @@ -606,6 +607,52 @@ public

[jira] [Commented] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148135#comment-17148135 ] Arpit Agarwal commented on HDDS-3214: - Moved to 0.7.0. > Unhealthy datanodes repeatedly participate

[jira] [Updated] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3214: Target Version/s: 0.7.0 (was: 0.6.0) > Unhealthy datanodes repeatedly participate in pipeline

[jira] [Updated] (HDDS-3741) Reload old OM state if Install Snapshot from Leader fails

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3741: Component/s: OM HA > Reload old OM state if Install Snapshot from Leader fails >

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3612: Target Version/s: 0.7.0 (was: 0.6.0) > Allow mounting bucket under other volume >

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3612: Target Version/s: 0.6.0 (was: 0.7.0) > Allow mounting bucket under other volume >

[jira] [Updated] (HDDS-3402) Use proper acls for sub directories created during CreateDirectory operation

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3402: Target Version/s: 0.7.0 (was: 0.6.0) > Use proper acls for sub directories created during

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3612: Priority: Blocker (was: Critical) > Allow mounting bucket under other volume >

[jira] [Updated] (HDDS-3685) Remove replay logic from actual request logic

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3685: Priority: Blocker (was: Critical) > Remove replay logic from actual request logic >

[jira] [Updated] (HDDS-3599) [OFS] Add contract test for HA

2020-06-29 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3599: Target Version/s: 0.7.0 (was: 0.6.0) > [OFS] Add contract test for HA >

[GitHub] [hadoop-ozone] nandakumar131 closed pull request #1145: HDDS-3895. Implement container related operations in ContainerManagerImpl

2020-06-29 Thread GitBox
nandakumar131 closed pull request #1145: URL: https://github.com/apache/hadoop-ozone/pull/1145 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Comment Edited] (HDDS-3874) ITestRootedOzoneContract tests are flaky

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148034#comment-17148034 ] Siyao Meng edited comment on HDDS-3874 at 6/29/20, 6:09 PM: [~elek] I doubt

[jira] [Commented] (HDDS-3874) ITestRootedOzoneContract tests are flaky

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148034#comment-17148034 ] Siyao Meng commented on HDDS-3874: -- [~elek] I doubt this has anything to do with the FS interface. Looks

[jira] [Assigned] (HDDS-3830) Introduce OM layout version 'v0'.

2020-06-29 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3830: - Assignee: Aravindan Vijayan > Introduce OM layout version 'v0'. >

[jira] [Updated] (HDDS-3830) Introduce OM layout version 'v0'.

2020-06-29 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-3830: -- Fix Version/s: 0.6.0 > Introduce OM layout version 'v0'. > - >

[jira] [Updated] (HDDS-3805) [OFS] Remove usage of OzoneClientAdapter interface

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3805: - Summary: [OFS] Remove usage of OzoneClientAdapter interface (was: [OFS] Use ClientProtocol directly in

[jira] [Updated] (HDDS-3820) [OFS] Follow-up work post merge

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3820: - Component/s: (was: OFS) Ozone Filesystem > [OFS] Follow-up work post merge >

[jira] [Updated] (HDDS-3803) [OFS] Add User Guide

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3803: - Component/s: (was: Ozone Filesystem) documentation > [OFS] Add User Guide >

[jira] [Updated] (HDDS-3805) [OFS] Use ClientProtocol directly in Adapter and FS

2020-06-29 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3805: - Component/s: Ozone Filesystem > [OFS] Use ClientProtocol directly in Adapter and FS >

[jira] [Updated] (HDDS-698) Support Topology Awareness for Ozone

2020-06-29 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-698: - Fix Version/s: 0.6.0 > Support Topology Awareness for Ozone >

[jira] [Updated] (HDDS-1930) Test Topology Aware Job scheduling with Ozone Topology

2020-06-29 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-1930: -- Fix Version/s: 0.6.0 > Test Topology Aware Job scheduling with Ozone Topology >

[jira] [Resolved] (HDDS-3097) Fallback to ozone.om.address if suffixed key is not defined

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3097. --- Resolution: Duplicate I accidentally created a duplicate of this and created a patch: HDDS-3878 It

[jira] [Commented] (HDDS-3853) Container marked as missing on datanode while container directory do exist

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147988#comment-17147988 ] Marton Elek commented on HDDS-3853: --- Same comment as on HDDS-3852: We discussed it during the Community

[jira] [Commented] (HDDS-3852) Failed to import replicated container

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147984#comment-17147984 ] Marton Elek commented on HDDS-3852: --- We discussed it during the Community Meeting. It seems to be hard

[jira] [Updated] (HDDS-3853) Container marked as missing on datanode while container directory do exist

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3853: -- Description: {code} INFO org.apache.hadoop.ozone.container.common.impl.HddsDispatcher: Operation:

[jira] [Updated] (HDDS-3852) Failed to import replicated container

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3852: -- Target Version/s: 0.7.0 (was: 0.6.0) > Failed to import replicated container >

[jira] [Updated] (HDDS-3855) Add upgrade smoketest

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3855: -- Target Version/s: 0.7.0 (was: 0.6.0) > Add upgrade smoketest > - > >

[jira] [Updated] (HDDS-3853) Container marked as missing on datanode while container directory do exist

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3853: -- Target Version/s: 0.7.0 (was: 0.6.0) > Container marked as missing on datanode while container

[jira] [Resolved] (HDDS-3886) StackOverflowError in KeyValueBlockIterator.hasNext

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3886. --- Resolution: Duplicate Closing based on the information from Attila. Feel free to re-open, if you

[jira] [Updated] (HDDS-3886) StackOverflowError in KeyValueBlockIterator.hasNext

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3886: -- Target Version/s: 0.7.0 (was: 0.6.0) > StackOverflowError in KeyValueBlockIterator.hasNext >

[jira] [Updated] (HDDS-390) Add method to check for valid key name based on URI characters

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-390: - Target Version/s: 0.7.0 (was: 0.6.0) > Add method to check for valid key name based on URI characters >

[jira] [Updated] (HDDS-1199) In Healthy Pipeline rule consider pipelines with all replicationType and replicationFactor

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1199: -- Target Version/s: 0.7.0 (was: 0.6.0) > In Healthy Pipeline rule consider pipelines with all

[jira] [Commented] (HDDS-1199) In Healthy Pipeline rule consider pipelines with all replicationType and replicationFactor

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147957#comment-17147957 ] Marton Elek commented on HDDS-1199: --- [~bharat], please move back if you think it's still a problem. >

[jira] [Resolved] (HDDS-1676) Datanode out file contains ReferenceCountedDB related exceptions

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-1676. --- Resolution: Cannot Reproduce > Datanode out file contains ReferenceCountedDB related exceptions >

[jira] [Updated] (HDDS-1714) When restart om with Kerberos, NPException happened at addPersistedDelegationToken

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1714: -- Target Version/s: 0.7.0 (was: 0.6.0) > When restart om with Kerberos, NPException happened at >

[jira] [Updated] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1933: -- Target Version/s: 0.7.0 (was: 0.6.0) > Datanode should use hostname in place of ip addresses to allow

[jira] [Resolved] (HDDS-2086) ReconServer throws SQLException but path present for ozone.recon.db.dir in ozone-site

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2086. --- Resolution: Invalid Please re-open if you see it again, it should be fixed with the recent changes.

[jira] [Updated] (HDDS-2309) Optimise OzoneManagerDoubleBuffer::flushTransactions to flush in batches

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2309: -- Target Version/s: 0.7.0 (was: 0.6.0) > Optimise OzoneManagerDoubleBuffer::flushTransactions to flush

[jira] [Updated] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2324: -- Target Version/s: 0.7.0 (was: 0.6.0) > Enhance locking mechanism in OzoneMangaer >

[jira] [Updated] (HDDS-2351) Fix write performance issue in Non-HA OM

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2351: -- Target Version/s: 0.7.0 (was: 0.6.0) > Fix write performance issue in Non-HA OM >

[jira] [Commented] (HDDS-2351) Fix write performance issue in Non-HA OM

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147945#comment-17147945 ] Marton Elek commented on HDDS-2351: --- Is it still a problem, can we close it? Seems to be better now? >

[jira] [Updated] (HDDS-2694) HddsVolume#readVersionFile fails when reading older versions

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2694: -- Target Version/s: 0.7.0 (was: 0.6.0) > HddsVolume#readVersionFile fails when reading older versions >

[jira] [Updated] (HDDS-2694) HddsVolume#readVersionFile fails when reading older versions

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2694: -- Priority: Critical (was: Major) > HddsVolume#readVersionFile fails when reading older versions >

[jira] [Updated] (HDDS-2697) SCM log is flooded with block deletion txId mismatch messages

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2697: -- Target Version/s: 0.7.0 (was: 0.6.0) > SCM log is flooded with block deletion txId mismatch messages >

[jira] [Updated] (HDDS-2697) SCM log is flooded with block deletion txId mismatch messages

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2697: -- Priority: Critical (was: Major) > SCM log is flooded with block deletion txId mismatch messages >

[jira] [Updated] (HDDS-2253) Add container state to snapshot to avoid spurious missing container being reported.

2020-06-29 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2253: Target Version/s: 0.7.0 (was: 0.6.0) > Add container state to snapshot to avoid spurious

[jira] [Updated] (HDDS-3090) Fix logging in OMFileRequest and OzoneManager

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3090: -- Target Version/s: 0.7.0 (was: 0.6.0) > Fix logging in OMFileRequest and OzoneManager >

[jira] [Updated] (HDDS-3039) SCM sometimes cannot exit safe mode

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3039: -- Target Version/s: 0.7.0 (was: 0.6.0) > SCM sometimes cannot exit safe mode >

[jira] [Resolved] (HDDS-1557) Datanode exits because Ratis fails to shutdown ratis server

2020-06-29 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-1557. - Resolution: Cannot Reproduce No longer able to reproduce this. Please reopen if we see

[jira] [Updated] (HDDS-3133) Add export objectIds in Ozone as FileIds to allow LLAP to cache the files

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3133: -- Target Version/s: 0.7.0 (was: 0.6.0) > Add export objectIds in Ozone as FileIds to allow LLAP to cache

[jira] [Updated] (HDDS-3138) Fix pipeline datanode limit on cluster with rack awareness

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3138: -- Target Version/s: 0.7.0 (was: 0.6.0) > Fix pipeline datanode limit on cluster with rack awareness >

[jira] [Updated] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3214: -- Priority: Blocker (was: Major) > Unhealthy datanodes repeatedly participate in pipeline creation >

[jira] [Updated] (HDDS-3246) Include OM hostname info in "getserviceroles" subcommand of OM CLI

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3246: -- Target Version/s: 0.7.0 (was: 0.6.0) > Include OM hostname info in "getserviceroles" subcommand of OM

[jira] [Updated] (HDDS-3246) Include OM hostname info in "getserviceroles" subcommand of OM CLI

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3246: -- Priority: Major (was: Minor) > Include OM hostname info in "getserviceroles" subcommand of OM CLI >

[jira] [Updated] (HDDS-3277) Datanodes do not close pipeline when pipeline directory is deleted.

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3277: -- Priority: Critical (was: Major) > Datanodes do not close pipeline when pipeline directory is deleted.

[jira] [Updated] (HDDS-3277) Datanodes do not close pipeline when pipeline directory is deleted.

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3277: -- Target Version/s: 0.7.0 (was: 0.6.0) > Datanodes do not close pipeline when pipeline directory is

[jira] [Comment Edited] (HDDS-3325) Handle Resource Unavailable exception in OM HA

2020-06-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147926#comment-17147926 ] Marton Elek edited comment on HDDS-3325 at 6/29/20, 4:29 PM: - Is it a blocker

  1   2   >