[jira] [Updated] (HDDS-4253) SCM changes to process Layout Info in register request/response

2020-09-29 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde updated HDDS-4253: - Summary: SCM changes to process Layout Info in register request/response (was: SCM changes to

[jira] [Created] (HDDS-4296) SCM changes to process Layout Info in heartbeat request/response

2020-09-29 Thread Prashant Pogde (Jira)
Prashant Pogde created HDDS-4296: Summary: SCM changes to process Layout Info in heartbeat request/response Key: HDDS-4296 URL: https://issues.apache.org/jira/browse/HDDS-4296 Project: Hadoop

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1399: HDDS-3684. Add tests for replication annotation

2020-09-29 Thread GitBox
amaliujia commented on pull request #1399: URL: https://github.com/apache/hadoop-ozone/pull/1399#issuecomment-701150039 @timmylicheng conflicts resolved. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1454: HDDS-4285. Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread GitBox
ChenSammi commented on pull request #1454: URL: https://github.com/apache/hadoop-ozone/pull/1454#issuecomment-701144316 @adoroszlai thanks for identify this performance issue. I'm not quite familar with tokens, since it's a user token, suppose it has a much longer liveness than input

[jira] [Resolved] (HDDS-4106) Volume space: Supports clearing spaceQuota

2020-09-29 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-4106. - Fix Version/s: 1.1.0 Resolution: Fixed This has been fixed by HDDS-3751 > Volume space:

[jira] [Resolved] (HDDS-4105) Bucket space: Supports clearing spaceQuota

2020-09-29 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-4105. - Resolution: Fixed This has been fixed by HDDS-3751 > Bucket space: Supports clearing spaceQuota

[jira] [Updated] (HDDS-4105) Bucket space: Supports clearing spaceQuota

2020-09-29 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4105: Fix Version/s: 1.1.0 > Bucket space: Supports clearing spaceQuota >

[jira] [Resolved] (HDDS-3751) Ozone sh bucket client support quota option.

2020-09-29 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-3751. - Fix Version/s: 1.1.0 Resolution: Fixed pr has been merged > Ozone sh bucket client

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-29 Thread GitBox
ChenSammi commented on pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#issuecomment-701139655 Thanks @captainzmc for the contribution and @cxorm @adoroszlai @maobaolong for the review. This is an

[GitHub] [hadoop-ozone] ChenSammi merged pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-29 Thread GitBox
ChenSammi merged pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] amaliujia edited a comment on pull request #1444: HDDS-4242. Copy PrefixInfo proto to new project hadoop-ozone/interface-storage

2020-09-29 Thread GitBox
amaliujia edited a comment on pull request #1444: URL: https://github.com/apache/hadoop-ozone/pull/1444#issuecomment-700874303 @elek your suggestion make senses as the new util classes are dedicated to be used by `interface-storage`. If it is even dedicated to be used by a `codec` class,

[jira] [Created] (HDDS-4295) SCM ServiceManager

2020-09-29 Thread Li Cheng (Jira)
Li Cheng created HDDS-4295: -- Summary: SCM ServiceManager Key: HDDS-4295 URL: https://issues.apache.org/jira/browse/HDDS-4295 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Resolved] (HDDS-3206) Make sure AllocateBlock can only be executed on leader SCM

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-3206. Resolution: Duplicate > Make sure AllocateBlock can only be executed on leader SCM >

[jira] [Resolved] (HDDS-3199) Handle PipelineAction and OpenPipline from DN to SCM

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-3199. Resolution: Duplicate > Handle PipelineAction and OpenPipline from DN to SCM >

[jira] [Created] (HDDS-4294) Backport updates from ContainerManager(V1)

2020-09-29 Thread Li Cheng (Jira)
Li Cheng created HDDS-4294: -- Summary: Backport updates from ContainerManager(V1) Key: HDDS-4294 URL: https://issues.apache.org/jira/browse/HDDS-4294 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-4293) Backport updates from PipelineManager(V1)

2020-09-29 Thread Li Cheng (Jira)
Li Cheng created HDDS-4293: -- Summary: Backport updates from PipelineManager(V1) Key: HDDS-4293 URL: https://issues.apache.org/jira/browse/HDDS-4293 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-3211) Design for SCM HA configuration

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3211: --- Summary: Design for SCM HA configuration (was: Make SCM HA configurable) > Design for SCM HA configuration >

[jira] [Resolved] (HDDS-3200) Handle NodeReport from DN to SCMs

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-3200. Resolution: Duplicate > Handle NodeReport from DN to SCMs > - > >

[jira] [Resolved] (HDDS-3193) Handle ContainerReport and IncrementalContainerReport

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-3193. Resolution: Duplicate > Handle ContainerReport and IncrementalContainerReport >

[jira] [Commented] (HDDS-3211) Make SCM HA configurable

2020-09-29 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204409#comment-17204409 ] Li Cheng commented on HDDS-3211: [~nicholasjiang] Hey Nicolas, this issue would require an overall design

[GitHub] [hadoop-ozone] fapifta opened a new pull request #1456: Upgrade

2020-09-29 Thread GitBox
fapifta opened a new pull request #1456: URL: https://github.com/apache/hadoop-ozone/pull/1456 ## What changes were proposed in this pull request? Server side implementation of the finalization logic is implemented in this pull request. The initial idea in the client side

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1454: HDDS-4285. Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread GitBox
linyiqun commented on a change in pull request #1454: URL: https://github.com/apache/hadoop-ozone/pull/1454#discussion_r497199494 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/storage/ContainerProtocolCalls.java ## @@ -84,7 +86,8 @@ private

[jira] [Resolved] (HDDS-4287) Exclude protobuff classes from ozone-filesystem-hadoop3 jars

2020-09-29 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDDS-4287. --- Fix Version/s: 1.1.0 Resolution: Fixed Thanks [~bharat] for the review! >

[GitHub] [hadoop-ozone] umamaheswararao merged pull request #1455: HDDS-4287: Exclude protobuff classes from ozone-filesystem-hadoop3 jars

2020-09-29 Thread GitBox
umamaheswararao merged pull request #1455: URL: https://github.com/apache/hadoop-ozone/pull/1455 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1455: HDDS-4287: Exclude protobuff classes from ozone-filesystem-hadoop3 jars

2020-09-29 Thread GitBox
bharatviswa504 commented on pull request #1455: URL: https://github.com/apache/hadoop-ozone/pull/1455#issuecomment-701064102 +1 LGTM This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Created] (HDDS-4292) OMFailoverProxyProvider.createOMProxyIfNeeded should return a new proxy instance for Hadoop < 3.2

2020-09-29 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-4292: Summary: OMFailoverProxyProvider.createOMProxyIfNeeded should return a new proxy instance for Hadoop < 3.2 Key: HDDS-4292 URL:

[jira] [Updated] (HDDS-4287) Exclude protobuff classes from ozone-filesystem-hadoop3 jars

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4287: - Labels: pull-request-available (was: ) > Exclude protobuff classes from ozone-filesystem-hadoop3

[GitHub] [hadoop-ozone] umamaheswararao opened a new pull request #1455: HDDS-4287: Exclude protobuff classes from ozone-filesystem-hadoop3 jars

2020-09-29 Thread GitBox
umamaheswararao opened a new pull request #1455: URL: https://github.com/apache/hadoop-ozone/pull/1455 ## What changes were proposed in this pull request? Excluded the protobuf classes from hadoop-ozone-filesystem-hadoop3/2. We already kept the dependency on hadoop anyway and hadoop

[GitHub] [hadoop-ozone] bharatviswa504 closed pull request #1331: HDDS-4117. Normalize Keypath for listKeys.

2020-09-29 Thread GitBox
bharatviswa504 closed pull request #1331: URL: https://github.com/apache/hadoop-ozone/pull/1331 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1331: HDDS-4117. Normalize Keypath for listKeys.

2020-09-29 Thread GitBox
bharatviswa504 commented on pull request #1331: URL: https://github.com/apache/hadoop-ozone/pull/1331#issuecomment-700952276 Closing this. Opened #1451 to track this issue. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1451: HDDS-4117. Normalize Keypath for listKeys.

2020-09-29 Thread GitBox
bharatviswa504 commented on pull request #1451: URL: https://github.com/apache/hadoop-ozone/pull/1451#issuecomment-700951976 Rebased and fixed test. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1453: HDDS-4290. Enable insight point for SCM heartbeat protocol

2020-09-29 Thread GitBox
amaliujia commented on pull request #1453: URL: https://github.com/apache/hadoop-ozone/pull/1453#issuecomment-700941359 +1! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #1452: HDDS-4288. the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread GitBox
vivekratnavel merged pull request #1452: URL: https://github.com/apache/hadoop-ozone/pull/1452 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #1452: HDDS-4288. the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread GitBox
vivekratnavel commented on pull request #1452: URL: https://github.com/apache/hadoop-ozone/pull/1452#issuecomment-700910350 @elek Thanks for working on this! I noticed this weird big logo on the docs recently but didn't have the bandwidth to fix it.

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1444: HDDS-4242. Copy PrefixInfo proto to new project hadoop-ozone/interface-storage

2020-09-29 Thread GitBox
amaliujia commented on pull request #1444: URL: https://github.com/apache/hadoop-ozone/pull/1444#issuecomment-700874303 @elek your suggestion make senses as the new util classes are dedicated to be used by `interface-storage`. If it is even dedicated to be used by a `codec` class, it can

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#issuecomment-700860595 Thanks again @bharatviswa504 for the comments. Uploaded patch addressing the comments. Please let me know the feedback!

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1454: HDDS-4285. Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread GitBox
adoroszlai commented on a change in pull request #1454: URL: https://github.com/apache/hadoop-ozone/pull/1454#discussion_r496889816 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/storage/ContainerProtocolCalls.java ## @@ -84,7 +86,8 @@ private

[jira] [Updated] (HDDS-4227) Implement a "prepareForUpgrade" step that applies all committed transactions onto the OM state machine.

2020-09-29 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4227: Resolution: Fixed Status: Resolved (was: Patch Available) Merged PR. > Implement

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1430: HDDS-4227. Implement a 'Prepare For Upgrade' step in OM that applies all committed Ratis transactions.

2020-09-29 Thread GitBox
avijayanhwx merged pull request #1430: URL: https://github.com/apache/hadoop-ozone/pull/1430 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1430: HDDS-4227. Implement a 'Prepare For Upgrade' step in OM that applies all committed Ratis transactions.

2020-09-29 Thread GitBox
avijayanhwx commented on pull request #1430: URL: https://github.com/apache/hadoop-ozone/pull/1430#issuecomment-700837411 Thank you for the reviews @linyiqun, @fapifta & @swagle. Merging this. This is an automated message

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496831469 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmDirectoryInfo.java ## @@ -0,0 +1,266 @@ +/** + *

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1454: HDDS-4285. Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread GitBox
linyiqun commented on a change in pull request #1454: URL: https://github.com/apache/hadoop-ozone/pull/1454#discussion_r496819670 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/storage/ContainerProtocolCalls.java ## @@ -84,7 +86,8 @@ private

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496824181 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMDirectoryCreateRequestV1.java ## @@ -0,0

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496824421 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -129,6 +134,131 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
bharatviswa504 commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496823617 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -129,6 +134,131 @@

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496821295 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequestV1.java ## @@ -0,0 +1,323

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496820524 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequestV1.java ## @@ -0,0 +1,312

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496819566 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -129,6 +134,131 @@ public

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496818679 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -129,6 +134,131 @@ public

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496818679 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMFileRequest.java ## @@ -129,6 +134,131 @@ public

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496815568 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequestV1.java ## @@ -0,0 +1,323

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496813934 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/file/TestOMDirectoryCreateRequestV1.java ## @@ -0,0

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-29 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r496812987 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmDirectoryInfo.java ## @@ -0,0 +1,266 @@ +/** + * Licensed to

[jira] [Updated] (HDDS-4285) Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4285: - Labels: pull-request-available (was: ) > Read is slow due to frequent calls to

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1454: HDDS-4285. Read is slow due to the frequent usage of UGI.getCurrentUser Call()

2020-09-29 Thread GitBox
adoroszlai opened a new pull request #1454: URL: https://github.com/apache/hadoop-ozone/pull/1454 ## What changes were proposed in this pull request? Reduce the number of `getCurrentUser()` and `getTokens()` calls performed during some `ContainerProtocolCalls` operations. This is

[jira] [Updated] (HDDS-4285) Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens()

2020-09-29 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4285: --- Summary: Read is slow due to frequent calls to UGI.getCurrentUser() and getTokens() (was:

[jira] [Created] (HDDS-4291) "GDPR Compliance" Feature Should Be Renamed

2020-09-29 Thread Michael O'Kane (Jira)
Michael O'Kane created HDDS-4291: Summary: "GDPR Compliance" Feature Should Be Renamed Key: HDDS-4291 URL: https://issues.apache.org/jira/browse/HDDS-4291 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-29 Thread GitBox
captainzmc commented on pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#issuecomment-700751283 Thanks @adoroszlai’s review, I have already fixed the review issues, can you help take another look? [CI is normal in my personal

[jira] [Updated] (HDDS-4290) Enable insight point for SCM heartbeat protocol

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4290: - Labels: pull-request-available (was: ) > Enable insight point for SCM heartbeat protocol >

[jira] [Updated] (HDDS-4184) Add Features menu for Chinese document.

2020-09-29 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4184: - Labels: newbie (was: ) > Add Features menu for Chinese document. >

[jira] [Updated] (HDDS-4258) Set GDPR to a Security submenu in EN and CN document.

2020-09-29 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4258: - Labels: newbie (was: ) > Set GDPR to a Security submenu in EN and CN document. >

[GitHub] [hadoop-ozone] elek opened a new pull request #1453: HDDS-4290. Enable insight point for SCM heartbeat protocol

2020-09-29 Thread GitBox
elek opened a new pull request #1453: URL: https://github.com/apache/hadoop-ozone/pull/1453 ## What changes were proposed in this pull request? The registration of the already implemented insight-point seems to be missing. ## What is the link to the Apache JIRA

[jira] [Created] (HDDS-4290) Enable insight point for SCM heartbeat protocol

2020-09-29 Thread Marton Elek (Jira)
Marton Elek created HDDS-4290: - Summary: Enable insight point for SCM heartbeat protocol Key: HDDS-4290 URL: https://issues.apache.org/jira/browse/HDDS-4290 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4288) the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4288: - Labels: pull-request-available (was: ) > the icon of hadoop-ozone is bigger than ever >

[GitHub] [hadoop-ozone] elek opened a new pull request #1452: HDDS-4288. the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread GitBox
elek opened a new pull request #1452: URL: https://github.com/apache/hadoop-ozone/pull/1452 ## What changes were proposed in this pull request? Logo is too big on doc snapshot (generated by the Jenkins):

[jira] [Commented] (HDDS-4288) the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203905#comment-17203905 ] Marton Elek commented on HDDS-4288: --- Thanks to report this issue. I think it's not related to HDDS-4166,

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496643970 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCMPipelineManager.java ## @@ -619,9 +619,9 @@ private

[jira] [Assigned] (HDDS-4288) the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek reassigned HDDS-4288: - Assignee: Marton Elek > the icon of hadoop-ozone is bigger than ever >

[jira] [Resolved] (HDDS-4215) update freon doc.

2020-09-29 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-4215. --- Target Version/s: 1.1.0 Resolution: Fixed > update freon doc. > - > >

[GitHub] [hadoop-ozone] elek merged pull request #1403: HDDS-4215. update freon doc.

2020-09-29 Thread GitBox
elek merged pull request #1403: URL: https://github.com/apache/hadoop-ozone/pull/1403 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-29 Thread GitBox
captainzmc commented on a change in pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#discussion_r496662068 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/rpc/RpcClient.java ## @@ -441,6 +431,8 @@ public void

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496627193 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/RatisPipelineProvider.java ## @@ -121,18 +158,24 @@

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496643970 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCMPipelineManager.java ## @@ -619,9 +619,9 @@ private

[GitHub] [hadoop-ozone] ChenSammi merged pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
ChenSammi merged pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496643970 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCMPipelineManager.java ## @@ -619,9 +619,9 @@ private

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
ChenSammi commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-700642125 Thanks @sodonnel and @linyiqun for the review. Basically I think report handler is not a good place to handle all the empty container deletion process. It can

[jira] [Updated] (HDDS-4232) Use single thread for KeyDeletingService

2020-09-29 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4232: --- Labels: (was: pull-request-available) > Use single thread for KeyDeletingService >

[jira] [Resolved] (HDDS-4232) Use single thread for KeyDeletingService

2020-09-29 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4232. Fix Version/s: 1.1.0 Resolution: Fixed > Use single thread for KeyDeletingService >

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1415: HDDS-4232. Use single thread for KeyDeletingService.

2020-09-29 Thread GitBox
adoroszlai merged pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService.

2020-09-29 Thread GitBox
adoroszlai commented on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-700638453 Thanks @lokeshj1703 for the fix and @amaliujia and @bharatviswa504 for the review. This is an

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1407: HDDS-4158. Provide a class type for Java based configuration

2020-09-29 Thread GitBox
adoroszlai commented on a change in pull request #1407: URL: https://github.com/apache/hadoop-ozone/pull/1407#discussion_r496629283 ## File path: hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/conf/SimpleConfiguration.java ## @@ -93,4 +98,12 @@ public int getPort() {

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496628424 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/protocol/commands/CreatePipelineCommand.java ## @@ -48,16

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496628148 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/transport/server/ratis/XceiverServerRatis.java

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496627193 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/RatisPipelineProvider.java ## @@ -121,18 +158,24 @@

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
runzhiwang commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496624353 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineStateManager.java ## @@ -59,7 +59,8 @@ void

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-29 Thread GitBox
adoroszlai commented on a change in pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#discussion_r496617299 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/rpc/RpcClient.java ## @@ -441,6 +431,8 @@ public void

[GitHub] [hadoop-ozone] linyiqun edited a comment on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
linyiqun edited a comment on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-700598266 > @linyiqun I do agree that I think this could be handled more cleanly and efficiently in the container report handler. However its probably not much of an

[GitHub] [hadoop-ozone] linyiqun commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
linyiqun commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-700598266 > @linyiqun I do agree that I think this could be handled more cleanly and efficiently in the container report handler. However its probably not much of an overhead for

[jira] [Created] (HDDS-4289) Throw exception from hadoop2 filesystem jar in HA environment

2020-09-29 Thread Marton Elek (Jira)
Marton Elek created HDDS-4289: - Summary: Throw exception from hadoop2 filesystem jar in HA environment Key: HDDS-4289 URL: https://issues.apache.org/jira/browse/HDDS-4289 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] sodonnel commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
sodonnel commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-700582338 > There is following logic in ReplicatioManager, which will handle the replicas reported during container state is DELETING. Sorry I missed that. You are correct. I

[GitHub] [hadoop-ozone] lokeshj1703 commented on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService.

2020-09-29 Thread GitBox
lokeshj1703 commented on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-700573211 /ready This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HDDS-4231) Background Service blocks on task results

2020-09-29 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4231: --- Labels: (was: pull-request-available) > Background Service blocks on task results >

[jira] [Updated] (HDDS-4231) Background Service blocks on task results

2020-09-29 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4231: --- Fix Version/s: 1.1.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-29 Thread GitBox
linyiqun commented on a change in pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#discussion_r496544696 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ReplicationManager.java ## @@ -320,6 +331,12 @@ private

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1414: HDDS-4231. Background Service blocks on task results.

2020-09-29 Thread GitBox
adoroszlai commented on pull request #1414: URL: https://github.com/apache/hadoop-ozone/pull/1414#issuecomment-700548576 Thanks @lokeshj1703 for the contribution and @amaliujia and @nandakumar131 for the review. This is an

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1414: HDDS-4231. Background Service blocks on task results.

2020-09-29 Thread GitBox
adoroszlai merged pull request #1414: URL: https://github.com/apache/hadoop-ozone/pull/1414 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
GlenGeng commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496533516 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/protocol/commands/CreatePipelineCommand.java ## @@ -39,6 +42,7

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-29 Thread GitBox
GlenGeng commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r496496531 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/protocol/commands/CreatePipelineCommand.java ## @@ -48,16 +52,37

[jira] [Created] (HDDS-4288) the icon of hadoop-ozone is begger than ever

2020-09-29 Thread Shiyou xin (Jira)
Shiyou xin created HDDS-4288: Summary: the icon of hadoop-ozone is begger than ever Key: HDDS-4288 URL: https://issues.apache.org/jira/browse/HDDS-4288 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4288) the icon of hadoop-ozone is bigger than ever

2020-09-29 Thread Shiyou xin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyou xin updated HDDS-4288: - Summary: the icon of hadoop-ozone is bigger than ever (was: the icon of hadoop-ozone is begger than

  1   2   >