[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486442745 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486438477 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#issuecomment-690376470 > Thank You @elek for the design document. > > My understanding from this is the draft is as below. Let me know if I am missing something here. >

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486443111 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-10 Thread GitBox
captainzmc commented on pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#issuecomment-690427621 Hi @ChenSammi @cxorm, This PR is a bucket quota shell based on #1233 volume quota shell. Could you help review it?

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 commented on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690583817 Hi @lokeshj1703 https://issues.apache.org/jira/browse/HDDS-4121 This Jira changes the behavior with this openKeyCleanup service does not call SCM directly, it

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486439769 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486441102 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486535317 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1416: HDDS-4233. Interrupted exeception printed out from DatanodeStateMachine

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1416: URL: https://github.com/apache/hadoop-ozone/pull/1416#discussion_r486500932 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/DatanodeStateMachine.java ## @@

[jira] [Resolved] (HDDS-4196) Add an endpoint in Recon to query Prometheus

2020-09-10 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian resolved HDDS-4196. -- Resolution: Fixed > Add an endpoint in Recon to query Prometheus >

[jira] [Commented] (HDDS-4229) Upload Ozone 1.0.0 sources jars to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193826#comment-17193826 ] Siyao Meng commented on HDDS-4229: -- Any idea what tools I should use to properly (build and)

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486439055 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1414: HDDS-4231. Background Service blocks on task results.

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1414: URL: https://github.com/apache/hadoop-ozone/pull/1414#discussion_r486505162 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/utils/BackgroundService.java ## @@ -62,11 +56,11 @@ public

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486437934 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1314: HDDS-3988: DN can distinguish SCMCommand from stale leader SCM

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1314: URL: https://github.com/apache/hadoop-ozone/pull/1314#discussion_r486495949 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/ha/MockSCMHAManager.java ## @@ -78,8 +79,8 @@ public void start()

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#discussion_r486502026 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyDeletingService.java ## @@ -66,9 +66,6 @@ private static

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1414: HDDS-4231. Background Service blocks on task results.

2020-09-10 Thread GitBox
amaliujia commented on pull request #1414: URL: https://github.com/apache/hadoop-ozone/pull/1414#issuecomment-690532823 +1 tried to review this PR and it looks good to me. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1398: HDDS-4210. ResolveBucket during checkAcls fails.

2020-09-10 Thread GitBox
bharatviswa504 commented on a change in pull request #1398: URL: https://github.com/apache/hadoop-ozone/pull/1398#discussion_r486559825 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3523,6 +3533,47 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 edited a comment on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690583817 Hi @lokeshj1703 https://issues.apache.org/jira/browse/HDDS-4121 This Jira changes the behavior of openKeyCleanup service, and does not call SCM directly,

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 edited a comment on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690583817 Hi @lokeshj1703 https://issues.apache.org/jira/browse/HDDS-4121 This Jira changes the behavior with this openKeyCleanup service does not call SCM

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#discussion_r486502026 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyDeletingService.java ## @@ -66,9 +66,6 @@ private static

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486441859 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread GitBox
amaliujia commented on pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413#issuecomment-690526588 LGTM! Thanks! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1398: HDDS-4210. ResolveBucket during checkAcls fails.

2020-09-10 Thread GitBox
bharatviswa504 commented on a change in pull request #1398: URL: https://github.com/apache/hadoop-ozone/pull/1398#discussion_r486559825 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3523,6 +3533,47 @@ public

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1398: HDDS-4210. ResolveBucket during checkAcls fails.

2020-09-10 Thread GitBox
bharatviswa504 commented on a change in pull request #1398: URL: https://github.com/apache/hadoop-ozone/pull/1398#discussion_r486559825 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3523,6 +3533,47 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486757610 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,280 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 edited a comment on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690583817 Hi @lokeshj1703 [HDDS-4120](https://issues.apache.org/jira/browse/HDDS-4120) This Jira changes the behavior of openKeyCleanup service, and does not call

[jira] [Updated] (HDDS-3805) [OFS] Remove usage of OzoneClientAdapter interface

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3805: - Priority: Minor (was: Major) > [OFS] Remove usage of OzoneClientAdapter interface >

[jira] [Commented] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193955#comment-17193955 ] Li Cheng commented on HDDS-4228: PR is merged. Thanks [~glengeng] for working on this. > add field 'num'

[GitHub] [hadoop-ozone] timmylicheng merged pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread GitBox
timmylicheng merged pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Resolved] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-4228. Fix Version/s: 1.1.0 Resolution: Fixed > add field 'num' to ALLOCATE_BLOCK of scm audit log. >

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #1390: HDDS-4196. Add an endpoint in Recon to query Prometheus

2020-09-10 Thread GitBox
vivekratnavel merged pull request #1390: URL: https://github.com/apache/hadoop-ozone/pull/1390 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HDDS-4229) Upload Ozone 1.0.0 sources jars to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4229: - Description: ozone artifacts on Apache maven repo doesn't have the corresponding sources jars. This

[jira] [Updated] (HDDS-4229) Upload Ozone 1.0.0 sources jars to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4229: - Description: ozone artifacts on Apache maven repo doesn't have the corresponding sources jars. This

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
bharatviswa504 commented on pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#issuecomment-690808157 > > Thank You @elek for the design document. > > My understanding from this is the draft is as below. Let me know if I am missing something here. > >

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread GitBox
timmylicheng commented on pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413#issuecomment-690833613 Merging This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (HDDS-4234) Add comment to ListVolumes logic

2020-09-10 Thread Xie Lei (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xie Lei updated HDDS-4234: -- Description: when do following command, the statistics of list request is 2 {code:java} ozone sh volume ls

[jira] [Updated] (HDDS-4234) Add comment to ListVolumes logic

2020-09-10 Thread Xie Lei (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xie Lei updated HDDS-4234: -- Attachment: image-2020-09-11-11-23-50-504.png > Add comment to ListVolumes logic >

[jira] [Created] (HDDS-4234) Add comment to ListVolumes logic

2020-09-10 Thread Xie Lei (Jira)
Xie Lei created HDDS-4234: - Summary: Add comment to ListVolumes logic Key: HDDS-4234 URL: https://issues.apache.org/jira/browse/HDDS-4234 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-4229) Upload Ozone 1.0.0 sources jars to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4229: - Description: ozone artifacts on Apache maven repo doesn't have the corresponding sources jars. This

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 commented on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690739465 And also a question, these are expired Keys in the openKeyTable, how for the same block 2 threads can send the request before. And also I see there is no logic for

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1214: HDDS-3981. Add more debug level log to XceiverClientGrpc for debug purpose

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1214: URL: https://github.com/apache/hadoop-ozone/pull/1214#discussion_r486649479 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ## @@ -354,7 +363,7 @@ private

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1214: HDDS-3981. Add more debug level log to XceiverClientGrpc for debug purpose

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1214: URL: https://github.com/apache/hadoop-ozone/pull/1214#discussion_r486650134 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ## @@ -354,7 +363,7 @@ private

[GitHub] [hadoop-ozone] bharatviswa504 removed a comment on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 removed a comment on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690739465 And also a question, these are expired Keys in the openKeyTable, how for the same block 2 threads can send the request before. And also I see there is no

[jira] [Updated] (HDDS-4234) Add importent comment to ListVolumes logic

2020-09-10 Thread Xie Lei (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xie Lei updated HDDS-4234: -- Summary: Add importent comment to ListVolumes logic (was: Add comment to ListVolumes logic) > Add importent

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1340: HDDS-3188 Add failover proxy for SCM block location.

2020-09-10 Thread GitBox
timmylicheng commented on pull request #1340: URL: https://github.com/apache/hadoop-ozone/pull/1340#issuecomment-690835337 > The client failover logic is based on the suggested leader sent by SCM. The `String` value of suggested leader sent by SCM Server is `RaftPeer#getAddress`, but at

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
bharatviswa504 edited a comment on pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415#issuecomment-690583817 Hi @lokeshj1703 [HDDS-4120](https://issues.apache.org/jira/browse/HDDS-4120) This Jira changes the behavior of openKeyCleanup service, and does not call

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1214: HDDS-3981. Add more debug level log to XceiverClientGrpc for debug purpose

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1214: URL: https://github.com/apache/hadoop-ozone/pull/1214#discussion_r486652573 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ## @@ -339,6 +343,11 @@ private

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1340: HDDS-3188 Add failover proxy for SCM block location.

2020-09-10 Thread GitBox
timmylicheng commented on a change in pull request #1340: URL: https://github.com/apache/hadoop-ozone/pull/1340#discussion_r486736129 ## File path: hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/scm/proxy/SCMBlockLocationFailoverProxyProvider.java ## @@ -0,0

[GitHub] [hadoop-ozone] lamber-ken opened a new pull request #1417: HDDS-4324. Add importent comment to ListVolumets logic

2020-09-10 Thread GitBox
lamber-ken opened a new pull request #1417: URL: https://github.com/apache/hadoop-ozone/pull/1417 ## What changes were proposed in this pull request? when execute `ozone sh volume ls` command only once, but the the statistics of list request is 2. After delved into logic, it

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486760564 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-10 Thread GitBox
amaliujia commented on a change in pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#discussion_r486775970 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneBucket.java ## @@ -174,6 +184,20 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486761072 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r486775263 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneVolume.java ## @@ -131,6 +133,18 @@ public

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
xiaoyuyao commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486761554 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,280 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1405: HDDS-4143. Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-10 Thread GitBox
fapifta commented on a change in pull request #1405: URL: https://github.com/apache/hadoop-ozone/pull/1405#discussion_r486213861 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketSetPropertyRequest.java ## @@ -206,4

[jira] [Created] (HDDS-4230) CLONE - Add failover proxy to SCM block protocol

2020-09-10 Thread Glen Geng (Jira)
Glen Geng created HDDS-4230: --- Summary: CLONE - Add failover proxy to SCM block protocol Key: HDDS-4230 URL: https://issues.apache.org/jira/browse/HDDS-4230 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4230) SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException

2020-09-10 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4230: Description: like OMFailoverProxyProvider,  SCMBlockLocationFailoverProxyProvider should also handle

[jira] [Created] (HDDS-4232) Use single thread for KeyDeletingService and OpenKeyCleanupService

2020-09-10 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-4232: - Summary: Use single thread for KeyDeletingService and OpenKeyCleanupService Key: HDDS-4232 URL: https://issues.apache.org/jira/browse/HDDS-4232 Project: Hadoop Distributed

[jira] [Updated] (HDDS-4232) Use single thread for KeyDeletingService and OpenKeyCleanupService

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4232: - Labels: pull-request-available (was: ) > Use single thread for KeyDeletingService and

[GitHub] [hadoop-ozone] lokeshj1703 opened a new pull request #1415: HDDS-4232. Use single thread for KeyDeletingService and OpenKeyCleanupService.

2020-09-10 Thread GitBox
lokeshj1703 opened a new pull request #1415: URL: https://github.com/apache/hadoop-ozone/pull/1415 ## What changes were proposed in this pull request? KeyDeletingService and OpenKeyCleanupService scan the keys from a particular rocksdb table and sends deletion request to SCM. Every

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1314: HDDS-3988: DN can distinguish SCMCommand from stale leader SCM

2020-09-10 Thread GitBox
GlenGeng commented on a change in pull request #1314: URL: https://github.com/apache/hadoop-ozone/pull/1314#discussion_r486282159 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/ha/MockSCMHAManager.java ## @@ -78,8 +79,8 @@ public void start()

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1340: HDDS-3188 Add failover proxy for SCM block location.

2020-09-10 Thread GitBox
timmylicheng commented on a change in pull request #1340: URL: https://github.com/apache/hadoop-ozone/pull/1340#discussion_r486199846 ## File path: hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/scm/proxy/SCMBlockLocationFailoverProxyProvider.java ## @@ -0,0

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1340: HDDS-3188 Add failover proxy for SCM block location.

2020-09-10 Thread GitBox
timmylicheng commented on a change in pull request #1340: URL: https://github.com/apache/hadoop-ozone/pull/1340#discussion_r486199021 ## File path: hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/scm/proxy/SCMBlockLocationFailoverProxyProvider.java ## @@ -0,0

[GitHub] [hadoop-ozone] fapifta edited a comment on pull request #1405: HDDS-4143. Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-10 Thread GitBox
fapifta edited a comment on pull request #1405: URL: https://github.com/apache/hadoop-ozone/pull/1405#issuecomment-690123594 Hi @avijayanhwx, thank you for working on this. Please find some comments below. 1. First and foremost I would like to comment on the

[GitHub] [hadoop-ozone] fapifta commented on pull request #1405: HDDS-4143. Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-10 Thread GitBox
fapifta commented on pull request #1405: URL: https://github.com/apache/hadoop-ozone/pull/1405#issuecomment-690123594 Hi @avijayanhwx, thank you for working on this. Please find some comments below. 1. First and foremost I would like to comment on the

[jira] [Created] (HDDS-4231) Background Service blocks on task results

2020-09-10 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-4231: - Summary: Background Service blocks on task results Key: HDDS-4231 URL: https://issues.apache.org/jira/browse/HDDS-4231 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4231) Background Service blocks on task results

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4231: - Labels: pull-request-available (was: ) > Background Service blocks on task results >

[GitHub] [hadoop-ozone] lokeshj1703 opened a new pull request #1414: HDDS-4231. Background Service blocks on task results.

2020-09-10 Thread GitBox
lokeshj1703 opened a new pull request #1414: URL: https://github.com/apache/hadoop-ozone/pull/1414 ## What changes were proposed in this pull request? Background service currently waits on the results of the tasks. The idea is to track the time it took for the task to execute and

[jira] [Updated] (HDDS-4230) SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException

2020-09-10 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4230: Description: like OMFailoverProxyProvider,  (was: Need to supports 2N + 1 SCMs. Add configs and logic to

[GitHub] [hadoop-ozone] captainzmc closed pull request #1337: HDDS-4129. change MAX_QUOTA_IN_BYTES to Long.MAX_VALUE.

2020-09-10 Thread GitBox
captainzmc closed pull request #1337: URL: https://github.com/apache/hadoop-ozone/pull/1337 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-4230) SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException

2020-09-10 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4230: Summary: SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException (was: CLONE - Add

[jira] [Updated] (HDDS-4230) SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException

2020-09-10 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4230: Description: It is an enhancement for HDDS-3188. Like OMFailoverProxyProvider,

[jira] [Assigned] (HDDS-4230) SCMBlockLocationFailoverProxyProvider should handle LeaderNotReadyException

2020-09-10 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng reassigned HDDS-4230: --- Assignee: (was: Li Cheng) > SCMBlockLocationFailoverProxyProvider should handle

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1314: HDDS-3988: DN can distinguish SCMCommand from stale leader SCM

2020-09-10 Thread GitBox
GlenGeng commented on a change in pull request #1314: URL: https://github.com/apache/hadoop-ozone/pull/1314#discussion_r486281665 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/StateContext.java ## @@ -478,7

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1290: HDDS-4064. Show container verbose info with verbose option

2020-09-10 Thread GitBox
maobaolong commented on pull request #1290: URL: https://github.com/apache/hadoop-ozone/pull/1290#issuecomment-690015532 @adoroszlai @xiaoyuyao @elek Thanks for your review. This is an automated message from the Apache Git

[jira] [Resolved] (HDDS-4064) Show container verbose info with verbose option

2020-09-10 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDDS-4064. -- Fix Version/s: 1.1.0 Resolution: Fixed > Show container verbose info with verbose option >

[GitHub] [hadoop-ozone] GlenGeng commented on a change in pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-10 Thread GitBox
GlenGeng commented on a change in pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#discussion_r486090313 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/ratis/RatisHelper.java ## @@ -125,6 +131,17 @@ private static RaftGroup

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1407: HDDS-4158. Provide a class type for Java based configuration

2020-09-10 Thread GitBox
maobaolong commented on pull request #1407: URL: https://github.com/apache/hadoop-ozone/pull/1407#issuecomment-690017443 @adoroszlai Please take a look at this PR, it will help us to use the `Java based configuration` conveniently.

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread GitBox
timmylicheng commented on pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413#issuecomment-690017940 LGTM. +1 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (HDDS-4229) Upload Ozone 1.0.0 sources jars to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4229: - Summary: Upload Ozone 1.0.0 sources jars to Apache maven repo (was: Upload Ozone 1.0.0 sources jar to

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4228: - Labels: pull-request-available pull-requests-available (was: pull-requests-available) > add

[jira] [Created] (HDDS-4229) Upload Ozone 1.0.0 sources jar to Apache maven repo

2020-09-10 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-4229: Summary: Upload Ozone 1.0.0 sources jar to Apache maven repo Key: HDDS-4229 URL: https://issues.apache.org/jira/browse/HDDS-4229 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4233) Interrupted exeception printed out from DatanodeStateMachine

2020-09-10 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-4233: -- Summary: Interrupted exeception printed out from DatanodeStateMachine (was: Interrupted execption

[jira] [Updated] (HDDS-4233) Interrupted exeception printed out from DatanodeStateMachine

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4233: - Labels: pull-request-available (was: ) > Interrupted exeception printed out from

[GitHub] [hadoop-ozone] elek opened a new pull request #1416: HDDS-4233. Interrupted exeception printed out from DatanodeStateMachine

2020-09-10 Thread GitBox
elek opened a new pull request #1416: URL: https://github.com/apache/hadoop-ozone/pull/1416 ## What changes were proposed in this pull request? Hide Interrupted exceptions from WARN level as they are expected. ## What is the link to the Apache JIRA

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486417710 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename,

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486418379 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename,

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486423208 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename,

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486424461 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename,

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486428009 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486428560 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486429661 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486432322 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486433552 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-10 Thread GitBox
elek commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r486434809 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to support both

[jira] [Created] (HDDS-4233) Interrupted execption printed out from DatanodeStateMachine

2020-09-10 Thread Marton Elek (Jira)
Marton Elek created HDDS-4233: - Summary: Interrupted execption printed out from DatanodeStateMachine Key: HDDS-4233 URL: https://issues.apache.org/jira/browse/HDDS-4233 Project: Hadoop Distributed Data