[jira] [Updated] (HDDS-4189) Use a unified Cli syntax for both getting OM and SCM status

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4189: - Labels: pull-request-available (was: ) > Use a unified Cli syntax for both getting OM and SCM

[GitHub] [hadoop-ozone] cxorm edited a comment on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-09-01 Thread GitBox
cxorm edited a comment on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-685179614 Thank you @captainzmc for updating the PR. Could you rebase it with latest master branch ? This PR looks good to me, +1 (Would you be so kind to take a look

[GitHub] [hadoop-ozone] amaliujia opened a new pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia opened a new pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375 ## What changes were proposed in this pull request? Change `ozone admin om getserviceroles` to `ozone admin om status` ## What is the link to the Apache JIRA

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
adoroszlai commented on a change in pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#discussion_r481521954 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/om/GetServiceRolesSubcommand.java ## @@ -30,10 +30,10 @@ import

[jira] [Assigned] (HDDS-3762) Intermittent failure in TestDeleteWithSlowFollower

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3762: -- Assignee: Attila Doroszlai > Intermittent failure in TestDeleteWithSlowFollower >

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1369: HDDS-4104. Provide a way to get the default value and key of java-based-configuration easily

2020-09-01 Thread GitBox
maobaolong commented on pull request #1369: URL: https://github.com/apache/hadoop-ozone/pull/1369#issuecomment-684589260 @elek Thanks to create the Java-based-Configuration framework, it is better than the hadoop configuration, but sometime, I want to get the default value or key name for

[GitHub] [hadoop-ozone] flirmnave commented on pull request #1368: HDDS-4156. add hierarchical layout to Chinese doc

2020-09-01 Thread GitBox
flirmnave commented on pull request #1368: URL: https://github.com/apache/hadoop-ozone/pull/1368#issuecomment-684447642 > Thanks for the work @flirmnave . > > According to what I see in localhost, it seems there are some subpages left. > >

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1370: HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1370: URL: https://github.com/apache/hadoop-ozone/pull/1370#discussion_r480881190 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestWatchForCommit.java ## @@ -297,9 +298,11 @@

[jira] [Assigned] (HDDS-4104) Provide a way to get the default value and key of java-based-configuration easily

2020-09-01 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong reassigned HDDS-4104: Assignee: maobaolong > Provide a way to get the default value and key of java-based-configuration

[jira] [Updated] (HDDS-4104) Provide a way to get the default value and key of java-based-configuration easily

2020-09-01 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-4104: - Issue Type: New Feature (was: Improvement) > Provide a way to get the default value and key of

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1329: HDDS-4077. Incomplete OzoneFileSystem statistics

2020-09-01 Thread GitBox
adoroszlai commented on pull request #1329: URL: https://github.com/apache/hadoop-ozone/pull/1329#issuecomment-684631539 Thanks @bshashikant for reviewing and merging this. This is an automated message from the Apache Git

[jira] [Created] (HDDS-4184) Add Features menu for Chinese document.

2020-09-01 Thread Zheng Huang-Mu (Jira)
Zheng Huang-Mu created HDDS-4184: Summary: Add Features menu for Chinese document. Key: HDDS-4184 URL: https://issues.apache.org/jira/browse/HDDS-4184 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4184) Add Features menu for Chinese document.

2020-09-01 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4184: - Environment: (was: !image-2020-09-01-14-24-44-703.png!) > Add Features menu for Chinese

[jira] [Updated] (HDDS-4184) Add Features menu for Chinese document.

2020-09-01 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4184: - Environment: !image-2020-09-01-14-24-44-703.png! (was: !image-2020-09-01-14-24-44-703.png! ) >

[jira] [Created] (HDDS-4185) Remove IncrementalByteBuffer from Ozone client

2020-09-01 Thread Marton Elek (Jira)
Marton Elek created HDDS-4185: - Summary: Remove IncrementalByteBuffer from Ozone client Key: HDDS-4185 URL: https://issues.apache.org/jira/browse/HDDS-4185 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1369: HDDS-4104. Provide a way to get the default value and key of java-based-configuration easily

2020-09-01 Thread GitBox
adoroszlai commented on a change in pull request #1369: URL: https://github.com/apache/hadoop-ozone/pull/1369#discussion_r480984328 ## File path: hadoop-hdds/config/src/test/java/org/apache/hadoop/hdds/conf/TestConfigurationReflectionUtil.java ## @@ -0,0 +1,71 @@ +/** + *

[jira] [Updated] (HDDS-4168) Remove reference to Skaffold in the README in dist/

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4168: - Labels: pull-request-available (was: ) > Remove reference to Skaffold in the README in dist/ >

[jira] [Updated] (HDDS-3457) When ACL enable, use ozonefs put key will get OMException: Key not found, checkAccess failed.

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3457: - Labels: pull-request-available (was: ) > When ACL enable, use ozonefs put key will get

[GitHub] [hadoop-ozone] sodonnel commented on pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-09-01 Thread GitBox
sodonnel commented on pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#issuecomment-684505875 I think this change is good to commit now? @adoroszlai gave a thumbs up a few days back and I have addressed the only concern @ChenSammi raised. I will commit

[jira] [Commented] (HDDS-4181) Add acceptance tests for upgrade, finalization and downgrade

2020-09-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188244#comment-17188244 ] Marton Elek commented on HDDS-4181: --- Related: HDDS-3855 which shows an initial attempt. > Add

[jira] [Comment Edited] (HDDS-4181) Add acceptance tests for upgrade, finalization and downgrade

2020-09-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188244#comment-17188244 ] Marton Elek edited comment on HDDS-4181 at 9/1/20, 8:10 AM: Related: HDDS-3855

[jira] [Assigned] (HDDS-4168) Remove reference to Skaffold in the README in dist/

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-4168: -- Assignee: Alex Scammon > Remove reference to Skaffold in the README in dist/ >

[GitHub] [hadoop-ozone] iamabug commented on a change in pull request #1368: HDDS-4156. add hierarchical layout to Chinese doc

2020-09-01 Thread GitBox
iamabug commented on a change in pull request #1368: URL: https://github.com/apache/hadoop-ozone/pull/1368#discussion_r480992755 ## File path: hadoop-hdds/docs/content/concept/_index.zh.md ## @@ -2,7 +2,7 @@ title: 概念 date: "2017-10-10" menu: main -weight: 6 +weight: 3

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1360: HDDS-4168. Remove archaic reference to Skaffold

2020-09-01 Thread GitBox
adoroszlai commented on pull request #1360: URL: https://github.com/apache/hadoop-ozone/pull/1360#issuecomment-684638663 @elek would you like to take a look at this doc improvement? This is an automated message from the

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481469131 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/protocol/StorageContainerLocationProtocol.java ## @@ -230,4 +230,5 @@

[GitHub] [hadoop-ozone] cxorm commented on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-09-01 Thread GitBox
cxorm commented on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-685179614 Thank you @captainzmc for updating the PR. Could you rebase it with latest master branch ? This PR looks good to me, +1 (cc @ChenSammi )

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1370: HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread GitBox
adoroszlai merged pull request #1370: URL: https://github.com/apache/hadoop-ozone/pull/1370 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1370: HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread GitBox
adoroszlai commented on pull request #1370: URL: https://github.com/apache/hadoop-ozone/pull/1370#issuecomment-685243200 Thanks @runzhiwang for the fix and @amaliujia for the review. This is an automated message from the

[jira] [Updated] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4176: --- Component/s: test > Fix failed UT: test2WayCommitForTimeoutException >

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
timmylicheng commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481557217 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/scm/GetScmRatisStatusSubcommand.java ## @@ -0,0 +1,26 @@ +package

[jira] [Updated] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4176: --- Labels: (was: pull-request-available) > Fix failed UT: test2WayCommitForTimeoutException >

[jira] [Resolved] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4176. Fix Version/s: 1.1.0 Resolution: Fixed > Fix failed UT:

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1376: HDDS-3762. Intermittent failure in TestDeleteWithSlowFollower

2020-09-01 Thread GitBox
adoroszlai opened a new pull request #1376: URL: https://github.com/apache/hadoop-ozone/pull/1376 ## What changes were proposed in this pull request? Intermittent failure in `testDeleteKeyWithSlowFollower` seems to be caused by: * `DeleteBlocksCommandHandler` increments

[jira] [Updated] (HDDS-3762) Intermittent failure in TestDeleteWithSlowFollower

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3762: - Labels: pull-request-available (was: ) > Intermittent failure in TestDeleteWithSlowFollower >

[jira] [Created] (HDDS-4189) Use a unified Cli syntax for both getting OM and SCM status

2020-09-01 Thread Rui Wang (Jira)
Rui Wang created HDDS-4189: -- Summary: Use a unified Cli syntax for both getting OM and SCM status Key: HDDS-4189 URL: https://issues.apache.org/jira/browse/HDDS-4189 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481469412 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/shell/TestScmAdminHA.java ## @@ -0,0 +1,66 @@ +package

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia commented on pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#issuecomment-685181181 R: @adoroszlai @timmylicheng This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4176: - Labels: pull-request-available (was: ) > Fix failed UT: test2WayCommitForTimeoutException >

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #1364: HDDS-4165. GitHub Actions cache does not work outside of workspace

2020-09-01 Thread GitBox
vivekratnavel commented on pull request #1364: URL: https://github.com/apache/hadoop-ozone/pull/1364#issuecomment-685272723 @adoroszlai Thanks for fixing this! +1 LGTM This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia commented on pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#issuecomment-685211998 Thank you for your review @cxorm! ``` [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 4.417 s <<< FAILURE! - in

[jira] [Created] (HDDS-4190) Intermittent failure in TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-01 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4190: -- Summary: Intermittent failure in TestOMAllocateBlockRequest#testValidateAndUpdateCache Key: HDDS-4190 URL: https://issues.apache.org/jira/browse/HDDS-4190

[GitHub] [hadoop-ozone] cxorm commented on pull request #1367: HDDS-4169. Fix some minor errors in StorageContainerManager.md

2020-09-01 Thread GitBox
cxorm commented on pull request #1367: URL: https://github.com/apache/hadoop-ozone/pull/1367#issuecomment-685254966 The failed `build-branch / unit (pull_request)` seems not related the patch. Let's commit it again. This

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1340: HDDS-3188 Enable SCM group with failover proxy for SCM block location.

2020-09-01 Thread GitBox
amaliujia commented on pull request #1340: URL: https://github.com/apache/hadoop-ozone/pull/1340#issuecomment-685271344 This PR overall LGTM This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-685173208 Addressed the following comments 1. Merge `getRatisStatus` with `GetScmInfo` 2. Adopt command syntax `ozone admin scm status` 3. added an acceptance test

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1371: HDDS-2922. Balance ratis leader distribution in datanodes

2020-09-01 Thread GitBox
amaliujia commented on pull request #1371: URL: https://github.com/apache/hadoop-ozone/pull/1371#issuecomment-685181887 Thanks @runzhiwang. This is an awesome work! I will also try to help review this PR. This is an

[GitHub] [hadoop-ozone] cxorm commented on pull request #1075: HDDS-3369. Cleanup old write-path of volume in OM

2020-09-01 Thread GitBox
cxorm commented on pull request #1075: URL: https://github.com/apache/hadoop-ozone/pull/1075#issuecomment-685191223 Thank you @adoroszlai for the advise. Splitting `OzoneManagerProtocol` interface is huge work IMHO. I think it is improper to change the interface after

[jira] [Commented] (HDDS-3762) Intermittent failure in TestDeleteWithSlowFollower

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188941#comment-17188941 ] Attila Doroszlai commented on HDDS-3762: I think the bug from description was fixed by HDDS-3964:

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-09-01 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r481477852 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/protocol/ClientProtocol.java ## @@ -101,10 +100,11 @@ void

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #912: WIP Patch - HDDS-2949: store dir/key entries in separate tables - first patch onl…

2020-09-01 Thread GitBox
github-actions[bot] commented on pull request #912: URL: https://github.com/apache/hadoop-ozone/pull/912#issuecomment-685206902 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author.

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #1173: HDDS-3880. Improve OM HA Robot test

2020-09-01 Thread GitBox
github-actions[bot] closed pull request #1173: URL: https://github.com/apache/hadoop-ozone/pull/1173 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #1173: HDDS-3880. Improve OM HA Robot test

2020-09-01 Thread GitBox
github-actions[bot] commented on pull request #1173: URL: https://github.com/apache/hadoop-ozone/pull/1173#issuecomment-685206895 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author.

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #912: WIP Patch - HDDS-2949: store dir/key entries in separate tables - first patch onl…

2020-09-01 Thread GitBox
github-actions[bot] closed pull request #912: URL: https://github.com/apache/hadoop-ozone/pull/912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] captainzmc commented on pull request #868: HDDS-3457. Fix ozonefs put and mkdir KEY_NOT_FOUND issue when ACL enable

2020-09-01 Thread GitBox
captainzmc commented on pull request #868: URL: https://github.com/apache/hadoop-ozone/pull/868#issuecomment-685244606 > Hi @captainzmc, > I enabled ACL and performed mkdir using o3fs, but 'checkAccess' function is never reached. I have put some System.out.println statements in

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
cxorm commented on a change in pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#discussion_r481576976 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/om/GetServiceRolesSubcommand.java ## @@ -30,10 +30,10 @@ import

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
adoroszlai commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481709338 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/scm/GetScmRatisStatusSubcommand.java ## @@ -0,0 +1,26 @@ +package

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481414123 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/scm/GetScmRatisStatusSubcommand.java ## @@ -0,0 +1,26 @@ +package

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1370: HDDS-4176. Fix failed UT: test2WayCommitForTimeoutException

2020-09-01 Thread GitBox
runzhiwang commented on a change in pull request #1370: URL: https://github.com/apache/hadoop-ozone/pull/1370#discussion_r481493152 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestWatchForCommit.java ## @@ -297,9 +298,11 @@

[jira] [Commented] (HDDS-4190) Intermittent failure in TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-01 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188923#comment-17188923 ] Attila Doroszlai commented on HDDS-4190: Similar assertions (failing intermittently when run

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#discussion_r481610070 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/om/GetServiceRolesSubcommand.java ## @@ -30,10 +30,10 @@ import

[jira] [Commented] (HDDS-3103) Have multi-raft pipeline calculator to recommend best pipeline number per datanode

2020-09-01 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188980#comment-17188980 ] Rui Wang commented on HDDS-3103: [~timmylicheng] Do you have a plan to work on this JIRA in near term?

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481746270 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/scm/GetScmRatisStatusSubcommand.java ## @@ -0,0 +1,26 @@ +package

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia commented on pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#issuecomment-685183677 Context: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481380452 This is an automated

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1375: HDDS-4189. Change `ozone admin om getserviceroles` to `ozone admin om status`

2020-09-01 Thread GitBox
amaliujia commented on pull request #1375: URL: https://github.com/apache/hadoop-ozone/pull/1375#issuecomment-685278548 It seemed that there is another opinion about what command name should be. So I will convert this PR to a draft now to wait for a consensus. Thanks for all

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
amaliujia commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481638257 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/scm/GetScmRatisStatusSubcommand.java ## @@ -0,0 +1,26 @@ +package

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Description: *The problem is:* If setup one Recon and one SCM, then shutdown the Recon server, all

[GitHub] [hadoop-ozone] GlenGeng opened a new pull request #1373: HDDS-4186: Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread GitBox
GlenGeng opened a new pull request #1373: URL: https://github.com/apache/hadoop-ozone/pull/1373 ## What changes were proposed in this pull request? Current RetryPolicy of Datanode for SCM is retryForeverWithFixedSleep: ``` RetryPolicy retryPolicy =

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4186: - Labels: pull-request-available (was: ) > Adjust RetryPolicy of SCMConnectionManager for

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Target Version/s: (was: 0.7.0) > Adjust RetryPolicy of SCMConnectionManager >

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Summary: Adjust RetryPolicy of SCMConnectionManager (was: CLONE - Improve performance of the BufferPool

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Labels: (was: pull-request-available) > Adjust RetryPolicy of SCMConnectionManager >

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Summary: Adjust RetryPolicy of SCMConnectionManager for SCM/Recon (was: Adjust RetryPolicy of

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Component/s: Ozone Datanode > Adjust RetryPolicy of SCMConnectionManager for SCM/Recon >

[jira] [Assigned] (HDDS-4186) CLONE - Improve performance of the BufferPool management of Ozone client

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng reassigned HDDS-4186: --- Assignee: Glen Geng (was: Marton Elek) > CLONE - Improve performance of the BufferPool management

[jira] [Created] (HDDS-4186) CLONE - Improve performance of the BufferPool management of Ozone client

2020-09-01 Thread Glen Geng (Jira)
Glen Geng created HDDS-4186: --- Summary: CLONE - Improve performance of the BufferPool management of Ozone client Key: HDDS-4186 URL: https://issues.apache.org/jira/browse/HDDS-4186 Project: Hadoop

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1192: HDDS-3947: Sort DNs for client when the key is a file for #getFileStatus #listStatus APIs

2020-09-01 Thread GitBox
adoroszlai commented on a change in pull request #1192: URL: https://github.com/apache/hadoop-ozone/pull/1192#discussion_r481025587 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/fs/OzoneManagerFS.java ## @@ -31,7 +31,18 @@ * Ozone Manager

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Description: Current RetryPolicy of Datanode for SCM is retryForeverWithFixedSleep: {code:java} RetryPolicy

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Description: Current RetryPolicy of Datanode for SCM is retryForeverWithFixedSleep: {code:java} RetryPolicy

[jira] [Updated] (HDDS-4119) Improve performance of the BufferPool management of Ozone client

2020-09-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-4119: -- Target Version/s: 1.0.1 (was: 1.1.0) > Improve performance of the BufferPool management of Ozone

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Description: Current RetryPolicy of Datanode for SCM is retryForeverWithFixedSleep: {code:java} RetryPolicy

[jira] [Updated] (HDDS-4186) Adjust RetryPolicy of SCMConnectionManager for SCM/Recon

2020-09-01 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4186: Description: *The problem is:* If setup one Recon and one SCM, then shutdown the Recon server, all

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #1298: HDDS-3869. Use different column families for datanode block and metadata

2020-09-01 Thread GitBox
hanishakoneru commented on a change in pull request #1298: URL: https://github.com/apache/hadoop-ozone/pull/1298#discussion_r476042841 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/impl/ContainerDataYaml.java ## @@ -280,6

[jira] [Assigned] (HDDS-4173) Implement HDDS Version management using the LayoutVersionManager interface.

2020-09-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-4173: - Assignee: Prashant Pogde > Implement HDDS Version management using the

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-09-01 Thread GitBox
bharatviswa504 commented on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-684950217 @elek There is no issue with this. As the other argument is when the flag is disabled to support HCFS. And I believe we have agreed on the part we need

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-09-01 Thread GitBox
bharatviswa504 edited a comment on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-684950217 @elek There is no issue with this, and I believe we have agreed on the part we need this like 100% HCFS with few changes to AWS S3 semantics. I don't see

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-09-01 Thread GitBox
bharatviswa504 edited a comment on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-684950217 @elek There is no issue with this. As the other argument is when the flag is disabled to support HCFS. And I believe we have agreed on the part we

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-09-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188586#comment-17188586 ] Arpit Agarwal commented on HDDS-4097: - If you always create them, then you are basically interpreting

[jira] [Comment Edited] (HDDS-4181) Add acceptance tests for upgrade, finalization and downgrade

2020-09-01 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188636#comment-17188636 ] Aravindan Vijayan edited comment on HDDS-4181 at 9/1/20, 4:49 PM: -- Thanks

[jira] [Commented] (HDDS-4181) Add acceptance tests for upgrade, finalization and downgrade

2020-09-01 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188636#comment-17188636 ] Aravindan Vijayan commented on HDDS-4181: - Thanks [~elek]. I have seen that changes, and planning

[jira] [Assigned] (HDDS-4175) Implement Datanode Finalization

2020-09-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-4175: - Assignee: Istvan Fajth > Implement Datanode Finalization >

[jira] [Assigned] (HDDS-4174) Add current HDDS layout version to Datanode heartbeat and registration.

2020-09-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-4174: - Assignee: Prashant Pogde > Add current HDDS layout version to Datanode heartbeat and

[jira] [Assigned] (HDDS-4178) SCM Finalize command implementation.

2020-09-01 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-4178: - Assignee: Istvan Fajth > SCM Finalize command implementation. >

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-09-01 Thread GitBox
bharatviswa504 edited a comment on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-684950217 @elek There is no issue with this, and I believe we have agreed on the part we need this like 100% HCFS with few changes to AWS S3 semantics. I don't see

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Description: 40 datanodes with 400, 000 containers, start recon with xmx:10G. After several hours,

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-09-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188536#comment-17188536 ] Marton Elek commented on HDDS-4097: --- [~arp] It was discussed with more details during the community sync

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-01 Thread GitBox
timmylicheng commented on a change in pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#discussion_r481135941 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMClientProtocolServer.java ## @@ -560,6 +563,13 @@

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-09-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188538#comment-17188538 ] Arpit Agarwal commented on HDDS-4097: - bq. Using simple, acceptable key names (/a/b/c, /a/b/c/d) both

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-09-01 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188544#comment-17188544 ] Marton Elek commented on HDDS-4097: --- > Unfortunately there is no way you can guarantee that. A

[jira] [Created] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
runzhiwang created HDDS-4187: Summary: Fix memory leak of recon Key: HDDS-4187 URL: https://issues.apache.org/jira/browse/HDDS-4187 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-4188) Fix Chinese document broken link.

2020-09-01 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4188: - Attachment: brokenLink.png > Fix Chinese document broken link. >

[jira] [Updated] (HDDS-4188) Fix Chinese document broken link.

2020-09-01 Thread Zheng Huang-Mu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Huang-Mu updated HDDS-4188: - Description: In Chinese document *Home/概念/概览*, There is a broken link. Look attachment

  1   2   >