[GitHub] [hadoop-ozone] amaliujia commented on pull request #1447: HDDS-4264. Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread GitBox
amaliujia commented on pull request #1447: URL: https://github.com/apache/hadoop-ozone/pull/1447#issuecomment-699255649 +1 on unifying the name convention. Though not sure which name convention is better :) Would also want to hear suggestions from @adoroszlai

[jira] [Updated] (HDDS-4273) Volume Namespace:`usedNamespace` works by `ozone sh vol info`

2020-09-25 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated HDDS-4273: --- Summary: Volume Namespace:`usedNamespace` works by `ozone sh vol info` (was: `usedNamespace` works by `ozone

[jira] [Resolved] (HDDS-3730) Support Namespace Level quota for bucket

2020-09-25 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved HDDS-3730. Resolution: Duplicate Has broken down this Jira to multiple smaller Jira > Support Namespace Level quota

[jira] [Created] (HDDS-4279) Bucket Namespace: support clear namespace quota

2020-09-25 Thread Rui Wang (Jira)
Rui Wang created HDDS-4279: -- Summary: Bucket Namespace: support clear namespace quota Key: HDDS-4279 URL: https://issues.apache.org/jira/browse/HDDS-4279 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4278) Bucket Namespace: check usedNamespace when create key in bucket

2020-09-25 Thread Rui Wang (Jira)
Rui Wang created HDDS-4278: -- Summary: Bucket Namespace: check usedNamespace when create key in bucket Key: HDDS-4278 URL: https://issues.apache.org/jira/browse/HDDS-4278 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-4277) Bucket Namespace: add namespaceQuotaUsage and update it when create and delete key in a bucket

2020-09-25 Thread Rui Wang (Jira)
Rui Wang created HDDS-4277: -- Summary: Bucket Namespace: add namespaceQuotaUsage and update it when create and delete key in a bucket Key: HDDS-4277 URL: https://issues.apache.org/jira/browse/HDDS-4277

[jira] [Resolved] (HDDS-3729) Support Namespace Level quota for Volume

2020-09-25 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved HDDS-3729. Resolution: Duplicate This is Jira is broken down to more smaller Jira. > Support Namespace Level quota

[jira] [Created] (HDDS-4276) Volume Namespace: support clear namespace quota

2020-09-25 Thread Rui Wang (Jira)
Rui Wang created HDDS-4276: -- Summary: Volume Namespace: support clear namespace quota Key: HDDS-4276 URL: https://issues.apache.org/jira/browse/HDDS-4276 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4275) Volume Namespace: check usedNamespace when create bucket

2020-09-25 Thread Rui Wang (Jira)
Rui Wang created HDDS-4275: -- Summary: Volume Namespace: check usedNamespace when create bucket Key: HDDS-4275 URL: https://issues.apache.org/jira/browse/HDDS-4275 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-25 Thread GitBox
ChenSammi commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-698899914 > Sorry for the slow reply on this. I have been caught up on some other things. > > > After a second thought, deleting the container record in SCM DB immediately

[jira] [Updated] (HDDS-4264) Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4264: - Labels: pull-request-available (was: ) > Uniform naming conventions of Ozone Shell Options. >

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #1447: HDDS-4264. Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread GitBox
captainzmc opened a new pull request #1447: URL: https://github.com/apache/hadoop-ozone/pull/1447 ## What changes were proposed in this pull request? Current Shell command of Ozone, some use hump connection, some use '-' connection. We need to unify the naming conventions. See

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1447: HDDS-4264. Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread GitBox
captainzmc commented on pull request #1447: URL: https://github.com/apache/hadoop-ozone/pull/1447#issuecomment-698921171 Hi @adoroszlai,Could you help review this PR? This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-09-25 Thread GitBox
captainzmc commented on a change in pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#discussion_r494297018 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/bucket/OMBucketDeleteResponse.java ## @@ -64,6 +76,12

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-09-25 Thread GitBox
amaliujia commented on pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#issuecomment-698104826 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (HDDS-4105) Bucket space: Supports clearing spaceQuota

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4105: Summary: Bucket space: Supports clearing spaceQuota (was: Volume space: update spaceQuota should

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1383: HDDS-4194. Create a script to check AWS S3 compatibility

2020-09-25 Thread GitBox
adoroszlai merged pull request #1383: URL: https://github.com/apache/hadoop-ozone/pull/1383 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-4194) Create a script to check AWS S3 compatibility

2020-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4194: - Labels: pull-request-available (was: ) > Create a script to check AWS S3 compatibility >

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-09-25 Thread GitBox
amaliujia commented on a change in pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#discussion_r494575654 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketCreateRequest.java ## @@ -201,6 +201,8

[GitHub] [hadoop-ozone] cxorm commented on pull request #1425: HDDS-2981 Add unit tests for Proto [de]serialization

2020-09-25 Thread GitBox
cxorm commented on pull request #1425: URL: https://github.com/apache/hadoop-ozone/pull/1425#issuecomment-698096286 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (HDDS-3728) Bucket space: check quotaUsageInBytes when write key

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3728: Summary: Bucket space: check quotaUsageInBytes when write key (was: Support Storage space Level

[jira] [Updated] (HDDS-2660) Create insight point for datanode container protocol

2020-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2660: - Labels: pull-request-available (was: ) > Create insight point for datanode container protocol >

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1272: HDDS-2660. Create insight point for datanode container protocol

2020-09-25 Thread GitBox
adoroszlai merged pull request #1272: URL: https://github.com/apache/hadoop-ozone/pull/1272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-25 Thread GitBox
sodonnel commented on a change in pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#discussion_r494180772 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -96,13 +101,24

[jira] [Updated] (HDDS-4105) Bucket space: Supports clearing spaceQuota

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4105: Description: Bucket space quota supports deleting spaceQuota. (was: update spaceQuota should check

[GitHub] [hadoop-ozone] bshashikant merged pull request #1442: HDDS-3297. Enable TestOzoneClientKeyGenerator.

2020-09-25 Thread GitBox
bshashikant merged pull request #1442: URL: https://github.com/apache/hadoop-ozone/pull/1442 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-25 Thread GitBox
captainzmc commented on pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#issuecomment-698132943 Hi all, status updates: rebase PR and resolve conflicts. This PR can be reviewed again. This is an

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1443: HDDS-4270. Add more reusable byteman scripts to debug ofs/o3fs performance

2020-09-25 Thread GitBox
adoroszlai merged pull request #1443: URL: https://github.com/apache/hadoop-ozone/pull/1443 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HDDS-4254) Bucket space: add usedBytes and update it when create and delete key

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202143#comment-17202143 ] mingchao zhao commented on HDDS-4254: - PR has been merged, close this. > Bucket space: add usedBytes

[jira] [Resolved] (HDDS-4254) Bucket space: add usedBytes and update it when create and delete key

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-4254. - Fix Version/s: 1.1.0 Resolution: Fixed > Bucket space: add usedBytes and update it when

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1443: HDDS-4270. Add more reusable byteman scripts to debug ofs/o3fs performance

2020-09-25 Thread GitBox
elek commented on a change in pull request #1443: URL: https://github.com/apache/hadoop-ozone/pull/1443#discussion_r494239916 ## File path: dev-support/byteman/watchforcommit_all.btm ## @@ -0,0 +1,47 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[jira] [Updated] (HDDS-4053) Volume space: add quotaUsageInBytes and update it when create and delete key

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4053: Fix Version/s: 1.1.0 > Volume space: add quotaUsageInBytes and update it when create and delete key

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1434: HDDS-3727. Volume space: check quotaUsageInBytes when write key.

2020-09-25 Thread GitBox
captainzmc commented on pull request #1434: URL: https://github.com/apache/hadoop-ozone/pull/1434#issuecomment-698235132 Thanks for @ChenSammi ‘s review. The review issues have been fixed. Could you help take another look?

[GitHub] [hadoop-ozone] cxorm commented on pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-25 Thread GitBox
cxorm commented on pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412#issuecomment-698094498 Thanks @captainzmc for the work. Would you please rebase this PR ? I would take a look on it.

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1443: HDDS-4270. Add more reusable byteman scripts to debug ofs/o3fs performance

2020-09-25 Thread GitBox
adoroszlai commented on pull request #1443: URL: https://github.com/apache/hadoop-ozone/pull/1443#issuecomment-698385899 Thanks @elek for updating the patch. This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-4270) Add more reusable byteman scripts to debug ofs/o3fs performance

2020-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4270: - Labels: pull-request-available (was: ) > Add more reusable byteman scripts to debug ofs/o3fs

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1445: HDDS-4272. Volume namespace: add usedNamespace and update it when create and delete bucket

2020-09-25 Thread GitBox
cxorm commented on a change in pull request #1445: URL: https://github.com/apache/hadoop-ozone/pull/1445#discussion_r494095636 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmVolumeArgs.java ## @@ -68,15 +69,16 @@ "builder."})

[GitHub] [hadoop-ozone] sodonnel commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-25 Thread GitBox
sodonnel commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-698259315 Sorry for the slow reply on this. I have been caught up on some other things. > After a second thought, deleting the container record in SCM DB immediately while

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #1298: HDDS-3869. Use different column families for datanode block and metadata

2020-09-25 Thread GitBox
hanishakoneru commented on pull request #1298: URL: https://github.com/apache/hadoop-ozone/pull/1298#issuecomment-698555281 @errose28, the unit test failures seem to be related to the patch. Can you please check. This is an

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-09-25 Thread GitBox
ChenSammi commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-698899914 > Sorry for the slow reply on this. I have been caught up on some other things. > > > After a second thought, deleting the container record in SCM DB immediately

[jira] [Updated] (HDDS-4264) Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4264: Description: Current Shell command of Ozone, some use hump connection, some use '-' connection. We

[jira] [Updated] (HDDS-4264) Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4264: Description: Current Shell command of Ozone, some use hump connection, some use '-' connection. We

[jira] [Updated] (HDDS-4264) Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4264: Description: Current Shell command of Ozone, some use hump connection, some use '-' connection. We

[jira] [Assigned] (HDDS-4264) Uniform naming conventions of Ozone Shell Options.

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao reassigned HDDS-4264: --- Assignee: mingchao zhao > Uniform naming conventions of Ozone Shell Options. >

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #1446: HDDS-4274. Change the log level of the SCM Delete block to improve performance.

2020-09-25 Thread GitBox
captainzmc opened a new pull request #1446: URL: https://github.com/apache/hadoop-ozone/pull/1446 ## What changes were proposed in this pull request? There are scenarios in which the DELETE operation is very frequent. Now that info level logs in SCM are affecting performance, we

[jira] [Updated] (HDDS-4274) Change the log level of the SCM Delete block to improve performance.

2020-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4274: - Labels: pull-request-available (was: ) > Change the log level of the SCM Delete block to improve

[jira] [Updated] (HDDS-4274) Change the log level of the SCM Delete block to improve performance.

2020-09-25 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-4274: Fix Version/s: 1.1.0 > Change the log level of the SCM Delete block to improve performance. >

[jira] [Created] (HDDS-4274) Change the log level of the SCM Delete block to improve performance.

2020-09-25 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-4274: --- Summary: Change the log level of the SCM Delete block to improve performance. Key: HDDS-4274 URL: https://issues.apache.org/jira/browse/HDDS-4274 Project: Hadoop