[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4228: - Labels: pull-request-available pull-requests-available (was: pull-requests-available) > add fiel

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread GitBox
timmylicheng commented on pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413#issuecomment-690017940 LGTM. +1 This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1407: HDDS-4158. Provide a class type for Java based configuration

2020-09-09 Thread GitBox
maobaolong commented on pull request #1407: URL: https://github.com/apache/hadoop-ozone/pull/1407#issuecomment-690017443 @adoroszlai Please take a look at this PR, it will help us to use the `Java based configuration` conveniently. -

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1290: HDDS-4064. Show container verbose info with verbose option

2020-09-09 Thread GitBox
maobaolong commented on pull request #1290: URL: https://github.com/apache/hadoop-ozone/pull/1290#issuecomment-690015532 @adoroszlai @xiaoyuyao @elek Thanks for your review. This is an automated message from the Apache Git Se

[jira] [Resolved] (HDDS-4064) Show container verbose info with verbose option

2020-09-09 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDDS-4064. -- Fix Version/s: 1.1.0 Resolution: Fixed > Show container verbose info with verbose option > --

[GitHub] [hadoop-ozone] captainzmc closed pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-09 Thread GitBox
captainzmc closed pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Labels: pull-requests-available (was: pull-request-available) > add field 'num' to ALLOCATE_BLOCK of scm au

[GitHub] [hadoop-ozone] GlenGeng opened a new pull request #1413: HDDS-4228: add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread GitBox
GlenGeng opened a new pull request #1413: URL: https://github.com/apache/hadoop-ozone/pull/1413 ## What changes were proposed in this pull request? The scm audit log for ALLOCATE_BLOCK is as follows: `2020-09-10 03:42:08,196 | INFO | SCMAudit | user=root | ip=172.16.90.221 | op=AL

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4228: - Labels: pull-request-available (was: ) > add field 'num' to ALLOCATE_BLOCK of scm audit log. > --

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Description:   The scm audit log for ALLOCATE_BLOCK is as follows: {code:java} 2020-09-10 03:42:08,196 | IN

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Description:   The scm audit log for ALLOCATE_BLOCK is as follows: {code:java} 2020-09-10 03:42:08,196 | IN

[jira] [Updated] (HDDS-4228) add field 'num' to ALLOCATE_BLOCK of scm audit log.

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Summary: add field 'num' to ALLOCATE_BLOCK of scm audit log. (was: ALLOCATE_BLOCK of scm audit log miss num

[jira] [Updated] (HDDS-4228) ALLOCATE_BLOCK of scm audit log miss num

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Description:   The sac {code:java} 2020-09-10 03:42:08,196 | INFO | SCMAudit | user=root | ip=172.16.90.221

[jira] [Assigned] (HDDS-4228) ALLOCATE_BLOCK of scm audit log miss num

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng reassigned HDDS-4228: --- Assignee: Glen Geng (was: Marton Elek) > ALLOCATE_BLOCK of scm audit log miss num >

[jira] [Updated] (HDDS-4228) ALLOCATE_BLOCK of scm audit log miss num

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Labels: (was: pull-request-available) > ALLOCATE_BLOCK of scm audit log miss num > ---

[jira] [Updated] (HDDS-4228) ALLOCATE_BLOCK of scm audit log miss num

2020-09-09 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4228: Priority: Minor (was: Blocker) > ALLOCATE_BLOCK of scm audit log miss num > ---

[jira] [Created] (HDDS-4228) ALLOCATE_BLOCK of scm audit log miss num

2020-09-09 Thread Glen Geng (Jira)
Glen Geng created HDDS-4228: --- Summary: ALLOCATE_BLOCK of scm audit log miss num Key: HDDS-4228 URL: https://issues.apache.org/jira/browse/HDDS-4228 Project: Hadoop Distributed Data Store Issue Type

[jira] [Updated] (HDDS-2416) Ozone Trash Feature

2020-09-09 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-2416: --- Attachment: (was: Process deleting keys in trash-enabled buckets.html) > Ozone Trash Feature > ---

[jira] [Updated] (HDDS-4227) Implement a "prepareForUpgrade" step that applies all committed transactions onto the OM state machine.

2020-09-09 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4227: Description: *Why is this needed?* Through HDDS-4143, we have a generic factory to handle mu

[GitHub] [hadoop-ozone] amaliujia edited a comment on pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-09 Thread GitBox
amaliujia edited a comment on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-689826469 R @timmylicheng @nandakumar131 I am thinking maybe we can first merge this PR and create a JIRA to track left work. Right now per feedback this command coul

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1346: HDDS-4115. CLI command to show current SCM leader and follower status.

2020-09-09 Thread GitBox
amaliujia commented on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-689826469 R @timmylicheng @nandakumar131 I am thinking maybe we can first merge this PR and create a JIRA to track left work. Right now per feedback this command could print

[jira] [Created] (HDDS-4227) Implement a "prepareForUpgrade" step that applies all committed transactions onto the OM state machine.

2020-09-09 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4227: --- Summary: Implement a "prepareForUpgrade" step that applies all committed transactions onto the OM state machine. Key: HDDS-4227 URL: https://issues.apache.org/jira/browse/HD

[GitHub] [hadoop-ozone] smengcl commented on pull request #1401: HDDS-3927. Rename Ozone OM,DN,SCM runtime options to conform to naming conventions

2020-09-09 Thread GitBox
smengcl commented on pull request #1401: URL: https://github.com/apache/hadoop-ozone/pull/1401#issuecomment-689797013 Thanks @elek for the review. I have made changes accordingly. Do the changes look good to you? This

[jira] [Created] (HDDS-4226) Cleanup OM snapshots left after a failed installSnapshot

2020-09-09 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-4226: --- Summary: Cleanup OM snapshots left after a failed installSnapshot Key: HDDS-4226 URL: https://issues.apache.org/jira/browse/HDDS-4226 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1400: HDDS-4141. Implement Finalize command in Ozone Manager client.

2020-09-09 Thread GitBox
avijayanhwx commented on pull request #1400: URL: https://github.com/apache/hadoop-ozone/pull/1400#issuecomment-689756069 Thanks for working on this @fapifta, and for the reviews @linyiqun , @sodonnel. This is an automated

[jira] [Updated] (HDDS-4143) Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-09 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4143: Description: * Add the current layout version (MLV) to the OM Ratis request. If there is no

[jira] [Resolved] (HDDS-4141) Implement Finalize command in Ozone Manager client.

2020-09-09 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-4141. - Resolution: Fixed PR merged. > Implement Finalize command in Ozone Manager client. >

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1400: HDDS-4141. Implement Finalize command in Ozone Manager client.

2020-09-09 Thread GitBox
avijayanhwx merged pull request #1400: URL: https://github.com/apache/hadoop-ozone/pull/1400 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1400: HDDS-4141. Implement Finalize command in Ozone Manager client.

2020-09-09 Thread GitBox
avijayanhwx commented on a change in pull request #1400: URL: https://github.com/apache/hadoop-ozone/pull/1400#discussion_r485845129 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/upgrade/OMFinalizeUpgradeProgressResponse.java ## @@

[GitHub] [hadoop-ozone] smengcl merged pull request #1397: HDDS-4211. [OFS] Better owner and group display for listing Ozone volumes and buckets

2020-09-09 Thread GitBox
smengcl merged pull request #1397: URL: https://github.com/apache/hadoop-ozone/pull/1397 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Updated] (HDDS-4211) [OFS] Better owner and group display for listing Ozone volumes and buckets

2020-09-09 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4211: - Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0) Resolution: Fixed Stat

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1397: HDDS-4211. [OFS] Better owner and group display for listing Ozone volumes and buckets

2020-09-09 Thread GitBox
smengcl commented on a change in pull request #1397: URL: https://github.com/apache/hadoop-ozone/pull/1397#discussion_r485820978 ## File path: hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneClientAdapterImpl.java ## @@ -972,24 +992,26 @@ p

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
arp7 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485820636 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename, [

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
arp7 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485820636 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename, [

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1400: HDDS-4141. Implement Finalize command in Ozone Manager client.

2020-09-09 Thread GitBox
fapifta commented on a change in pull request #1400: URL: https://github.com/apache/hadoop-ozone/pull/1400#discussion_r485819842 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/upgrade/OMFinalizeUpgradeProgressResponse.java ## @@ -0,0

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485817494 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing /

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485817494 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing /

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485817494 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing /

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485813294 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485805457 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485805715 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485804988 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485802830 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485802830 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485802418 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485801742 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485801364 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485798906 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485794138 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485794525 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[jira] [Created] (HDDS-4225) NPE while installing snapshots on ozone manager

2020-09-09 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-4225: --- Summary: NPE while installing snapshots on ozone manager Key: HDDS-4225 URL: https://issues.apache.org/jira/browse/HDDS-4225 Project: Hadoop Distributed Data Sto

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485789295 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485789295 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485785304 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485784568 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing /

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485778737 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485778176 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -0,0 +1,282 @@ +--- +title: S3/Ozone Filesystem inter-op +summary: How to supp

[jira] [Comment Edited] (HDDS-4209) S3A Filesystem does not work with Ozone S3

2020-09-09 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193033#comment-17193033 ] Bharat Viswanadham edited comment on HDDS-4209 at 9/9/20, 4:56 PM: -

[jira] [Commented] (HDDS-4209) S3A Filesystem does not work with Ozone S3

2020-09-09 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193033#comment-17193033 ] Bharat Viswanadham commented on HDDS-4209: -- Hi [~elek] For your test have you ena

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1405: HDDS-4143. Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-09 Thread GitBox
avijayanhwx commented on a change in pull request #1405: URL: https://github.com/apache/hadoop-ozone/pull/1405#discussion_r485769011 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketSetPropertyRequest.java ## @@ -206,4 +2

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1405: HDDS-4143. Implement a factory for OM Requests that returns an instance based on layout version.

2020-09-09 Thread GitBox
avijayanhwx commented on a change in pull request #1405: URL: https://github.com/apache/hadoop-ozone/pull/1405#discussion_r485769011 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/bucket/OMBucketSetPropertyRequest.java ## @@ -206,4 +2

[jira] [Resolved] (HDDS-4173) Implement HDDS Version management using the LayoutVersionManager interface.

2020-09-09 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-4173. - Resolution: Fixed PR merged through Github. > Implement HDDS Version management using the

[jira] [Updated] (HDDS-4224) OM failed to install snapshots after OM failover

2020-09-09 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-4224: Labels: MiniOzoneChaosCluster (was: ) > OM failed to install snapshots after OM failover >

[jira] [Created] (HDDS-4224) OM failed to install snapshots after OM failover

2020-09-09 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-4224: --- Summary: OM failed to install snapshots after OM failover Key: HDDS-4224 URL: https://issues.apache.org/jira/browse/HDDS-4224 Project: Hadoop Distributed Data St

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1392: HDDS-4173. Implement HDDS Version management using the LayoutVersion…

2020-09-09 Thread GitBox
avijayanhwx merged pull request #1392: URL: https://github.com/apache/hadoop-ozone/pull/1392 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] avijayanhwx edited a comment on pull request #1392: HDDS-4173. Implement HDDS Version management using the LayoutVersion…

2020-09-09 Thread GitBox
avijayanhwx edited a comment on pull request #1392: URL: https://github.com/apache/hadoop-ozone/pull/1392#issuecomment-689684096 Thanks for working on this @prashantpogde. Thanks for the review @linyiqun. LGTM +1 This is

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1392: HDDS-4173. Implement HDDS Version management using the LayoutVersion…

2020-09-09 Thread GitBox
avijayanhwx commented on pull request #1392: URL: https://github.com/apache/hadoop-ozone/pull/1392#issuecomment-689684096 Thanks for working on this @prashantpogde. LGTM +1 This is an automated message from the Apache Git Ser

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1392: HDDS-4173. Implement HDDS Version management using the LayoutVersion…

2020-09-09 Thread GitBox
avijayanhwx commented on a change in pull request #1392: URL: https://github.com/apache/hadoop-ozone/pull/1392#discussion_r485765534 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/upgrade/NewSCMFeatureUpgradeAction.java ## @@ -0,0 +1,34 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1361: HDDS-4155. Directory and filename can end up with same name in a path.

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1361: URL: https://github.com/apache/hadoop-ozone/pull/1361#discussion_r485756050 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSWithObjectStoreCreate.java ## @@ -303,6 +304,

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1361: HDDS-4155. Directory and filename can end up with same name in a path.

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1361: URL: https://github.com/apache/hadoop-ozone/pull/1361#discussion_r485756050 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSWithObjectStoreCreate.java ## @@ -303,6 +304,

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1361: HDDS-4155. Directory and filename can end up with same name in a path.

2020-09-09 Thread GitBox
bharatviswa504 commented on a change in pull request #1361: URL: https://github.com/apache/hadoop-ozone/pull/1361#discussion_r485756050 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSWithObjectStoreCreate.java ## @@ -303,6 +304,

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1361: HDDS-4155. Directory and filename can end up with same name in a path.

2020-09-09 Thread GitBox
arp7 commented on a change in pull request #1361: URL: https://github.com/apache/hadoop-ozone/pull/1361#discussion_r485738948 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSWithObjectStoreCreate.java ## @@ -303,6 +304,12 @@ publ

[jira] [Comment Edited] (HDDS-4222) [OzoneFS optimization] Provide a mechanism for efficient path lookup

2020-09-09 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192947#comment-17192947 ] Yiqun Lin edited comment on HDDS-4222 at 9/9/20, 3:29 PM: -- Thanks

[GitHub] [hadoop-ozone] arp7 commented on pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
arp7 commented on pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#issuecomment-689638762 I have an alternate proposal, idea left in a comment. cc @bharatviswa504 @elek This is an automated message

[jira] [Commented] (HDDS-4222) [OzoneFS optimization] Provide a mechanism for efficient path lookup

2020-09-09 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192947#comment-17192947 ] Yiqun Lin commented on HDDS-4222: - Thanks for attaching the dir cache design, [~rakeshr]!

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
arp7 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485699608 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename, [

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
arp7 commented on a change in pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#discussion_r485693614 ## File path: hadoop-hdds/docs/content/design/s3_hcfs.md ## @@ -67,45 +66,100 @@ To solve the performance problems of the directory listing / rename, [

[GitHub] [hadoop-ozone] linyiqun commented on pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-09 Thread GitBox
linyiqun commented on pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#issuecomment-689607498 > Next task am planning to do CreateFile and then get/listStatus. IMHO, both file/dir delete can be done together in one patch which involves changes in KeyDeletingService

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485570651 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmVolumeArgs.java ## @@ -46,6 +47,7 @@ private long quotaIn

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485570651 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmVolumeArgs.java ## @@ -46,6 +47,7 @@ private long quotaIn

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#issuecomment-689582328 Thanks for @cxorm @xiaoyuyao to the review. The new commit has been updated. Could you help take another look?

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #1412: HDDS-3751. Ozone sh client support bucket quota option.

2020-09-09 Thread GitBox
captainzmc opened a new pull request #1412: URL: https://github.com/apache/hadoop-ozone/pull/1412 ## What changes were proposed in this pull request? By HDDS-3725 Ozone currently supports Set volume quota. This PR refers to the implementation of HDDS-3725, and make Ozone shell suppo

[jira] [Updated] (HDDS-3751) Ozone sh bucket client support quota option.

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3751: - Labels: pull-request-available (was: ) > Ozone sh bucket client support quota option. > -

[GitHub] [hadoop-ozone] elek edited a comment on pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
elek edited a comment on pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#issuecomment-689541807 Opened as a **DRAFT** pull request as this is only a proposal. @arp7 and @bharatviswa504 still have concerns about the proposed approach. --

[GitHub] [hadoop-ozone] elek commented on pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
elek commented on pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411#issuecomment-689541807 Opened as a **DRAFT** pull request as this is only a proposal. @arp7 and @bharatviswa504 still have concerns about the proposed approache.

[jira] [Updated] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4097: - Labels: pull-request-available (was: ) > S3/Ozone Filesystem inter-op > -

[GitHub] [hadoop-ozone] elek opened a new pull request #1411: HDDS-4097. [DESIGN] S3/Ozone Filesystem inter-op

2020-09-09 Thread GitBox
elek opened a new pull request #1411: URL: https://github.com/apache/hadoop-ozone/pull/1411 ## What changes were proposed in this pull request? A new design doc is included about S3/HCFS interoperability. Earlier it was discussed under https://issues.apache.org/jira/browse/HDDS-4097.

[jira] [Commented] (HDDS-4209) S3A Filesystem does not work with Ozone S3

2020-09-09 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192839#comment-17192839 ] Marton Elek commented on HDDS-4209: --- I checked it with aws s3 api, and after the first s

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485573765 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java ## @@ -182,8 +179,16 @@ pub

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485570651 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmVolumeArgs.java ## @@ -46,6 +47,7 @@ private long quotaIn

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485547522 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConsts.java ## @@ -269,6 +269,7 @@ private OzoneConsts() { public

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-09 Thread GitBox
rakeshadr commented on pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#issuecomment-689493252 > With new layout version added, the latest PR logic looks more clear and independent. > I just left my minor comments. I am thinking one next part of work is delete d

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-09 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r485527504 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneDirectory.java ## @@ -0,0 +1,198 @@ +/* + * Licensed

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1404: HDDS-2949: mkdir : store directory entries in a separate table

2020-09-09 Thread GitBox
rakeshadr commented on a change in pull request #1404: URL: https://github.com/apache/hadoop-ozone/pull/1404#discussion_r485527375 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequestV1.java ## @@ -0,0 +1,313 @

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-09-09 Thread GitBox
captainzmc commented on a change in pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#discussion_r485447342 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneVolume.java ## @@ -131,6 +133,18 @@ public OzoneVolume(Config

[jira] [Created] (HDDS-4223) Optimize the construction method of OzoneVolume and OzoneBucket.

2020-09-09 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-4223: --- Summary: Optimize the construction method of OzoneVolume and OzoneBucket. Key: HDDS-4223 URL: https://issues.apache.org/jira/browse/HDDS-4223 Project: Hadoop Distribute

[jira] [Commented] (HDDS-2939) Ozone FS namespace

2020-09-09 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192704#comment-17192704 ] Rakesh Radhakrishnan commented on HDDS-2939: Thanks a lot [~linyiqun] for the

[jira] [Commented] (HDDS-4222) [OzoneFS optimization] Provide a mechanism for efficient path lookup

2020-09-09 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192703#comment-17192703 ] Rakesh Radhakrishnan commented on HDDS-4222: Hi [~linyiqun], I have moved the

[jira] [Commented] (HDDS-4222) [OzoneFS optimization] Provide a mechanism for efficient path lookup

2020-09-09 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192688#comment-17192688 ] Rakesh Radhakrishnan commented on HDDS-4222: Attached document captures mode d

[jira] [Created] (HDDS-4222) [OzoneFS optimization] Provide a mechanism for efficient path lookup

2020-09-09 Thread Rakesh Radhakrishnan (Jira)
Rakesh Radhakrishnan created HDDS-4222: -- Summary: [OzoneFS optimization] Provide a mechanism for efficient path lookup Key: HDDS-4222 URL: https://issues.apache.org/jira/browse/HDDS-4222 Project:

  1   2   >