[jira] [Updated] (HDDS-3254) Memory leak of datanode

2020-03-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3254: - Description: As the image shows, the physical memory of datanode increase to 11.2GB, and then crash. I

[jira] [Assigned] (HDDS-3254) Memory leak of datanode

2020-03-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reassigned HDDS-3254: Assignee: runzhiwang > Memory leak of datanode > --- > > Key:

[jira] [Commented] (HDDS-3254) Memory leak of datanode

2020-03-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065244#comment-17065244 ] runzhiwang commented on HDDS-3254: -- I'm working on it. > Memory leak of datanode >

[jira] [Created] (HDDS-3254) Memory leak of datanode

2020-03-23 Thread runzhiwang (Jira)
runzhiwang created HDDS-3254: Summary: Memory leak of datanode Key: HDDS-3254 URL: https://issues.apache.org/jira/browse/HDDS-3254 Project: Hadoop Distributed Data Store Issue Type: Bug

[GitHub] [hadoop-ozone] fapifta commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state

2020-03-23 Thread GitBox
fapifta commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state URL: https://github.com/apache/hadoop-ozone/pull/705#issuecomment-602964815 Oh, that gives some better understanding the problem, which is the size of the cache, thank you for

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396509770 ## File path:

[jira] [Updated] (HDDS-3253) Initialize Recon metrics for prometheus at /prom endpoint

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3253: - Labels: pull-request-available (was: ) > Initialize Recon metrics for prometheus at /prom

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #715: HDDS-3253. Initialize Recon metrics for prometheus at /prom endpoint

2020-03-23 Thread GitBox
vivekratnavel opened a new pull request #715: HDDS-3253. Initialize Recon metrics for prometheus at /prom endpoint URL: https://github.com/apache/hadoop-ozone/pull/715 ## What changes were proposed in this pull request? - Initialize metrics for Recon at /prom endpoint ## What

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #715: HDDS-3253. Initialize Recon metrics for prometheus at /prom endpoint

2020-03-23 Thread GitBox
vivekratnavel commented on issue #715: HDDS-3253. Initialize Recon metrics for prometheus at /prom endpoint URL: https://github.com/apache/hadoop-ozone/pull/715#issuecomment-602899211 @avijayanhwx @elek Please review This is

[jira] [Created] (HDDS-3253) Initialize Recon metrics for prometheus at /prom endpoint

2020-03-23 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3253: Summary: Initialize Recon metrics for prometheus at /prom endpoint Key: HDDS-3253 URL: https://issues.apache.org/jira/browse/HDDS-3253

[jira] [Updated] (HDDS-3164) Add Recon endpoint to serve missing containers and its metadata.

2020-03-23 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-3164: - Status: Patch Available (was: In Progress) > Add Recon endpoint to serve

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-23 Thread GitBox
hanishakoneru commented on issue #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#issuecomment-602891210 Integration test failure (timeout) is unrelated and passes locally. Re-triggering the checks.

[jira] [Updated] (HDDS-3164) Add Recon endpoint to serve missing containers and its metadata.

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3164: - Labels: pull-request-available (was: ) > Add Recon endpoint to serve missing containers and its

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata.

2020-03-23 Thread GitBox
vivekratnavel commented on issue #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata. URL: https://github.com/apache/hadoop-ozone/pull/714#issuecomment-602888078 @avijayanhwx @elek Please review

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata.

2020-03-23 Thread GitBox
vivekratnavel opened a new pull request #714: HDDS-3164. Add Recon endpoint to serve missing containers and its metadata. URL: https://github.com/apache/hadoop-ozone/pull/714 ## What changes were proposed in this pull request? - Add an endpoint (/api/v1/containers/missing) to serve

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-03-23 Thread GitBox
sodonnel commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#discussion_r396774317 ## File path:

[jira] [Updated] (HDDS-3252) Release Ozone 0.5.0

2020-03-23 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-3252: Description: Jira to perform release activities for 0.5.0   Vote passed: 

[jira] [Created] (HDDS-3252) Release Ozone 0.5.0

2020-03-23 Thread Dinesh Chitlangia (Jira)
Dinesh Chitlangia created HDDS-3252: --- Summary: Release Ozone 0.5.0 Key: HDDS-3252 URL: https://issues.apache.org/jira/browse/HDDS-3252 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-3056) Allow users to list volumes they have access to, and optionally allow all users to list all volumes

2020-03-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Summary: Allow users to list volumes they have access to, and optionally allow all users to list all

[jira] [Updated] (HDDS-3056) Optionally allow all users to list all volumes

2020-03-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Description: Current implementation of {{listVolumes}} only returns the volumes the user creates. And

[jira] [Updated] (HDDS-3056) Optionally allow all users to list all volumes

2020-03-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Description: Current implementation of {{listVolumes}} only returns the volumes the user creates. And

[GitHub] [hadoop-ozone] esahekmat commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state

2020-03-23 Thread GitBox
esahekmat commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state URL: https://github.com/apache/hadoop-ozone/pull/705#issuecomment-602838026 Hi, Thank you for your comprehensive response. sorry for my mistake in creating PR, I'm new to this

[jira] [Updated] (HDDS-3056) Optionally allow all users to list all volumes

2020-03-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Summary: Optionally allow all users to list all volumes (was: Allow all users to list all volumes) >

[GitHub] [hadoop-ozone] fapifta commented on issue #704: HDDS-3248. shutdown defaultMetricsSystem before tests

2020-03-23 Thread GitBox
fapifta commented on issue #704: HDDS-3248. shutdown defaultMetricsSystem before tests URL: https://github.com/apache/hadoop-ozone/pull/704#issuecomment-602771057 Thank you for figuring this out, and posting a JIRA about it. As in #705 I disagree with how the solution is

[GitHub] [hadoop-ozone] fapifta commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state

2020-03-23 Thread GitBox
fapifta commented on issue #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state URL: https://github.com/apache/hadoop-ozone/pull/705#issuecomment-602768722 Hi, thank you for figuring the problem out and posting a JIRA for it. I am on the other hand

[jira] [Updated] (HDDS-3251) Bump version to 0.6.0-SNAPSHOT

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3251: - Labels: pull-request-available (was: ) > Bump version to 0.6.0-SNAPSHOT >

[GitHub] [hadoop-ozone] elek opened a new pull request #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT

2020-03-23 Thread GitBox
elek opened a new pull request #713: HDDS-3251. Bump version to 0.6.0-SNAPSHOT URL: https://github.com/apache/hadoop-ozone/pull/713 ## What changes were proposed in this pull request? As 0.5.0 release is almost here, our daily builds should use a newer version. ## What is the

[jira] [Created] (HDDS-3251) Bump version to 0.6.0-SNAPSHOT

2020-03-23 Thread Marton Elek (Jira)
Marton Elek created HDDS-3251: - Summary: Bump version to 0.6.0-SNAPSHOT Key: HDDS-3251 URL: https://issues.apache.org/jira/browse/HDDS-3251 Project: Hadoop Distributed Data Store Issue Type:

[GitHub] [hadoop-ozone] fapifta commented on issue #711: HDDS-3250. Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster.

2020-03-23 Thread GitBox
fapifta commented on issue #711: HDDS-3250. Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster. URL: https://github.com/apache/hadoop-ozone/pull/711#issuecomment-602730485 The changes looks good to me, one thing that we may consider is naming as the errorfilename

[GitHub] [hadoop-ozone] fapifta edited a comment on issue #710: HDDS-3173. Provide better default JVM options

2020-03-23 Thread GitBox
fapifta edited a comment on issue #710: HDDS-3173. Provide better default JVM options URL: https://github.com/apache/hadoop-ozone/pull/710#issuecomment-602717725 I have one concern, in case there is any -XX option configured, then we skip to add GC options. This may be a problem in case

[GitHub] [hadoop-ozone] fapifta commented on issue #710: HDDS-3173. Provide better default JVM options

2020-03-23 Thread GitBox
fapifta commented on issue #710: HDDS-3173. Provide better default JVM options URL: https://github.com/apache/hadoop-ozone/pull/710#issuecomment-602717725 I have one concern, in case there is any -XX option configured, then we skip to add GC options. This may be a problem in case when an

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-23 Thread GitBox
hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r396592736 ## File path:

[jira] [Updated] (HDDS-3243) Recon should not have the ability to send Create/Close Container commands to Datanode.

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3243: - Labels: pull-request-available (was: ) > Recon should not have the ability to send Create/Close

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-23 Thread GitBox
bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r396581977 ## File path:

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-23 Thread GitBox
hanishakoneru commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r396566755 ## File path:

[GitHub] [hadoop-docker-ozone] elek closed pull request #11: Fix Ozone Manager name mismatch in docker-compose.yaml and docker-config

2020-03-23 Thread GitBox
elek closed pull request #11: Fix Ozone Manager name mismatch in docker-compose.yaml and docker-config URL: https://github.com/apache/hadoop-docker-ozone/pull/11 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-docker-ozone] elek commented on issue #11: Fix Ozone Manager name mismatch in docker-compose.yaml and docker-config

2020-03-23 Thread GitBox
elek commented on issue #11: Fix Ozone Manager name mismatch in docker-compose.yaml and docker-config URL: https://github.com/apache/hadoop-docker-ozone/pull/11#issuecomment-602691806 Merged to ozone-0.4.1 branch (apache/ozone:0.4.1) and ozone-latest branch (apache/ozone:latest)

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396509770 ## File path:

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396509770 ## File path:

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396509770 ## File path:

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396509770 ## File path:

[jira] [Updated] (HDDS-3250) Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3250: - Labels: pull-request-available (was: ) > Create a separate log file for Warnings and Errors in

[GitHub] [hadoop-ozone] mukul1987 opened a new pull request #711: HDDS-3250. Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster.

2020-03-23 Thread GitBox
mukul1987 opened a new pull request #711: HDDS-3250. Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster. URL: https://github.com/apache/hadoop-ozone/pull/711 ## What changes were proposed in this pull request? Adding a new log file for just the error while

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#discussion_r396498271 ## File path:

[jira] [Created] (HDDS-3250) Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster

2020-03-23 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-3250: --- Summary: Create a separate log file for Warnings and Errors in MiniOzoneChaosCluster Key: HDDS-3250 URL: https://issues.apache.org/jira/browse/HDDS-3250

[GitHub] [hadoop-ozone] fapifta commented on issue #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on issue #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#issuecomment-602630174 I have added some comments suggesting changes, to the way how the test is organised in the belief the changes

[GitHub] [hadoop-ozone] elek opened a new pull request #710: HDDS-3173. Provide better default JVM options

2020-03-23 Thread GitBox
elek opened a new pull request #710: HDDS-3173. Provide better default JVM options URL: https://github.com/apache/hadoop-ozone/pull/710 ## What changes were proposed in this pull request? The GC pressure on Datanode is high because of the retry cache. I found crashes due to the

[jira] [Updated] (HDDS-3173) Provide better default JVM options

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3173: - Labels: pull-request-available (was: ) > Provide better default JVM options >

[jira] [Commented] (HDDS-3173) Provide better default JVM options

2020-03-23 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064829#comment-17064829 ] Marton Elek commented on HDDS-3173: --- Thanks to share [~ljain] I am not sure about the gc logs. Verbose

[GitHub] [hadoop-ozone] cxorm commented on issue #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-03-23 Thread GitBox
cxorm commented on issue #164: HDDS-426. Add field modificationTime for Volume and Bucket URL: https://github.com/apache/hadoop-ozone/pull/164#issuecomment-602611166 > Thanks @cxorm for the patch. LGTM overall, a few comments added inline. Also, there are other volume/bucket metadata/ACL

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-03-23 Thread GitBox
cxorm commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r396470847 ## File path:

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r396467880 ## File path:

[GitHub] [hadoop-ozone] runzhiwang commented on issue #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang commented on issue #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709#issuecomment-602598283 @bharatviswa504 Could you help review this patch ? If you agree with the change, I will fix the CI failure.

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r396458781 ## File path:

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #707: HDDS-3236. Fix Dropwizard metrics mapping for latest Ratis metrics.

2020-03-23 Thread GitBox
avijayanhwx commented on issue #707: HDDS-3236. Fix Dropwizard metrics mapping for latest Ratis metrics. URL: https://github.com/apache/hadoop-ozone/pull/707#issuecomment-602595742 LGTM +1. This is an automated message from

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457722 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457628 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457648 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457693 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457703 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457612 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457553 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457510 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457504 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457668 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457589 ## File path:

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif…

2020-03-23 Thread GitBox
fapifta commented on a change in pull request #619: HDDS-3111. Add unit test for container replication behavior under dif… URL: https://github.com/apache/hadoop-ozone/pull/619#discussion_r396457495 ## File path:

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r396454779 ## File path:

[jira] [Updated] (HDDS-426) Add field modificationTime for Volume and Bucket

2020-03-23 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-426: -- Description: There are update operations that can be performed for Volume, Bucket and Key. While Key

[jira] [Updated] (HDDS-3244) Improve write efficiency by opening RocksDB only once

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3244: - Labels: pull-request-available (was: ) > Improve write efficiency by opening RocksDB only once >

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once

2020-03-23 Thread GitBox
runzhiwang opened a new pull request #709: HDDS-3244. Improve write efficiency by opening RocksDB only once URL: https://github.com/apache/hadoop-ozone/pull/709 ## What changes were proposed in this pull request? What's the problem ? 1. when datanode create each container, a new

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket

2020-03-23 Thread GitBox
cxorm commented on a change in pull request #164: HDDS-426. Add field modificationTime for Volume and Bucket URL: https://github.com/apache/hadoop-ozone/pull/164#discussion_r396450260 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneBucket.java

[jira] [Updated] (HDDS-3244) Improve write efficiency by opening RocksDB only once

2020-03-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3244: - Description: when datanode create each container, a new RocksDB instance will be

[jira] [Updated] (HDDS-3142) Create isolated environment for OM to test it without SCM

2020-03-23 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3142: -- Summary: Create isolated environment for OM to test it without SCM (was: Create isolated enviornment

[jira] [Updated] (HDDS-3239) Provide message-level metrics from the generic protocol dispatch

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3239: - Labels: pull-request-available (was: ) > Provide message-level metrics from the generic protocol

[GitHub] [hadoop-ozone] elek opened a new pull request #708: HDDS-3239. Provide message-level metrics from the generic protocol dispatch.

2020-03-23 Thread GitBox
elek opened a new pull request #708: HDDS-3239. Provide message-level metrics from the generic protocol dispatch. URL: https://github.com/apache/hadoop-ozone/pull/708 ## What changes were proposed in this pull request? Ozone RPC protocols (due to the limitation of protobuf)

[jira] [Updated] (HDDS-3236) Fix Dropwizard metrics mapping for latest Ratis metrics

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3236: - Labels: pull-request-available (was: ) > Fix Dropwizard metrics mapping for latest Ratis metrics

[GitHub] [hadoop-ozone] elek opened a new pull request #707: HDDS-3236. Fix Dropwizard metrics mapping for latest Ratis metrics.

2020-03-23 Thread GitBox
elek opened a new pull request #707: HDDS-3236. Fix Dropwizard metrics mapping for latest Ratis metrics. URL: https://github.com/apache/hadoop-ozone/pull/707 ## What changes were proposed in this pull request? Ratis use dropwizard metrics where the key parameters of the metrics

[jira] [Resolved] (HDDS-3235) Change to default of max retry count for Ozone client

2020-03-23 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3235. --- Fix Version/s: (was: 0.5.0) 0.6.0 Resolution: Fixed

[GitHub] [hadoop-ozone] bshashikant merged pull request #699: HDDS-3235.Change to default of max retry count for Ozone client

2020-03-23 Thread GitBox
bshashikant merged pull request #699: HDDS-3235.Change to default of max retry count for Ozone client URL: https://github.com/apache/hadoop-ozone/pull/699 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] bshashikant merged pull request #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-23 Thread GitBox
bshashikant merged pull request #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698 This is an automated message from the Apache Git Service. To respond to the

[jira] [Resolved] (HDDS-3234) Fix retry interval default in Ozone client

2020-03-23 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3234. --- Fix Version/s: 0.6.0 Resolution: Fixed > Fix retry interval default in Ozone

[jira] [Updated] (HDDS-3246) Include OM hostname info in "getserviceroles" subcommand of OM CLI

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3246: - Labels: pull-request-available (was: ) > Include OM hostname info in "getserviceroles"

[GitHub] [hadoop-ozone] nilotpalnandi opened a new pull request #706: HDDS-3246 Include OM hostname info in getserviceroles subcommand of O…

2020-03-23 Thread GitBox
nilotpalnandi opened a new pull request #706: HDDS-3246 Include OM hostname info in getserviceroles subcommand of O… URL: https://github.com/apache/hadoop-ozone/pull/706 …M CLI ## What changes were proposed in this pull request? Currently, "getserviceroles" subcommand of OM

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r396299867 ## File path:

[jira] [Updated] (HDDS-3249) TestContainerCache fails if runs after TestBlockDeletingService

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3249: - Labels: pull-request-available (was: ) > TestContainerCache fails if runs after

[GitHub] [hadoop-ozone] esahekmat opened a new pull request #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state

2020-03-23 Thread GitBox
esahekmat opened a new pull request #705: HDDS-3249: renew ContainerCache.INSTANCE in order to test it in a fresh state URL: https://github.com/apache/hadoop-ozone/pull/705 This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-23 Thread GitBox
mukul1987 commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r396297765 ## File path:

[jira] [Created] (HDDS-3249) TestContainerCache fails if runs after TestBlockDeletingService

2020-03-23 Thread Isa Hekmatizadeh (Jira)
Isa Hekmatizadeh created HDDS-3249: -- Summary: TestContainerCache fails if runs after TestBlockDeletingService Key: HDDS-3249 URL: https://issues.apache.org/jira/browse/HDDS-3249 Project: Hadoop

[jira] [Updated] (HDDS-3248) TestHddsDispatcher and TestHandler fails if run after other tests

2020-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3248: - Labels: pull-request-available (was: ) > TestHddsDispatcher and TestHandler fails if run after

[GitHub] [hadoop-ozone] esahekmat opened a new pull request #704: HDDS-3248. shutdown defaultMetricsSystem before tests

2020-03-23 Thread GitBox
esahekmat opened a new pull request #704: HDDS-3248. shutdown defaultMetricsSystem before tests URL: https://github.com/apache/hadoop-ozone/pull/704 This is an automated message from the Apache Git Service. To respond to

[jira] [Created] (HDDS-3248) TestHddsDispatcher and TestHandler fails if run after other tests

2020-03-23 Thread Isa Hekmatizadeh (Jira)
Isa Hekmatizadeh created HDDS-3248: -- Summary: TestHddsDispatcher and TestHandler fails if run after other tests Key: HDDS-3248 URL: https://issues.apache.org/jira/browse/HDDS-3248 Project: Hadoop

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-03-23 Thread GitBox
timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#discussion_r396230240 ## File path:

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-03-23 Thread GitBox
timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#discussion_r396229970 ## File path:

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage

2020-03-23 Thread GitBox
timmylicheng commented on a change in pull request #668: HDDS-3139 Pipeline placement should max out pipeline usage URL: https://github.com/apache/hadoop-ozone/pull/668#discussion_r396229970 ## File path:

[GitHub] [hadoop-ozone] timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-23 Thread GitBox
timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#issuecomment-602405476 > @timmylicheng thanks for the clarification. > > As we create the pipeline via heartbeat