[jira] [Updated] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3267: - Labels: pull-request-available (was: ) > Replace ContainerCache in BlockUtils by LoadingCache >

[GitHub] [hadoop-ozone] esahekmat opened a new pull request #726: HDDS-3267. replace containerCache in blockUtils by LoadingCache

2020-03-26 Thread GitBox
esahekmat opened a new pull request #726: HDDS-3267. replace containerCache in blockUtils by LoadingCache URL: https://github.com/apache/hadoop-ozone/pull/726 ## What changes were proposed in this pull request? ContainerCache removed and instead of it, LoadingCache replaced in

[jira] [Commented] (HDDS-3088) maxRetries value is too large while trying to reconnect to SCM server

2020-03-26 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067895#comment-17067895 ] Arpit Agarwal commented on HDDS-3088: - cc [~shashikant], does this tie in with the retry settings you

[jira] [Updated] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3285: Description: 2020-03-26 21:26:48,869 [pool-326-thread-2] INFO util.ExitUtil

[jira] [Created] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-3285: --- Summary: MiniOzoneChaosCluster exits because of deadline exceeding Key: HDDS-3285 URL: https://issues.apache.org/jira/browse/HDDS-3285 Project: Hadoop

[jira] [Updated] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3285: Description: 2020-03-26 21:26:48,869 [pool-326-thread-2] INFO util.ExitUtil

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #399: HDDS-2424. Add the recover-trash command server side handling.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #399: HDDS-2424. Add the recover-trash command server side handling. URL: https://github.com/apache/hadoop-ozone/pull/399#discussion_r398700964 ## File path:

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604623673 Thanks @adoroszlai for working on this. I will go ahead and merge this as the change is only in acceptance

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-26 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-604676324 @adoroszlai, I think even with that limitation the timeout will help us isolate the problem. Let's say the acceptance suit is

[GitHub] [hadoop-ozone] timmylicheng edited a comment on issue #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-26 Thread GitBox
timmylicheng edited a comment on issue #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720#issuecomment-604254744 @elek Hey Marton, Sorry this patch was meant to merge into HDDS-2823 as a dev branch for SCM HA. So

[GitHub] [hadoop-ozone] timmylicheng commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM.

2020-03-26 Thread GitBox
timmylicheng commented on issue #720: HDDS-3185 Construct a standalone ratis server for SCM. URL: https://github.com/apache/hadoop-ozone/pull/720#issuecomment-604254744 @elek Hey Marton, So far the doc work is ongoing in parallel with prototyping. The doc still needs improvements and

[jira] [Updated] (HDDS-3001) NFS support for Ozone

2020-03-26 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde updated HDDS-3001: - Attachment: NFS Support for Ozone.pdf > NFS support for Ozone > - > >

[jira] [Commented] (HDDS-3001) NFS support for Ozone

2020-03-26 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067384#comment-17067384 ] Prashant Pogde commented on HDDS-3001: -- Attaching the design document. Please take a look. > NFS

[jira] [Comment Edited] (HDDS-3254) Datanode memory increase so much

2020-03-26 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067371#comment-17067371 ] runzhiwang edited comment on HDDS-3254 at 3/26/20, 6:06 AM: [~shashikant] I

[jira] [Comment Edited] (HDDS-3254) Datanode memory increase so much

2020-03-26 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067371#comment-17067371 ] runzhiwang edited comment on HDDS-3254 at 3/26/20, 6:06 AM: [~shashikant] I

[GitHub] [hadoop-ozone] swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-03-26 Thread GitBox
swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-604776938 S3BucketCreateRequest checked for length but the verifyResourceName is more comprehensive. We are still doing

[jira] [Created] (HDDS-3286) Support batchDelete when deleting path.

2020-03-26 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-3286: --- Summary: Support batchDelete when deleting path. Key: HDDS-3286 URL: https://issues.apache.org/jira/browse/HDDS-3286 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3286) Support batchDelete when deleting path.

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3286: Description: Currently delete file is to get all the keys in the directory, and then delete one by

[jira] [Resolved] (HDDS-3074) Make the configuration of container scrub consistent

2020-03-26 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-3074. -- Fix Version/s: 0.6.0 Resolution: Fixed > Make the configuration of container

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722#issuecomment-604820134 Thank You @cku328 for the contribution.

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722#issuecomment-604819927 Test failures are unrelated. This is an

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 merged pull request #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r398972414 ## File path:

[jira] [Resolved] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-3271. - Resolution: Not A Problem > The block file is not deleted after the key is deleted >

[jira] [Updated] (HDDS-3273) OM HA: getconf must return all OMs

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3273: - Labels: pull-request-available (was: ) > OM HA: getconf must return all OMs >

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399039110 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399039110 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java

[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604678295 Thanks @sodonnel and @vivekratnavel for the review, and @hanishakoneru for merging it.

[jira] [Commented] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067551#comment-17067551 ] mingchao zhao commented on HDDS-3271: - Hi [~msingh] Thank you for your discussion. >The SCM maintains

[jira] [Updated] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3284: --- Status: Patch Available (was: In Progress) > ozonesecure-mr test fails due to lack of disk

[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604386700 Thanks for looking into this. +1 on this from me, pending CI, but some of the "it-*" tests are a bit flaky.

[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604396747 Yea, I have seen random failures on it-client. As this is a yarn only change, I cannot see how it could impact the

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725 ## What changes were proposed in this pull request? Disable YARN disk utilization check in `ozonesecure-mr` acceptance test.

[jira] [Updated] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3284: - Labels: pull-request-available (was: ) > ozonesecure-mr test fails due to lack of disk space >

[jira] [Comment Edited] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067551#comment-17067551 ] mingchao zhao edited comment on HDDS-3271 at 3/26/20, 10:37 AM: Hi

[jira] [Comment Edited] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067551#comment-17067551 ] mingchao zhao edited comment on HDDS-3271 at 3/26/20, 10:36 AM: Hi

[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604392865 Thanks @sodonnel. Since it only changes acceptance tests, I think we can merge it even if `it-client` happens to

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398601166 ## File path:

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604452924 Thanks for the updates here. I think the code looks much cleaner now with the debug statements and refactored

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398621936 ## File path:

[GitHub] [hadoop-ozone] timmylicheng commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604466974 > Thanks for the updates here. I think the code looks much cleaner now with the debug statements and

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398622023 ## File path:

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604425486 Acceptance is failing with: ```

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398582704 ## File path:

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Isa Hekmatizadeh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067652#comment-17067652 ] Isa Hekmatizadeh commented on HDDS-3267: please assign this task to me, I'm currently working on

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604486699 Thanks for quickly addressing the final issues. I am +1 on this now. I will commit it later pending

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067774#comment-17067774 ] Mukul Kumar Singh commented on HDDS-3267: - [~esa.hekmat], I have added you as a contributor to the

[jira] [Assigned] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3267: --- Assignee: Isa Hekmatizadeh > Replace ContainerCache in BlockUtils by LoadingCache >