[GitHub] [hadoop-ozone] nandakumar131 merged pull request #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File

2020-03-16 Thread GitBox
nandakumar131 merged pull request #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File URL: https://github.com/apache/hadoop-ozone/pull/654 This is an automated message from the Apache Git Service. To

[jira] [Commented] (HDDS-3215) Intermittent failure in TestSCMNodeMetrics

2020-03-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060297#comment-17060297 ] Attila Doroszlai commented on HDDS-3215: Can be reproduced by adding 10 sec sleep before the

[jira] [Created] (HDDS-3215) Intermittent failure in TestSCMNodeMetrics

2020-03-16 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3215: -- Summary: Intermittent failure in TestSCMNodeMetrics Key: HDDS-3215 URL: https://issues.apache.org/jira/browse/HDDS-3215 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #688: HDDS-2995. Add integration test for Recon's Passive SCM state.

2020-03-16 Thread GitBox
avijayanhwx opened a new pull request #688: HDDS-2995. Add integration test for Recon's Passive SCM state. URL: https://github.com/apache/hadoop-ozone/pull/688 ## What changes were proposed in this pull request? - Verify Recon gets pipeline, node and container report from Datanode.

[GitHub] [hadoop-ozone] bshashikant opened a new pull request #556: HDDS-3018. Fix TestContainerStateMachineFailures.java

2020-03-16 Thread GitBox
bshashikant opened a new pull request #556: HDDS-3018. Fix TestContainerStateMachineFailures.java URL: https://github.com/apache/hadoop-ozone/pull/556 ## What changes were proposed in this pull request? The unit tests are written withe single node ratis into consideration. The

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #674: HDDS-3175. Healthy datanodes are marked as stale

2020-03-16 Thread GitBox
avijayanhwx commented on issue #674: HDDS-3175. Healthy datanodes are marked as stale URL: https://github.com/apache/hadoop-ozone/pull/674#issuecomment-599542777 @lokeshj1703 Can you fix the checkstyle issues in this PR?

[jira] [Commented] (HDDS-3175) Healthy datanodes are marked as stale

2020-03-16 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060226#comment-17060226 ] Aravindan Vijayan commented on HDDS-3175: - [~ljain] Thanks for the explanation. > Healthy

[GitHub] [hadoop-ozone] lokeshj1703 commented on issue #673: HDDS-3064. Get Key is hung when READ delay is injected in chunk file path.

2020-03-16 Thread GitBox
lokeshj1703 commented on issue #673: HDDS-3064. Get Key is hung when READ delay is injected in chunk file path. URL: https://github.com/apache/hadoop-ozone/pull/673#issuecomment-599540553 Had an offline discussion with @bshashikant. The grpc client maintains a cache for datanode so that

[GitHub] [hadoop-ozone] elek opened a new pull request #687: Hdds 2184

2020-03-16 Thread GitBox
elek opened a new pull request #687: Hdds 2184 URL: https://github.com/apache/hadoop-ozone/pull/687 ## What changes were proposed in this pull request? Originally ozone scmcli designed to be used only by the developers. A very cryptic name is chosen intentionally to frighten away

[GitHub] [hadoop-ozone] bshashikant closed pull request #556: HDDS-3018. Fix TestContainerStateMachineFailures.java

2020-03-16 Thread GitBox
bshashikant closed pull request #556: HDDS-3018. Fix TestContainerStateMachineFailures.java URL: https://github.com/apache/hadoop-ozone/pull/556 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] bshashikant opened a new pull request #686: HDDS-3098. TestDeleteWithSlowFollower is failing intermittently.

2020-03-16 Thread GitBox
bshashikant opened a new pull request #686: HDDS-3098. TestDeleteWithSlowFollower is failing intermittently. URL: https://github.com/apache/hadoop-ozone/pull/686 ## What changes were proposed in this pull request? Added a wait condition for atleast one pipeline to become open before

[jira] [Updated] (HDDS-3098) TestDeleteWithSlowFollower is failing intermittently

2020-03-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3098: - Labels: pull-request-available (was: ) > TestDeleteWithSlowFollower is failing intermittently >

[GitHub] [hadoop-ozone] adoroszlai merged pull request #671: HDDS-3086. Failure running integration test it-freon.

2020-03-16 Thread GitBox
adoroszlai merged pull request #671: HDDS-3086. Failure running integration test it-freon. URL: https://github.com/apache/hadoop-ozone/pull/671 This is an automated message from the Apache Git Service. To respond to the

[jira] [Resolved] (HDDS-3086) Failure running integration test it-freon

2020-03-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3086. Fix Version/s: 0.6.0 Resolution: Fixed > Failure running integration test it-freon

[GitHub] [hadoop-ozone] adoroszlai commented on issue #671: HDDS-3086. Failure running integration test it-freon.

2020-03-16 Thread GitBox
adoroszlai commented on issue #671: HDDS-3086. Failure running integration test it-freon. URL: https://github.com/apache/hadoop-ozone/pull/671#issuecomment-599486690 Thanks @bshashikant for the update. This is an automated

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java)

2020-03-16 Thread GitBox
adoroszlai commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java) URL: https://github.com/apache/hadoop-ozone/pull/680#discussion_r392946423 ## File path: hadoop-hdds/tools/pom.xml ## @@ -54,6 +54,12 @@

[GitHub] [hadoop-ozone] elek commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java)

2020-03-16 Thread GitBox
elek commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java) URL: https://github.com/apache/hadoop-ozone/pull/680#discussion_r392882577 ## File path: hadoop-hdds/tools/pom.xml ## @@ -54,6 +54,12 @@

[jira] [Commented] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060041#comment-17060041 ] Sammi Chen commented on HDDS-3167: -- Hi [~elek] and [~swagle], thanks for the input. bq. How would you

[jira] [Resolved] (HDDS-3154) Intermittent failure in Test2WayCommitInRatis

2020-03-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3154. Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~shashikant] for the fix. >

[GitHub] [hadoop-ozone] adoroszlai merged pull request #672: HDDS-3154. Intermittent failure in Test2WayCommitInRatis.

2020-03-16 Thread GitBox
adoroszlai merged pull request #672: HDDS-3154. Intermittent failure in Test2WayCommitInRatis. URL: https://github.com/apache/hadoop-ozone/pull/672 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HDDS-3147) User factor passed in get(uri,conf,user) API doesn't take effect

2020-03-16 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060025#comment-17060025 ] mingchao zhao commented on HDDS-3147: - I also found that the file owner has no effect on the current

[jira] [Created] (HDDS-3214) unhealthy datanodes repeatedly participate in pipeline creation

2020-03-16 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3214: Summary: unhealthy datanodes repeatedly participate in pipeline creation Key: HDDS-3214 URL: https://issues.apache.org/jira/browse/HDDS-3214 Project: Hadoop

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-16 Thread GitBox
runzhiwang opened a new pull request #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645 ## What changes were proposed in this pull request? Add jaeger trace span in s3gateway. ## What is the link to the Apache JIRA

[GitHub] [hadoop-ozone] runzhiwang closed pull request #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-16 Thread GitBox
runzhiwang closed pull request #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Created] (HDDS-3213) acceptance test for SCM HA

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3213: -- Summary: acceptance test for SCM HA Key: HDDS-3213 URL: https://issues.apache.org/jira/browse/HDDS-3213 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-3212) Purge SCM Ratis log

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3212: -- Summary: Purge SCM Ratis log Key: HDDS-3212 URL: https://issues.apache.org/jira/browse/HDDS-3212 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-3211) Make SCM HA configurable

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3211: -- Summary: Make SCM HA configurable Key: HDDS-3211 URL: https://issues.apache.org/jira/browse/HDDS-3211 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-3210) CLI for SCMs info

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3210: -- Summary: CLI for SCMs info Key: HDDS-3210 URL: https://issues.apache.org/jira/browse/HDDS-3210 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-3209) Load Snapshot info upon SCM Ratis starts

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3209: -- Summary: Load Snapshot info upon SCM Ratis starts Key: HDDS-3209 URL: https://issues.apache.org/jira/browse/HDDS-3209 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-3208) Implement Ratis Snapshots on SCM

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3208: -- Summary: Implement Ratis Snapshots on SCM Key: HDDS-3208 URL: https://issues.apache.org/jira/browse/HDDS-3208 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-3207) Provide docker-compose for SCM HA

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3207: -- Summary: Provide docker-compose for SCM HA Key: HDDS-3207 URL: https://issues.apache.org/jira/browse/HDDS-3207 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-3206) Make sure AllocateBlock can only be executed on leader SCM

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3206: -- Summary: Make sure AllocateBlock can only be executed on leader SCM Key: HDDS-3206 URL: https://issues.apache.org/jira/browse/HDDS-3206 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3205) Handle BlockDeletingServer in SCMs

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3205: -- Summary: Handle BlockDeletingServer in SCMs Key: HDDS-3205 URL: https://issues.apache.org/jira/browse/HDDS-3205 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-3205) Handle BlockDeletingService in SCMs

2020-03-16 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3205: --- Summary: Handle BlockDeletingService in SCMs (was: Handle BlockDeletingServer in SCMs) > Handle

[jira] [Created] (HDDS-3204) Decommission can be only executed on leader

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3204: -- Summary: Decommission can be only executed on leader Key: HDDS-3204 URL: https://issues.apache.org/jira/browse/HDDS-3204 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-3203) Replication can only be executed on leader

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3203: -- Summary: Replication can only be executed on leader Key: HDDS-3203 URL: https://issues.apache.org/jira/browse/HDDS-3203 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-3202) Certs for security needs a new root

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3202: -- Summary: Certs for security needs a new root Key: HDDS-3202 URL: https://issues.apache.org/jira/browse/HDDS-3202 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-3201) SafeMode exit rule for all SCMs

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3201: -- Summary: SafeMode exit rule for all SCMs Key: HDDS-3201 URL: https://issues.apache.org/jira/browse/HDDS-3201 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[GitHub] [hadoop-ozone] captainzmc edited a comment on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly

2020-03-16 Thread GitBox
captainzmc edited a comment on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly URL: https://github.com/apache/hadoop-ozone/pull/618#issuecomment-599371135 When output, the long type will be changed to date, and the format is as follows:

[jira] [Created] (HDDS-3200) Handle NodeReport from DN to SCMs

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3200: -- Summary: Handle NodeReport from DN to SCMs Key: HDDS-3200 URL: https://issues.apache.org/jira/browse/HDDS-3200 Project: Hadoop Distributed Data Store Issue Type:

[GitHub] [hadoop-ozone] adoroszlai commented on issue #682: HDDS-3181. Intermittent failure in TestReconWithOzoneManager due to BindException

2020-03-16 Thread GitBox
adoroszlai commented on issue #682: HDDS-3181. Intermittent failure in TestReconWithOzoneManager due to BindException URL: https://github.com/apache/hadoop-ozone/pull/682#issuecomment-599381783 Thanks @avijayanhwx and @vivekratnavel for the review.

[jira] [Created] (HDDS-3199) Handle PipelineAction and OpenPipline from DN to SCM

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3199: -- Summary: Handle PipelineAction and OpenPipline from DN to SCM Key: HDDS-3199 URL: https://issues.apache.org/jira/browse/HDDS-3199 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3198) Handle pipeline reports

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3198: -- Summary: Handle pipeline reports Key: HDDS-3198 URL: https://issues.apache.org/jira/browse/HDDS-3198 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[GitHub] [hadoop-ozone] captainzmc commented on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly

2020-03-16 Thread GitBox
captainzmc commented on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly URL: https://github.com/apache/hadoop-ozone/pull/618#issuecomment-599371135 When output, the long type will be changed to date, and the format is as follows:

[jira] [Created] (HDDS-3197) BackgroundPipelineCreator can only serve leader

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3197: -- Summary: BackgroundPipelineCreator can only serve leader Key: HDDS-3197 URL: https://issues.apache.org/jira/browse/HDDS-3197 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3196) Pipeline mutation needs to applyTransaction before writing to DB

2020-03-16 Thread Li Cheng (Jira)
Li Cheng created HDDS-3196: -- Summary: Pipeline mutation needs to applyTransaction before writing to DB Key: HDDS-3196 URL: https://issues.apache.org/jira/browse/HDDS-3196 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] runzhiwang edited a comment on issue #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-16 Thread GitBox
runzhiwang edited a comment on issue #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645#issuecomment-599356232 @elek Hi, I have updated PR according to you suggestion, thank you very much. Additionally, if throw exception when execute

<    1   2