[
https://issues.apache.org/jira/browse/HDDS-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924007#comment-16924007
]
Hudson commented on HDDS-1561:
------------------------------
FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17237 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17237/])
HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis (nanda: rev
6e4cdf89effb11c5ec36578da83a46d3d3c48c11)
* (edit)
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/common/transport/server/ratis/TestCSMMetrics.java
* (edit)
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/TestCloseContainerCommandHandler.java
* (edit)
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerRatisServer.java
* (edit)
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/transport/server/ratis/XceiverServerRatis.java
* (edit) hadoop-hdds/pom.xml
* (edit)
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/ozoneimpl/OzoneContainer.java
* (edit)
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/server/TestSecureContainerServer.java
* (edit)
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/transport/server/ratis/ContainerStateMachine.java
* (edit) hadoop-ozone/pom.xml
* (edit)
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/TestCloseContainerByPipeline.java
* (edit)
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/impl/ContainerData.java
* (edit)
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/server/TestContainerServer.java
* (edit)
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/CloseContainerCommandHandler.java
> Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove
> -----------------------------------------------------------------
>
> Key: HDDS-1561
> URL: https://issues.apache.org/jira/browse/HDDS-1561
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Datanode, SCM
> Affects Versions: 0.3.0
> Reporter: Mukul Kumar Singh
> Assignee: Lokesh Jain
> Priority: Blocker
> Labels: pull-request-available
> Attachments: HDDS-1561.001.patch
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Right now, if a pipeline is destroyed by SCM, all the container on the
> pipeline are marked as quasi closed when datanode received close container
> command. SCM while processing these containers reports, marks these
> containers as closed once majority of the nodes are available.
> This is however not a sufficient condition in cases where the raft log
> directory is missing or corrupted. As the containers will not have all the
> applied transaction.
> To solve this problem, we should QUASI_CLOSE the containers in datanode as
> part of ratis groupRemove. If a container is in OPEN state in datanode
> without any active pipeline, it will be marked as Unhealthy while processing
> close container command.
> cc [~jnp], [~shashikant], [~sdeka], [~nandakumar131]
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
