[
https://issues.apache.org/jira/browse/HDDS-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426423#comment-17426423
]
Aswin Shakil Balasubramanian commented on HDDS-5843:
----------------------------------------------------
*Stack Trace:*
{code:java}
java.io.IOException: Cannot add container to
pipeline=PipelineID=e7f7dc41-6005-4c8f-8249-f3b021492422 in closed state
at
org.apache.hadoop.hdds.scm.pipeline.PipelineStateMap.addContainerToPipeline(PipelineStateMap.java:101)
at
org.apache.hadoop.hdds.scm.pipeline.PipelineStateManagerV2Impl.addContainerToPipeline(PipelineStateManagerV2Impl.java:114)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.apache.hadoop.hdds.scm.ha.SCMHAInvocationHandler.invokeLocal(SCMHAInvocationHandler.java:83)
at
org.apache.hadoop.hdds.scm.ha.SCMHAInvocationHandler.invoke(SCMHAInvocationHandler.java:68)
at com.sun.proxy.$Proxy14.addContainerToPipeline(Unknown Source)
at
org.apache.hadoop.hdds.scm.pipeline.PipelineManagerV2Impl.addContainerToPipeline(PipelineManagerV2Impl.java:240)
at
org.apache.hadoop.hdds.scm.container.ContainerStateManagerImpl.initialize(ContainerStateManagerImpl.java:232)
at
org.apache.hadoop.hdds.scm.container.ContainerStateManagerImpl.<init>(ContainerStateManagerImpl.java:153)
at
org.apache.hadoop.hdds.scm.container.ContainerStateManagerImpl.<init>(ContainerStateManagerImpl.java:81)
at
org.apache.hadoop.hdds.scm.container.ContainerStateManagerImpl$Builder.build(ContainerStateManagerImpl.java:560)
at
org.apache.hadoop.hdds.scm.container.ContainerManagerImpl.<init>(ContainerManagerImpl.java:119)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManager.initializeSystemManagers(StorageContainerManager.java:544)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManager.<init>(StorageContainerManager.java:330)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManager.createSCM(StorageContainerManager.java:446)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManager.createSCM(StorageContainerManager.java:458)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter$SCMStarterHelper.start(StorageContainerManagerStarter.java:165)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.startScm(StorageContainerManagerStarter.java:139)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.call(StorageContainerManagerStarter.java:68)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.call(StorageContainerManagerStarter.java:44)
at picocli.CommandLine.executeUserObject(CommandLine.java:1933)
at picocli.CommandLine.access$1100(CommandLine.java:145)
at
picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2332)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2326)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2291)
at
picocli.CommandLine$AbstractParseResultHandler.handleParseResult(CommandLine.java:2152)
at picocli.CommandLine.parseWithHandlers(CommandLine.java:2530)
at picocli.CommandLine.parseWithHandler(CommandLine.java:2465)
at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:96)
at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:87)
at
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.main(StorageContainerManagerStarter.java:57)
{code}
> SCM terminates when adding container to a pipeline during startup
> -----------------------------------------------------------------
>
> Key: HDDS-5843
> URL: https://issues.apache.org/jira/browse/HDDS-5843
> Project: Apache Ozone
> Issue Type: Bug
> Components: SCM HA
> Reporter: Soumitra Sulav
> Assignee: Aswin Shakil Balasubramanian
> Priority: Major
>
> SCM terminates when a container in an OPEN state is added to a CLOSED
> pipeline during SCM startup.
> *Error:*
> {code:java}
> Cannot add container to
> pipeline=PipelineID=e7f7dc41-6005-4c8f-8249-f3b021492422 in closed state
> {code}
> *Cause:*
> Container Close happens after the Pipeline Close. The transaction buffer is
> flushed into SCM DB for every 1000 transactions, the pipeline close comes
> within the 1000 transaction and it is flushed to the SCM DB but before the
> Container Close is flushed into the SCM DB the SCM goes.
> When the SCM restarts it is in an inconsistent state where some containers
> are in an OPEN state for a CLOSED pipeline.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
