Shashikant Banerjee created HDDS-5381:
-----------------------------------------
Summary: SCM terminated with exit status 1: null
Key: HDDS-5381
URL: https://issues.apache.org/jira/browse/HDDS-5381
Project: Apache Ozone
Issue Type: Bug
Components: SCM HA
Reporter: Nilotpal Nandi
Assignee: Shashikant Banerjee
{code:java}
steps taken :
Running ozone fault injection tests which involve activating/deactivating
pipelines.
In one of the tests, while activating pipeline, SCM terminated.SCM log:
http://logserver.eng.hortonworks.com/s3/quanta/14903496/UNZIPPED_LOGS/QUASAR_DIAG_LOGS/debugging_files_20210623_213812930735/quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site.logs/var/log/hadoop-ozone/ozone-scm.log2021-06-23
23:56:59,922 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for
dn/[email protected] (auth:KERBEROS)
for protocol=interface
org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
2021-06-23 23:57:00,868 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth
successful for dn/[email protected]
(auth:KERBEROS)
2021-06-23 23:57:00,874 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for
dn/[email protected] (auth:KERBEROS)
for protocol=interface
org.apache.hadoop.ozone.protocol.StorageContainerDatanodeProtocol
2021-06-23 23:57:03,166 WARN
org.apache.hadoop.hdds.scm.pipeline.PipelineStateManager: Pipeline
PipelineID=661b906a-fd6b-4c14-b6b5-8c0a12c67ff7 is not found in the pipeline
Map. Pipeline may have been deleted already.
2021-06-23 23:57:03,168 ERROR org.apache.ratis.statemachine.StateMachine:
Terminating with exit status 1: null
java.lang.IllegalMonitorStateException
at
java.base/java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(ReentrantReadWriteLock.java:372)
at
java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1302)
at
java.base/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(ReentrantReadWriteLock.java:1147)
at
org.apache.hadoop.hdds.scm.pipeline.PipelineStateManagerV2Impl.updatePipelineState(PipelineStateManagerV2Impl.java:270)
at jdk.internal.reflect.GeneratedMethodAccessor101.invoke(Unknown
Source)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.apache.hadoop.hdds.scm.ha.SCMStateMachine.process(SCMStateMachine.java:168)
at
org.apache.hadoop.hdds.scm.ha.SCMStateMachine.applyTransaction(SCMStateMachine.java:139)
at
org.apache.ratis.server.impl.RaftServerImpl.applyLogToStateMachine(RaftServerImpl.java:1690)
at
org.apache.ratis.server.impl.StateMachineUpdater.applyLog(StateMachineUpdater.java:234)
at
org.apache.ratis.server.impl.StateMachineUpdater.run(StateMachineUpdater.java:179)
at java.base/java.lang.Thread.run(Thread.java:834)
2021-06-23 23:57:03,174 INFO
org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down StorageContainerManager at
quasar-bcnwtg-3.quasar-bcnwtg.root.hwx.site/172.27.106.70
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
