[
https://issues.apache.org/jira/browse/RATIS-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794882#comment-17794882
]
Tsz-wo Sze commented on RATIS-1958:
-----------------------------------
[~weichiu], it looks like a bug in Ozone. It added the same group twice
#
{code}
2023-12-08 14:27:26,778 INFO [main]-org.apache.ratis.server.RaftServer: om27:
addNew
group-9F198C4C3682:[om28|rpc:ccycloud-3.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER,
om26|rpc:ccycloud-2.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER,
om27|rpc:ccycloud-1.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER]
returns group-9F198C4C3682:java.util.concurrent.CompletableFuture@43982337[Not
completed]
{code}
#
{code}
2023-12-08 14:27:40,160 INFO [main]-org.apache.ratis.server.RaftServer: om27:
addNew
group-9F198C4C3682:[om28|rpc:ccycloud-3.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER,
om26|rpc:ccycloud-2.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER,
om27|rpc:ccycloud-1.weichiu.root.comops.site:9872|priority:0|startupRole:FOLLOWER]
returns group-9F198C4C3682:java.util.concurrent.CompletableFuture@4667c4c1[Not
completed]
{code}
> ILLEGAL TRANSITION RUNNING -> STARTING
> --------------------------------------
>
> Key: RATIS-1958
> URL: https://issues.apache.org/jira/browse/RATIS-1958
> Project: Ratis
> Issue Type: Bug
> Reporter: Wei-Chiu Chuang
> Priority: Major
> Attachments: om_illegal_transition.tgz, ozone-om.log
>
>
> Seen this error on a new Ozone cluster and OM crashed, unable to restart.
> (Version Cloudera CDP 7.1.9). Notably, I've seen this error twice in a week
> on separate clusters.
>
> {code:java}
> 2023-12-08 14:27:15,265 ERROR
> [main]-org.apache.hadoop.ozone.om.OzoneManagerStarter: OM start failed with
> exception
> java.util.concurrent.CompletionException: java.lang.IllegalStateException:
> ILLEGAL TRANSITION: In OzoneManagerStateMachine:om27:group-9F198C4C3682,
> RUNNING -> STARTING
> at
> java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
> at
> java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
> at
> java.util.concurrent.CompletableFuture.biRelay(CompletableFuture.java:1298)
> at
> java.util.concurrent.CompletableFuture$BiRelay.tryFire(CompletableFuture.java:1284)
> at
> java.util.concurrent.CompletableFuture$CoCompletion.tryFire(CompletableFuture.java:1034)
> at
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> at
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> at
> org.apache.ratis.util.ConcurrentUtils.accept(ConcurrentUtils.java:189)
> at
> org.apache.ratis.util.ConcurrentUtils.lambda$null$4(ConcurrentUtils.java:180)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.IllegalStateException: ILLEGAL TRANSITION: In
> OzoneManagerStateMachine:om27:group-9F198C4C3682, RUNNING -> STARTING
> at
> org.apache.ratis.util.Preconditions.assertTrue(Preconditions.java:60)
> at org.apache.ratis.util.LifeCycle$State.validate(LifeCycle.java:121)
> at org.apache.ratis.util.LifeCycle.transition(LifeCycle.java:164)
> at
> org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:268)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerStateMachine.initialize(OzoneManagerStateMachine.java:140)
> at
> org.apache.ratis.server.impl.ServerState.initialize(ServerState.java:173)
> at
> org.apache.ratis.server.impl.RaftServerImpl.start(RaftServerImpl.java:338)
> at
> org.apache.ratis.util.ConcurrentUtils.accept(ConcurrentUtils.java:188)
> ... 4 more {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
