kaijchen commented on PR #827: URL: https://github.com/apache/ratis/pull/827#issuecomment-1443228167
> Repeated 100x, found 2 failures (caused by a different reason): > https://github.com/kaijchen/ratis/actions/runs/4259760865 Seems it's caused by lost leadership. Is an entrie appended when lost leadership? ```log 2023-02-24 08:34:01,826 [s0@group-2A3370FE065E-LeaderStateImpl] WARN server.RaftServer$Division (LeaderStateImpl.java:checkLeadership(1098)) - s0@group-2A3370FE065E-LeaderStateImpl: Lost leadership on term: 2. Election timeout: 300ms. In charge for: 5009ms. Conf: 0: peers:[s0|rpc:localhost:35483|admin:localhost:45483|client:localhost:35767|dataStream:localhost:35067|priority:0|startupRole:FOLLOWER, s1|rpc:localhost:43385|admin:localhost:45063|client:localhost:32935|dataStream:localhost:33271|priority:0|startupRole:FOLLOWER, s2|rpc:localhost:36721|admin:localhost:44199|client:localhost:34095|dataStream:localhost:37345|priority:0|startupRole:FOLLOWER]|listeners:[], old=null 2023-02-24 08:34:01,827 [s0@group-2A3370FE065E-LeaderStateImpl] WARN server.RaftServer$Division (LeaderStateImpl.java:lambda$checkLeadership$20(1102)) - Follower s0@group-2A3370FE065E->s1(c40,m40,n41, attendVote=true, lastRpcSendTime=26, lastRpcResponseTime=2310) 2023-02-24 08:34:01,827 [s0@group-2A3370FE065E-LeaderStateImpl] WARN server.RaftServer$Division (LeaderStateImpl.java:lambda$checkLeadership$20(1102)) - Follower s0@group-2A3370FE065E->s2(c40,m40,n41, attendVote=true, lastRpcSendTime=27, lastRpcResponseTime=330) 2023-02-24 08:34:01,828 [s0@group-2A3370FE065E-LeaderStateImpl] INFO server.RaftServer$Division (RaftServerImpl.java:setRole(329)) - s0@group-2A3370FE065E: changes role from LEADER to FOLLOWER at term 2 for StepDownReason:LOST_MAJORITY_HEARTBEATS 2023-02-24 08:34:01,828 [s0@group-2A3370FE065E-LeaderStateImpl] INFO impl.RoleInfo (RoleInfo.java:shutdownLeaderState(93)) - s0: shutdown s0@group-2A3370FE065E-LeaderStateImpl 2023-02-24 08:34:01,828 [s0@group-2A3370FE065E->s1-LogAppenderDefault-LogAppenderDaemon] INFO leader.LogAppenderDaemon (LogAppenderDaemon.java:run(83)) - s0@group-2A3370FE065E->s1-LogAppenderDefault-LogAppenderDaemon was interrupted: java.lang.InterruptedException 2023-02-24 08:34:01,829 [s0@group-2A3370FE065E-LeaderStateImpl] INFO impl.PendingRequests (PendingRequests.java:sendNotLeaderResponses(282)) - s0@group-2A3370FE065E-PendingRequests: sendNotLeaderResponses 2023-02-24 08:34:01,830 [s0@group-2A3370FE065E->s2-LogAppenderDefault-LogAppenderDaemon] INFO leader.LogAppenderDaemon (LogAppenderDaemon.java:run(83)) - s0@group-2A3370FE065E->s2-LogAppenderDefault-LogAppenderDaemon was interrupted: java.lang.InterruptedException 2023-02-24 08:34:01,832 [s0@group-2A3370FE065E-LeaderStateImpl] INFO server.RaftServer$Division (ServerState.java:setLeader(260)) - s0@group-2A3370FE065E: change Leader from s0 to null at term 2 for StepDownReason:LOST_MAJORITY_HEARTBEATS 2023-02-24 08:34:01,832 [s0@group-2A3370FE065E-LeaderStateImpl] INFO impl.RoleInfo (RoleInfo.java:updateAndGet(139)) - s0: start s0@group-2A3370FE065E-FollowerState 2023-02-24 08:34:02,110 [s0@group-2A3370FE065E-FollowerState] INFO impl.FollowerState (FollowerState.java:lostMajorityHeartbeatsRecently(108)) - s0@group-2A3370FE065E-FollowerState: Skipping leader election since it stepped down recently (elapsed = 277ms < waitTime = 10s) 2023-02-24 08:34:02,369 [s0@group-2A3370FE065E-FollowerState] INFO impl.FollowerState (FollowerState.java:lostMajorityHeartbeatsRecently(108)) - s0@group-2A3370FE065E-FollowerState: Skipping leader election since it stepped down recently (elapsed = 536ms < waitTime = 10s) 2023-02-24 08:34:02,524 [Time-limited test] INFO segmented.SegmentedRaftLogWorker (SegmentedRaftLogWorker.java:close(242)) - s2@group-2A3370FE065E-SegmentedRaftLogWorker close() 2023-02-24 08:34:02,525 [Time-limited test] INFO server.RaftServer$Division (RaftServerImpl.java:lambda$close$4(466)) - s0@group-2A3370FE065E: shutdown 2023-02-24 08:34:02,525 [Time-limited test] INFO util.JmxRegister (JmxRegister.java:unregister(73)) - Successfully un-registered JMX Bean with object name Ratis:service=RaftServer,group=group-2A3370FE065E,id=s0 2023-02-24 08:34:02,525 [Time-limited test] INFO impl.RoleInfo (RoleInfo.java:shutdownFollowerState(110)) - s0: shutdown s0@group-2A3370FE065E-FollowerState 2023-02-24 08:34:02,525 [Time-limited test] INFO impl.StateMachineUpdater (StateMachineUpdater.java:stopAndJoin(154)) - s0@group-2A3370FE065E-StateMachineUpdater: set stopIndex = 40 2023-02-24 08:34:02,525 [s0@group-2A3370FE065E-FollowerState] INFO impl.FollowerState (FollowerState.java:run(152)) - s0@group-2A3370FE065E-FollowerState was interrupted 2023-02-24 08:34:02,525 [Time-limited test] INFO server.RaftServer$Division (ServerState.java:close(414)) - s0@group-2A3370FE065E: applyIndex: 40 2023-02-24 08:34:03,520 [Time-limited test] INFO segmented.SegmentedRaftLogWorker (SegmentedRaftLogWorker.java:close(242)) - s0@group-2A3370FE065E-SegmentedRaftLogWorker close() ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
