I'm working with a cluster that's having trouble reforming.
Before I explain, here is the totem section (which is the same on both
nodes, except for the nodeid).
totem {
nodeid: X
rrp_mode: none
token_retransmits_before_loss_const: 10
join: 1000
max_messages: 20
vsftype: none
token: 20000
consensus: 2500
send_join: 45
secauth: off
version: 2
}
Oh, and the version: AIS Executive Service RELEASE 'subrev 1152
version 0.80'
* Two nodes: hikari and hikari2
* We break the comms on hikari2 (if down)
* hikari notices and shoots hikari2
* hikari2 boots
So far, so good.
* hikari2 starts openais
Jun 22 11:47:46 hikari2 openais[4172]: [MAIN ] AIS Executive Service
RELEASE 'subrev 1152 version 0.80'
* Now the fun begins.
hikari seems to be noticing that hikari2 is out there because there's
a lot of "entering GATHER state from X" messages:
Jun 22 11:47:47 hikari openais[3868]: [TOTEM] entering GATHER state
from 11.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
..
Jun 22 11:47:50 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
..
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
But the membership never reforms and hikari2 still comes up alone:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] New Configuration:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] r(0) ip(172.16.1.112)
Which means hikari2 soon reboots hikari and the cycle continues.
I'm wondering, could it be anything to do with the way openais handles
the initial 'if down' event?
It seems to rebind to the loopback address (possibly with unintended
consequences):
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] The token was lost in
the OPERATIONAL state.
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] Receive multicast
socket recv buffer size (262142 bytes).
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] Transmit multicast
socket send buffer size (262142 bytes).
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] The network interface
is down.
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] entering GATHER state
from 15.
Jun 22 11:45:24 hikari2 openais[4214]: [TOTEM] entering GATHER state
from 2.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] Saving state aru ae
high seq received ae
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] Storing new sequence id
for ring 22128
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] entering COMMIT state.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] entering RECOVERY state.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] position [0] member
127.0.0.1:
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] previous ring seq
139556 rep 172.16.1.110
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] aru ae high delivered
ae received flag 1
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:45:26 hikari2 openais[4214]: [TOTEM] Sending initial ORF token
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] New Configuration:
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] r(0) ip(127.0.0.1)
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] Members Left:
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] r(0) ip(172.16.1.112)
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] Members Joined:
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:45:26 hikari2 openais[4214]: [CLM ] New Configuration:
Jun 22 11:45:27 hikari2 openais[4214]: [CLM ] r(0) ip(127.0.0.1)
Thoughts? Its very repeatable.
Full logs below.
## Logs from hikari
#### 'if down' on hikari2
Jun 22 11:45:27 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:45:27 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:45:27 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:45:27 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:45:27 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.112)
Jun 22 11:45:27 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:45:27 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:45:27 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:45:27 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:45:27 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:45:27 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:45:27 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:45:27 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:45:27 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
#### hikari forces hikari2 to reboot
Jun 22 11:47:47 hikari openais[3868]: [TOTEM] entering GATHER state
from 11.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] Saving state aru 2e high
seq received 2e
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] Storing new sequence id
for ring 2212c
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] entering COMMIT state.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] entering RECOVERY state.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] position [0] member
172.16.1.110:
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] previous ring seq 139560
rep 172.16.1.110
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] aru 2e high delivered 2e
received flag 1
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] Sending initial ORF token
Jun 22 11:47:49 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:49 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:49 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:49 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:49 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:49 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:49 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:49 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:49 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:49 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:49 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:47:49 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:47:49 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
Jun 22 11:47:50 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] Saving state aru b high
seq received b
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] Storing new sequence id
for ring 22130
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] entering COMMIT state.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] entering RECOVERY state.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] position [0] member
172.16.1.110:
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] previous ring seq 139564
rep 172.16.1.110
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] aru b high delivered b
received flag 1
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] Sending initial ORF token
Jun 22 11:47:52 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:52 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:52 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:52 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:52 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:52 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:52 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:52 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:52 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:52 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:52 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:47:52 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:47:52 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
Jun 22 11:47:53 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] Saving state aru b high
seq received b
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] Storing new sequence id
for ring 22134
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering COMMIT state.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering RECOVERY state.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] position [0] member
172.16.1.110:
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] previous ring seq 139568
rep 172.16.1.110
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] aru b high delivered b
received flag 1
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] Sending initial ORF token
Jun 22 11:47:56 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:56 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:56 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:56 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:56 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:56 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:56 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:56 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:56 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:56 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:56 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:47:56 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
Jun 22 11:47:56 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] Saving state aru b high
seq received b
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] Storing new sequence id
for ring 22138
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering COMMIT state.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering RECOVERY state.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] position [0] member
172.16.1.110:
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] previous ring seq 139572
rep 172.16.1.110
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] aru b high delivered b
received flag 1
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] Sending initial ORF token
Jun 22 11:47:59 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:59 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:59 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:59 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:59 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:59 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:59 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:47:59 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:47:59 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:47:59 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:47:59 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:47:59 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
Jun 22 11:47:59 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] entering GATHER state
from 0.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] Saving state aru b high
seq received b
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] Storing new sequence id
for ring 2213c
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] entering COMMIT state.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] entering RECOVERY state.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] position [0] member
172.16.1.110:
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] previous ring seq 139576
rep 172.16.1.110
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] aru b high delivered b
received flag 1
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] Sending initial ORF token
Jun 22 11:48:02 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:48:02 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:48:02 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:48:02 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:48:02 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:48:02 hikari openais[3868]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:48:02 hikari openais[3868]: [CLM ] New Configuration:
Jun 22 11:48:02 hikari openais[3868]: [CLM ] r(0) ip(172.16.1.110)
Jun 22 11:48:02 hikari openais[3868]: [CLM ] Members Left:
Jun 22 11:48:02 hikari openais[3868]: [CLM ] Members Joined:
Jun 22 11:48:02 hikari openais[3868]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:48:02 hikari openais[3868]: [CLM ] got nodejoin message
172.16.1.110
Jun 22 11:48:02 hikari openais[3868]: [TOTEM] entering GATHER state
from 9.
#### hikari2 forces hikari to reboot
Jun 22 11:50:20 hikari openais[3825]: [MAIN ] AIS Executive Service
RELEASE 'subrev 1152 version 0.80'
## Logs from hikari2
Jun 22 11:47:46 hikari2 openais[4172]: [MAIN ] AIS Executive Service
RELEASE 'subrev 1152 version 0.80'
Jun 22 11:47:46 hikari2 openais[4172]: [MAIN ] Copyright (C) 2002-2006
MontaVista Software, Inc and contributors.
Jun 22 11:47:46 hikari2 openais[4172]: [MAIN ] Copyright (C) 2006 Red
Hat, Inc.
Jun 22 11:47:46 hikari2 openais[4172]: [MAIN ] AIS Executive Service:
started and ready to provide service.
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] Token Timeout (20000
ms) retransmit timeout (1960 ms)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] token hold (1558 ms)
retransmits before loss (10 retrans)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] join (1000 ms)
send_join (45 ms) consensus (2500 ms) merge (200 ms)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] downcheck (1000 ms)
fail to recv const (50 msgs)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] seqno unchanged const
(30 rotations) Maximum network MTU 1500
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] window size per
rotation (50 messages) maximum messages per rotation (20 messages)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] send threads (0 threads)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] RRP token expired
timeout (1960 ms)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] RRP token problem
counter (2000 ms)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] RRP threshold (10
problem count)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] RRP mode set to none.
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM]
heartbeat_failures_allowed (0)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] max_network_delay (50 ms)
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] HeartBeat is Disabled.
To enable set heartbeat_failures_allowed > 0
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] Receive multicast
socket recv buffer size (262142 bytes).
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] Transmit multicast
socket send buffer size (262142 bytes).
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] The network interface
[172.16.1.112] is now up.
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] Created or loaded
sequence id 139556.172.16.1.112 for this ring.
Jun 22 11:47:47 hikari2 openais[4172]: [TOTEM] entering GATHER state
from 15.
Jun 22 11:47:48 hikari2 openais[4172]: [MAIN ] Service initialized
'Pacemaker Cluster Manager'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais extended virtual synchrony service'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais cluster membership service B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais availability management framework B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais checkpoint service B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais event service B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais distributed locking service B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais message service B.01.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais configuration service'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais cluster closed process group service v1.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SERV ] Service initialized
'openais cluster config database access v1.01'
Jun 22 11:47:48 hikari2 openais[4172]: [SYNC ] Not using a virtual
synchrony filter.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] Creating commit token
because I am the rep.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] Saving state aru 0 high
seq received 0
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] Storing new sequence id
for ring 22128
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] entering COMMIT state.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] entering RECOVERY state.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] position [0] member
172.16.1.112:
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] previous ring seq
139556 rep 172.16.1.112
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] aru 0 high delivered 0
received flag 1
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] Did not need to
originate any messages in recovery.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] Sending initial ORF token
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] New Configuration:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] Members Left:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] Members Joined:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] CLM CONFIGURATION CHANGE
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] New Configuration:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] r(0) ip(172.16.1.112)
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] Members Left:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] Members Joined:
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] r(0) ip(172.16.1.112)
Jun 22 11:47:48 hikari2 openais[4172]: [SYNC ] This node is within the
primary component and will provide service.
Jun 22 11:47:48 hikari2 openais[4172]: [TOTEM] entering OPERATIONAL
state.
Jun 22 11:47:48 hikari2 openais[4172]: [CLM ] got nodejoin message
172.16.1.112
#### 20s later, hikari2 reboots hikari
-- Andrew
_______________________________________________
Openais mailing list
[email protected]
https://lists.linux-foundation.org/mailman/listinfo/openais
