The log in my previous email is a mess. Here is a link to it in a form that is easy to read.
http://www.psmnv.com/downloads/corosync.log -- Eric Robinson > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of > Robinson, Eric > Sent: Thursday, November 03, 2011 5:04 PM > To: General Linux-HA mailing list > Subject: Re: [Linux-HA] ringid FAULTY adminisrtative > intervention required > > Can anyone see from this debug log why the ring is being > marked faulty? > The "FAULTY" message is the last line. > > Nov 03 16:57:01 corosync [MAIN ] Corosync Cluster Engine ('1.2.3'): > started and ready to provide service. > Nov 03 16:57:01 corosync [MAIN ] Corosync built-in features: > nss rdma Nov 03 16:57:01 corosync [MAIN ] Successfully read > main configuration file '/etc/corosync/corosync.conf'. > Nov 03 16:57:01 corosync [TOTEM ] Token Timeout (5000 ms) > retransmit timeout (490 ms) Nov 03 16:57:01 corosync [TOTEM ] > token hold (382 ms) retransmits before loss (10 retrans) Nov > 03 16:57:01 corosync [TOTEM ] join (1000 ms) send_join (0 ms) > consensus (7500 ms) merge (200 ms) Nov 03 16:57:01 corosync > [TOTEM ] downcheck (1000 ms) fail to recv const (50 msgs) Nov > 03 16:57:01 corosync [TOTEM ] seqno unchanged const (30 > rotations) Maximum network MTU 1402 Nov 03 16:57:01 corosync > [TOTEM ] window size per rotation (50 messages) maximum > messages per rotation (20 messages) Nov 03 16:57:01 corosync > [TOTEM ] missed count const (5 messages) Nov 03 16:57:01 > corosync [TOTEM ] send threads (0 threads) Nov 03 16:57:01 > corosync [TOTEM ] RRP token expired timeout (490 ms) Nov 03 > 16:57:01 corosync [TOTEM ] RRP token problem counter (2000 > ms) Nov 03 16:57:01 corosync [TOTEM ] RRP threshold (10 > problem count) Nov 03 16:57:01 corosync [TOTEM ] RRP mode set > to passive. > Nov 03 16:57:01 corosync [TOTEM ] heartbeat_failures_allowed > (0) Nov 03 16:57:01 corosync [TOTEM ] max_network_delay (50 > ms) Nov 03 16:57:01 corosync [TOTEM ] HeartBeat is Disabled. > To enable set heartbeat_failures_allowed > 0 Nov 03 16:57:01 > corosync [TOTEM ] Initializing transport (UDP/IP). > Nov 03 16:57:01 corosync [TOTEM ] Initializing transmit/receive > security: libtomcrypt SOBER128/SHA1HMAC (mode 0). > Nov 03 16:57:01 corosync [TOTEM ] Initializing transport (UDP/IP). > Nov 03 16:57:01 corosync [TOTEM ] Initializing transmit/receive > security: libtomcrypt SOBER128/SHA1HMAC (mode 0). > Nov 03 16:57:01 corosync [IPC ] you are using ipc api v2 > Nov 03 16:57:01 corosync [TOTEM ] Receive multicast socket > recv buffer size (262142 bytes). > Nov 03 16:57:01 corosync [TOTEM ] Transmit multicast socket > send buffer size (262142 bytes). > Nov 03 16:57:01 corosync [TOTEM ] The network interface > [192.168.10.55] is now up. > Nov 03 16:57:01 corosync [TOTEM ] Created or loaded sequence id > 84.192.168.10.55 for this ring. > Set r/w permissions for uid=0, gid=0 on /var/log/corosync.log > Nov 03 16:57:01 corosync [pcmk ] debug: pcmk_user_lookup: > Cluster user root has uid=0 gid=0 Nov 03 16:57:01 corosync > [pcmk ] info: process_ais_conf: Reading configure Nov 03 > 16:57:01 corosync [pcmk ] info: config_find_init: Local handle: > 2013064636357672962 for logging > Nov 03 16:57:01 corosync [pcmk ] info: config_find_next: > Processing additional logging options... > Nov 03 16:57:01 corosync [pcmk ] info: get_config_opt: Found 'on' for > option: debug > Nov 03 16:57:01 corosync [pcmk ] info: get_config_opt: Found > 'yes' for > option: to_logfile > Nov 03 16:57:01 corosync [pcmk ] info: get_config_opt: Found > '/var/log/corosync.log' for option: logfile Nov 03 16:57:01 > corosync [pcmk ] info: get_config_opt: Found 'no' for > option: to_syslog > Nov 03 16:57:01 corosync [pcmk ] info: process_ais_conf: > User configured file based logging and explicitly disabled syslog. > Nov 03 16:57:01 corosync [pcmk ] info: config_find_init: > Local handle: > 4730966301143465987 for quorum > Nov 03 16:57:01 corosync [pcmk ] info: config_find_next: No > additional configuration supplied for: quorum Nov 03 16:57:01 > corosync [pcmk ] info: get_config_opt: No default for > option: provider > Nov 03 16:57:01 corosync [pcmk ] info: config_find_init: > Local handle: > 7739444317642555396 for service > Nov 03 16:57:01 corosync [pcmk ] info: config_find_next: > Processing additional service options... > Nov 03 16:57:01 corosync [pcmk ] info: get_config_opt: Found '1' for > option: ver > Nov 03 16:57:01 corosync [pcmk ] info: process_ais_conf: Enabling MCP > mode: Use the Pacemaker init script to complete Pacemaker > startup Nov 03 16:57:01 corosync [pcmk ] info: > get_config_opt: Defaulting to 'pcmk' for option: clustername > Nov 03 16:57:01 corosync [pcmk ] info: get_config_opt: > Defaulting to 'no' for option: use_logd Nov 03 16:57:01 > corosync [pcmk ] info: get_config_opt: Defaulting to 'no' > for option: use_mgmtd Nov 03 16:57:01 corosync [pcmk ] info: > pcmk_startup: CRM: Initialized Nov 03 16:57:01 corosync [pcmk > ] Logging: Initialized pcmk_startup Nov 03 16:57:01 corosync > [pcmk ] info: pcmk_startup: Maximum core file size is: > 18446744073709551615 Nov 03 16:57:01 corosync [pcmk ] debug: > pcmk_user_lookup: Cluster user hacluster has uid=495 gid=501 > Nov 03 16:57:01 corosync [pcmk ] info: pcmk_startup: > Service: 10 Nov 03 16:57:01 corosync [pcmk ] info: > pcmk_startup: Local hostname: > ha08a.mycharts.md > Nov 03 16:57:01 corosync [pcmk ] info: pcmk_update_nodeid: Local node > id: 923445440 > Nov 03 16:57:01 corosync [pcmk ] info: update_member: > Creating entry for node 923445440 born on 0 Nov 03 16:57:01 > corosync [pcmk ] info: update_member: 0x1b89020 Node > 923445440 now known as ha08a.mycharts.md (was: (null)) Nov 03 > 16:57:01 corosync [pcmk ] info: update_member: Node > ha08a.mycharts.md now has 1 quorum votes (was 0) Nov 03 > 16:57:01 corosync [pcmk ] info: update_member: Node > 923445440/ha08a.mycharts.md is now: member Nov 03 16:57:01 > corosync [SERV ] Service engine loaded: Pacemaker Cluster > Manager 1.1.2 Nov 03 16:57:01 corosync [SERV ] Service > engine loaded: corosync extended virtual synchrony service > Nov 03 16:57:01 corosync [SERV ] Service engine loaded: > corosync configuration service Nov 03 16:57:01 corosync [SERV > ] Service engine loaded: corosync cluster closed process > group service v1.01 Nov 03 16:57:01 corosync [MAIN ] > Compatibility mode set to whitetank. > Using V1 and V2 of the synchronization engine. > Nov 03 16:57:01 corosync [TOTEM ] Receive multicast socket > recv buffer size (262142 bytes). > Nov 03 16:57:01 corosync [TOTEM ] Transmit multicast socket > send buffer size (262142 bytes). > Nov 03 16:57:01 corosync [TOTEM ] The network interface > [198.51.100.55] is now up. > Nov 03 16:57:01 corosync [TOTEM ] entering GATHER state from 15. > Nov 03 16:57:01 corosync [TOTEM ] Creating commit token > because I am the rep. > Nov 03 16:57:01 corosync [TOTEM ] Saving state aru 0 high seq > received 0 Nov 03 16:57:01 corosync [TOTEM ] sendmsg(ucast) > failed (non-critical): > Destination address required > Nov 03 16:57:01 corosync [TOTEM ] Storing new sequence id for > ring 58 Nov 03 16:57:01 corosync [TOTEM ] entering COMMIT state. > Nov 03 16:57:01 corosync [TOTEM ] got commit token Nov 03 > 16:57:01 corosync [TOTEM ] entering RECOVERY state. > Nov 03 16:57:01 corosync [TOTEM ] position [0] member 192.168.10.55: > Nov 03 16:57:01 corosync [TOTEM ] previous ring seq 84 rep > 192.168.10.55 Nov 03 16:57:01 corosync [TOTEM ] aru 0 high > delivered 0 received flag 1 Nov 03 16:57:01 corosync [TOTEM ] > Did not need to originate any messages in recovery. > Nov 03 16:57:01 corosync [TOTEM ] got commit token Nov 03 > 16:57:01 corosync [TOTEM ] Sending initial ORF token Nov 03 > 16:57:01 corosync [TOTEM ] token retrans flag is 0 my set > retrans flag0 retrans queue empty 1 count 0, aru 0 Nov 03 > 16:57:01 corosync [TOTEM ] install seq 0 aru 0 high seq > received 0 Nov 03 16:57:01 corosync [TOTEM ] token retrans > flag is 0 my set retrans flag0 retrans queue empty 1 count 1, > aru 0 Nov 03 16:57:01 corosync [TOTEM ] install seq 0 aru 0 > high seq received 0 Nov 03 16:57:01 corosync [TOTEM ] token > retrans flag is 0 my set retrans flag0 retrans queue empty 1 > count 2, aru 0 Nov 03 16:57:01 corosync [TOTEM ] install seq > 0 aru 0 high seq received 0 Nov 03 16:57:01 corosync [TOTEM ] > token retrans flag is 0 my set retrans flag0 retrans queue > empty 1 count 3, aru 0 Nov 03 16:57:01 corosync [TOTEM ] > install seq 0 aru 0 high seq received 0 Nov 03 16:57:01 > corosync [TOTEM ] retrans flag count 4 token aru 0 install > seq 0 aru 0 0 Nov 03 16:57:01 corosync [TOTEM ] Resetting old > ring state Nov 03 16:57:01 corosync [TOTEM ] recovery to > regular 1-0 Nov 03 16:57:01 corosync [TOTEM ] Delivering to > app 1 to 0 Nov 03 16:57:01 corosync [pcmk ] notice: > pcmk_peer_update: Transitional membership event on ring 88: > memb=0, new=0, lost=0 Nov 03 16:57:01 corosync [pcmk ] > notice: pcmk_peer_update: Stable membership event on ring 88: > memb=1, new=1, lost=0 Nov 03 16:57:01 corosync [pcmk ] info: > pcmk_peer_update: NEW: > ha08a.mycharts.md 923445440 > Nov 03 16:57:01 corosync [pcmk ] debug: pcmk_peer_update: > Node 923445440 has address r(0) ip(192.168.10.55) r(1) > ip(198.51.100.55) Nov 03 16:57:01 corosync [pcmk ] info: > pcmk_peer_update: MEMB: > ha08a.mycharts.md 923445440 > Nov 03 16:57:01 corosync [pcmk ] debug: send_cluster_id: > Leaving born-on unset: 88 Nov 03 16:57:01 corosync [pcmk ] > debug: send_cluster_id: Local update: > id=923445440, born=0, seq=88 > Nov 03 16:57:01 corosync [SYNC ] This node is within the > primary component and will provide service. > Nov 03 16:57:01 corosync [TOTEM ] entering OPERATIONAL state. > Nov 03 16:57:01 corosync [TOTEM ] A processor joined or left > the membership and a new membership was formed. > Nov 03 16:57:01 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:01 corosync [TOTEM ] Delivering 0 > to 1 Nov 03 16:57:01 corosync [TOTEM ] Delivering MCAST > message with seq 1 to pending delivery queue Nov 03 16:57:01 > corosync [pcmk ] debug: pcmk_cluster_id_callback: Node > update: ha08a.mycharts.md (1.1.2) > Nov 03 16:57:01 corosync [SYNC ] confchg entries 1 Nov 03 > 16:57:01 corosync [SYNC ] Barrier Start Received From > 923445440 Nov 03 16:57:01 corosync [SYNC ] Barrier > completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Synchronization > actions starting for (dummy CLM service) Nov 03 16:57:01 > corosync [TOTEM ] mcasted message added to pending queue Nov > 03 16:57:01 corosync [TOTEM ] Delivering 1 to 2 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 2 to pending delivery queue Nov 03 16:57:01 corosync [TOTEM ] > mcasted message added to pending queue Nov 03 16:57:01 > corosync [TOTEM ] releasing messages up to and including > 1 > Nov 03 16:57:01 corosync [TOTEM ] Delivering 2 to 3 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 3 to pending delivery queue Nov 03 16:57:01 corosync [SYNC ] > confchg entries 1 Nov 03 16:57:01 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:01 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Committing > synchronization for (dummy CLM service) Nov 03 16:57:01 > corosync [SYNC ] Synchronization actions starting for (dummy > AMF service) Nov 03 16:57:01 corosync [TOTEM ] releasing > messages up to and including > 2 > Nov 03 16:57:01 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:01 corosync [TOTEM ] releasing > messages up to and including > 3 > Nov 03 16:57:01 corosync [TOTEM ] Delivering 3 to 4 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 4 to pending delivery queue Nov 03 16:57:01 corosync [SYNC ] > confchg entries 1 Nov 03 16:57:01 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:01 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Committing > synchronization for (dummy AMF service) Nov 03 16:57:01 > corosync [SYNC ] Synchronization actions starting for (dummy > CKPT service) Nov 03 16:57:01 corosync [TOTEM ] mcasted > message added to pending queue Nov 03 16:57:01 corosync > [TOTEM ] releasing messages up to and including > 4 > Nov 03 16:57:01 corosync [TOTEM ] Delivering 4 to 5 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 5 to pending delivery queue Nov 03 16:57:01 corosync [SYNC ] > confchg entries 1 Nov 03 16:57:01 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:01 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Committing > synchronization for (dummy CKPT service) Nov 03 16:57:01 > corosync [SYNC ] Synchronization actions starting for (dummy > EVT service) Nov 03 16:57:01 corosync [TOTEM ] mcasted > message added to pending queue Nov 03 16:57:01 corosync > [TOTEM ] Delivering 5 to 6 Nov 03 16:57:01 corosync [TOTEM ] > Delivering MCAST message with seq 6 to pending delivery queue > Nov 03 16:57:01 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:01 corosync [TOTEM ] releasing > messages up to and including > 5 > Nov 03 16:57:01 corosync [TOTEM ] Delivering 6 to 7 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 7 to pending delivery queue Nov 03 16:57:01 corosync [TOTEM ] > releasing messages up to and including > 6 > Nov 03 16:57:01 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:01 corosync [TOTEM ] releasing > messages up to and including > 7 > Nov 03 16:57:01 corosync [TOTEM ] Delivering 7 to 8 Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > 8 to pending delivery queue Nov 03 16:57:01 corosync [SYNC ] > confchg entries 1 Nov 03 16:57:01 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:01 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Committing > synchronization for (dummy EVT service) Nov 03 16:57:01 > corosync [SYNC ] Synchronization actions starting for > (corosync cluster closed process group service v1.01) Nov 03 > 16:57:01 corosync [TOTEM ] mcasted message added to pending > queue Nov 03 16:57:01 corosync [TOTEM ] mcasted message added > to pending queue Nov 03 16:57:01 corosync [TOTEM ] Delivering > 8 to a Nov 03 16:57:01 corosync [TOTEM ] Delivering MCAST > message with seq 9 to pending delivery queue Nov 03 16:57:01 > corosync [TOTEM ] Delivering MCAST message with seq a to > pending delivery queue > Nov 03 16:57:01 corosync [CPG ] downlist received left_list: 0 > Nov 03 16:57:01 corosync [CPG ] chosen downlist from node r(0) > ip(192.168.10.55) r(1) ip(198.51.100.55) Nov 03 16:57:01 > corosync [TOTEM ] mcasted message added to pending queue Nov > 03 16:57:01 corosync [TOTEM ] releasing messages up to and including > 8 > Nov 03 16:57:01 corosync [TOTEM ] Delivering a to b Nov 03 > 16:57:01 corosync [TOTEM ] Delivering MCAST message with seq > b to pending delivery queue Nov 03 16:57:01 corosync [SYNC ] > confchg entries 1 Nov 03 16:57:01 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:01 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:01 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:01 corosync [SYNC ] Committing > synchronization for (corosync cluster closed process group > service v1.01) Nov 03 16:57:01 corosync [TOTEM ] mcasted > message added to pending queue Nov 03 16:57:01 corosync > [TOTEM ] releasing messages up to and including a Nov 03 > 16:57:01 corosync [TOTEM ] Delivering b to c Nov 03 16:57:01 > corosync [TOTEM ] Delivering MCAST message with seq c to > pending delivery queue Nov 03 16:57:01 corosync [MAIN ] > Completed service synchronization, ready to provide service. > Nov 03 16:57:01 corosync [TOTEM ] releasing messages up to > and including b Nov 03 16:57:01 corosync [TOTEM ] releasing > messages up to and including c Nov 03 16:57:02 corosync > [TOTEM ] entering GATHER state from 11. > Nov 03 16:57:03 corosync [TOTEM ] Creating commit token > because I am the rep. > Nov 03 16:57:03 corosync [TOTEM ] Saving state aru c high seq > received c Nov 03 16:57:03 corosync [TOTEM ] Storing new > sequence id for ring 5c Nov 03 16:57:03 corosync [TOTEM ] > entering COMMIT state. > Nov 03 16:57:03 corosync [TOTEM ] got commit token Nov 03 > 16:57:03 corosync [TOTEM ] entering RECOVERY state. > Nov 03 16:57:03 corosync [TOTEM ] TRANS [0] member 192.168.10.55: > Nov 03 16:57:03 corosync [TOTEM ] position [0] member 192.168.10.55: > Nov 03 16:57:03 corosync [TOTEM ] previous ring seq 88 rep > 192.168.10.55 Nov 03 16:57:03 corosync [TOTEM ] aru c high > delivered c received flag 1 Nov 03 16:57:03 corosync [TOTEM ] > position [1] member 192.168.10.56: > Nov 03 16:57:03 corosync [TOTEM ] previous ring seq 88 rep > 192.168.10.56 Nov 03 16:57:03 corosync [TOTEM ] aru c high > delivered c received flag 1 Nov 03 16:57:03 corosync [TOTEM ] > Did not need to originate any messages in recovery. > Nov 03 16:57:03 corosync [TOTEM ] got commit token Nov 03 > 16:57:03 corosync [TOTEM ] Sending initial ORF token Nov 03 > 16:57:03 corosync [TOTEM ] got commit token Nov 03 16:57:03 > corosync [TOTEM ] Sending initial ORF token Nov 03 16:57:03 > corosync [TOTEM ] token retrans flag is 0 my set retrans > flag0 retrans queue empty 1 count 0, aru 0 Nov 03 16:57:03 > corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Nov > 03 16:57:03 corosync [TOTEM ] token retrans flag is 0 my set > retrans flag0 retrans queue empty 1 count 1, aru 0 Nov 03 > 16:57:03 corosync [TOTEM ] install seq 0 aru 0 high seq > received 0 Nov 03 16:57:03 corosync [TOTEM ] token retrans > flag is 0 my set retrans flag0 retrans queue empty 1 count 2, > aru 0 Nov 03 16:57:03 corosync [TOTEM ] install seq 0 aru 0 > high seq received 0 Nov 03 16:57:03 corosync [TOTEM ] token > retrans flag is 0 my set retrans flag0 retrans queue empty 1 > count 3, aru 0 Nov 03 16:57:03 corosync [TOTEM ] install seq > 0 aru 0 high seq received 0 Nov 03 16:57:03 corosync [TOTEM ] > retrans flag count 4 token aru 0 install seq 0 aru 0 0 Nov 03 > 16:57:03 corosync [TOTEM ] Resetting old ring state Nov 03 > 16:57:03 corosync [TOTEM ] recovery to regular 1-0 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering to app d to c Nov 03 > 16:57:03 corosync [pcmk ] notice: pcmk_peer_update: > Transitional membership event on ring 92: memb=1, new=0, > lost=0 Nov 03 16:57:03 corosync [pcmk ] info: pcmk_peer_update: memb: > ha08a.mycharts.md 923445440 > Nov 03 16:57:03 corosync [pcmk ] notice: pcmk_peer_update: > Stable membership event on ring 92: memb=2, new=1, lost=0 Nov > 03 16:57:03 corosync [pcmk ] info: update_member: Creating > entry for node 940222656 born on 92 Nov 03 16:57:03 corosync > [pcmk ] info: update_member: Node 940222656/unknown is now: > member Nov 03 16:57:03 corosync [pcmk ] info: pcmk_peer_update: NEW: > pending. 940222656 > Nov 03 16:57:03 corosync [pcmk ] debug: pcmk_peer_update: Node > 940222656 has address r(0) ip(192.168.10.56) r(1) > ip(198.51.100.56) Nov 03 16:57:03 corosync [pcmk ] info: > pcmk_peer_update: MEMB: > ha08a.mycharts.md 923445440 > Nov 03 16:57:03 corosync [pcmk ] info: pcmk_peer_update: MEMB: > pending. 940222656 > Nov 03 16:57:03 corosync [pcmk ] debug: pcmk_peer_update: 1 > nodes changed Nov 03 16:57:03 corosync [pcmk ] info: > send_member_notification: > Sending membership update 92 to 0 children Nov 03 16:57:03 > corosync [pcmk ] debug: send_cluster_id: Born-on set > to: 92 (peer) > Nov 03 16:57:03 corosync [pcmk ] debug: send_cluster_id: > Local update: > id=923445440, born=92, seq=92 > Nov 03 16:57:03 corosync [pcmk ] info: update_member: > 0x1b89020 Node 923445440 ((null)) born on: 92 Nov 03 16:57:03 > corosync [SYNC ] This node is within the primary component > and will provide service. > Nov 03 16:57:03 corosync [TOTEM ] entering OPERATIONAL state. > Nov 03 16:57:03 corosync [TOTEM ] A processor joined or left > the membership and a new membership was formed. > Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 1 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 0 to 1 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 1 to pending delivery queue Nov 03 16:57:03 corosync [SYNC ] > confchg entries 2 Nov 03 16:57:03 corosync [SYNC ] Barrier > Start Received From 940222656 Nov 03 16:57:03 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 0. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:03 corosync [TOTEM ] Delivering 1 > to 2 Nov 03 16:57:03 corosync [TOTEM ] Delivering MCAST > message with seq 2 to pending delivery queue Nov 03 16:57:03 > corosync [pcmk ] debug: pcmk_cluster_id_callback: Node > update: ha08a.mycharts.md (1.1.2) > Nov 03 16:57:03 corosync [SYNC ] confchg entries 2 Nov 03 > 16:57:03 corosync [SYNC ] Barrier Start Received From > 940222656 Nov 03 16:57:03 corosync [SYNC ] Barrier > completion status for nodeid 923445440 = 0. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:03 corosync [TOTEM ] Delivering 1 > to 2 Nov 03 16:57:03 corosync [TOTEM ] Delivering MCAST > message with seq 2 to pending delivery queue Nov 03 16:57:03 > corosync [pcmk ] debug: pcmk_cluster_id_callback: Node > update: ha08a.mycharts.md (1.1.2) > Nov 03 16:57:03 corosync [SYNC ] confchg entries 2 Nov 03 > 16:57:03 corosync [SYNC ] Barrier Start Received From > 923445440 Nov 03 16:57:03 corosync [SYNC ] Barrier > completion status for nodeid 923445440 = 1. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:03 corosync [SYNC ] Synchronization > actions starting for (dummy CLM service) Nov 03 16:57:03 > corosync [TOTEM ] Received ringid(192.168.10.55:92) seq > 2 > Nov 03 16:57:03 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:03 corosync [TOTEM ] releasing > messages up to and including > 1 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 2 to 3 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 3 to pending delivery queue Nov 03 16:57:03 corosync [TOTEM ] > Received ringid(192.168.10.55:92) seq > 3 > Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 4 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 3 to 4 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 4 to pending delivery queue Nov 03 16:57:03 corosync [TOTEM ] > mcasted message added to pending queue Nov 03 16:57:03 > corosync [TOTEM ] releasing messages up to and including > 2 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 4 to 5 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 5 to pending delivery queue Nov 03 16:57:03 corosync [SYNC ] > confchg entries 2 Nov 03 16:57:03 corosync [SYNC ] Barrier > Start Received From 923445440 Nov 03 16:57:03 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 0. > Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 5 > Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 6 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 5 to 6 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 6 to pending delivery queue Nov 03 16:57:03 corosync [SYNC ] > confchg entries 2 Nov 03 16:57:03 corosync [SYNC ] Barrier > Start Received From 940222656 Nov 03 16:57:03 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 1. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:03 corosync [SYNC ] Committing > synchronization for (dummy CLM service) Nov 03 16:57:03 > corosync [SYNC ] Synchronization actions starting for (dummy > AMF service) Nov 03 16:57:03 corosync [TOTEM ] releasing > messages up to and including > 4 > Nov 03 16:57:03 corosync [TOTEM ] releasing messages up to > and including > 6 > Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 7 > Nov 03 16:57:03 corosync [TOTEM ] Delivering 6 to 7 Nov 03 > 16:57:03 corosync [TOTEM ] Delivering MCAST message with seq > 7 to pending delivery queue Nov 03 16:57:03 corosync [SYNC ] > confchg entries 2 Nov 03 16:57:03 corosync [SYNC ] Barrier > Start Received From 940222656 Nov 03 16:57:03 corosync [SYNC > ] Barrier completion status for nodeid 923445440 = 0. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [TOTEM ] mcasted message added to > pending queue Nov 03 16:57:03 corosync [TOTEM ] Delivering 7 > to 8 Nov 03 16:57:03 corosync [TOTEM ] Delivering MCAST > message with seq 8 to pending delivery queue Nov 03 16:57:03 > corosync [SYNC ] confchg entries 2 Nov 03 16:57:03 corosync > [SYNC ] Barrier Start Received From 923445440 Nov 03 > 16:57:03 corosync [SYNC ] Barrier completion status for > nodeid 923445440 = 1. > Nov 03 16:57:03 corosync [SYNC ] Barrier completion status for nodeid > 940222656 = 1. > Nov 03 16:57:03 corosync [SYNC ] Synchronization barrier > completed Nov 03 16:57:03 corosync [SYNC ] Committing > synchronization for (dummy AMF service) Nov 03 16:57:03 > corosync [SYNC ] Synchronization actions starting for (dummy > CKPT service) Nov 03 16:57:03 corosync [TOTEM ] Received > ringid(192.168.10.55:92) seq > 8 > Nov 03 16:57:03 corosync [TOTEM ] releasing messages up to > and including > 7 > Nov 03 16:57:03 corosync [TOTEM ] Marking seqid 21 ringid 1 interface > 198.51.100.55 FAULTY - adminisrtative intervention required. > > > > > > > > -- > Eric Robinson > > > Disclaimer - November 3, 2011 > This email and any files transmitted with it are confidential > and intended solely for General Linux-HA mailing list. If you > are not the named addressee you should not disseminate, > distribute, copy or alter this email. Any views or opinions > presented in this email are solely those of the author and > might not represent those of Physicians' Managed Care or > Physician Select Management. Warning: Although Physicians' > Managed Care or Physician Select Management has taken > reasonable precautions to ensure no viruses are present in > this email, the company cannot accept responsibility for any > loss or damage arising from the use of this email or attachments. > This disclaimer was added by Policy Patrol: > http://www.policypatrol.com/ > _______________________________________________ > Linux-HA mailing list > [email protected] > http://lists.linux-ha.org/mailman/listinfo/linux-ha > See also: http://linux-ha.org/ReportingProblems > _______________________________________________ Linux-HA mailing list [email protected] http://lists.linux-ha.org/mailman/listinfo/linux-ha See also: http://linux-ha.org/ReportingProblems
