Check for a corefile in /var/lib/openais. If there is one, install the openais-debuginfo package and use gdb's bt command on the core file
gdb /usr/sbin/aisexec /var/lib/openais/core.XXXXX bt thanks -steve On Thu, 2010-01-07 at 12:55 -0700, hj lee wrote: > Hi, > > The openais is died suddenly and never recovered from it. Did anyone > have the same problem? > > --------------logs---------------------- > 2010-01-06 17:26:21.214953 vsstB-openais[3864]: [totemsrp.c:1842] aru > 2 high delivered 2 received flag 1 > 2010-01-06 17:26:21.214960 vsstB-openais[3864]: [totemsrp.c:1832] > position [1] member 192.168.10.22: > 2010-01-06 17:26:21.214971 vsstB-openais[3864]: [totemsrp.c:1836] > previous ring seq 1312632 rep 192.168.10.21 > 2010-01-06 17:26:21.214978 vsstB-openais[3864]: [totemsrp.c:1842] aru > 96 high delivered 96 received flag 1 > 2010-01-06 17:26:21.214986 vsstB-openais[3864]: [totemsrp.c:1950] Did > not need to originate any messages in recovery. > 2010-01-06 17:26:21.215304 vsstB-openais[3864]: [clm.c:0519] CLM > CONFIGURATION CHANGE > 2010-01-06 17:26:21.215313 vsstB-openais[3864]: [clm.c:0520] New > Configuration: > 2010-01-06 17:26:21.215320 vsstB-openais[3864]: [clm.c:0522] #011r(0) > ip(192.168.10.21) r(1) ip(192.168.60.21) > 2010-01-06 17:26:21.215327 vsstB-openais[3864]: [clm.c:0522] #011r(0) > ip(192.168.10.22) r(1) ip(192.168.60.22) > 2010-01-06 17:26:21.215339 vsstB-openais[3864]: [clm.c:0524] Members > Left: > 2010-01-06 17:26:21.215346 vsstB-openais[3864]: [clm.c:0529] Members > Joined: > 2010-01-06 17:26:21.215354 vsstB-openais[3864]: [plugin.c:0633] > notice: pcmk_peer_update: Transitional membership event on ring > 1312644: memb=2, new=0, lost=0 > 2010-01-06 17:26:21.215361 vsstB-openais[3864]: [plugin.c:0644] info: > pcmk_peer_update: memb: vsstA 353020096 > 2010-01-06 17:26:21.215368 vsstB-openais[3864]: [plugin.c:0644] info: > pcmk_peer_update: memb: vsstB 369797312 > 2010-01-06 17:26:21.215376 vsstB-openais[3864]: [clm.c:0519] CLM > CONFIGURATION CHANGE > 2010-01-06 17:26:21.215382 vsstB-openais[3864]: [clm.c:0520] New > Configuration: > 2010-01-06 17:26:21.215406 vsstB-openais[3864]: [clm.c:0522] #011r(0) > ip(192.168.10.21) r(1) ip(192.168.60.21) > 2010-01-06 17:26:21.216832 vsstB-openais[3864]: [clm.c:0522] #011r(0) > ip(192.168.10.22) r(1) ip(192.168.60.22) > 2010-01-06 17:26:21.216840 vsstB-openais[3864]: [clm.c:0524] Members > Left: > 2010-01-06 17:26:21.216847 vsstB-openais[3864]: [clm.c:0529] Members > Joined: > 2010-01-06 17:26:21.216854 vsstB-openais[3864]: [plugin.c:0633] > notice: pcmk_peer_update: Stable membership event on ring 1312644: > memb=2, new=0, lost=0 > 2010-01-06 17:26:21.216862 vsstB-openais[3864]: [plugin.c:0679] info: > pcmk_peer_update: MEMB: vsstA 353020096 > 2010-01-06 17:26:21.216869 vsstB-openais[3864]: [plugin.c:0679] info: > pcmk_peer_update: MEMB: vsstB 369797312 > 2010-01-06 17:26:21.216876 vsstB-openais[3864]: [sync.c:0321] This > node is within the primary component and will provide service. > 2010-01-06 17:26:21.216883 vsstB-openais[3864]: [totemsrp.c:1678] > entering OPERATIONAL state. > 2010-01-06 17:26:21.217156 vsstB-openais[3864]: [totemsrp.c:2365] > Retransmit List: 1 > 2010-01-06 17:26:21.217762 vsstB-openais[3864]: [clm.c:0601] got > nodejoin message 192.168.10.22 > 2010-01-06 17:26:21.220017 vsstB-openais[3864]: [evt.c:3930] Evt > config msg from nodeid r(0) ip(192.168.10.21) r(1) ip(192.168.60.21) , > but not in membership change > 2010-01-06 17:26:21.481592 vsstB-crmd: [3875]: ERROR: ais_dispatch: > Receiving message body failed: (-1) unknown: Resource temporarily > unavailable (11) > 2010-01-06 17:26:21.481628 vsstB-crmd: [3875]: ERROR: ais_dispatch: > AIS connection failed > 2010-01-06 17:26:21.481641 vsstB-attrd: [3873]: ERROR: ais_dispatch: > Receiving message body failed: (-1) unknown: Resource temporarily > unavailable (11) > 2010-01-06 17:26:21.481649 vsstB-attrd: [3873]: ERROR: ais_dispatch: > AIS connection failed > 2010-01-06 17:26:21.481656 vsstB-cib: [3871]: ERROR: ais_dispatch: > Receiving message body failed: (-1) unknown: Resource temporarily > unavailable (11) > 2010-01-06 17:26:21.481664 vsstB-cib: [3871]: ERROR: ais_dispatch: AIS > connection failed > 2010-01-06 17:26:21.481672 vsstB-crmd: [3875]: ERROR: crm_ais_destroy: > AIS connection terminated > 2010-01-06 17:26:21.481679 vsstB-attrd: [3873]: CRIT: > attrd_ais_destroy: Lost connection to OpenAIS service! > 2010-01-06 17:26:21.481685 vsstB-attrd: [3873]: info: main: Exiting... > 2010-01-06 17:26:21.481693 vsstB-attrd: [3873]: ERROR: > attrd_cib_connection_destroy: Connection to the CIB terminated... > 2010-01-06 17:26:21.481700 vsstB-cib: [3871]: ERROR: cib_ais_destroy: > AIS connection terminated > 2010-01-06 17:26:21.481709 vsstB-stonithd: [3870]: ERROR: > ais_dispatch: Receiving message body failed: (-1) unknown: Resource > temporarily unavailable (11) > 2010-01-06 17:26:21.481717 vsstB-stonithd: [3870]: ERROR: > ais_dispatch: AIS connection failed > 2010-01-06 17:26:21.482307 vsstB-stonithd: [3870]: ERROR: AIS > connection terminated > _______________________________________________ > Openais mailing list > [email protected] > https://lists.linux-foundation.org/mailman/listinfo/openais _______________________________________________ Openais mailing list [email protected] https://lists.linux-foundation.org/mailman/listinfo/openais
