- **Type**: defect --> enhancement


---

** [tickets:#407] amf : Recovery got escalated to nodeFailover but payload 
didnot go for reboot**

**Status:** unassigned
**Milestone:** future
**Created:** Fri May 31, 2013 05:42 AM UTC by Praveen
**Last Updated:** Fri May 31, 2013 05:43 AM UTC
**Owner:** nobody

Migrated from http://devel.opensaf.org/ticket/2929.

changeset : 3855
 Model : 2n
 configuration : 1App,1SG,5SU with 3comps each, 5SIs with 3csi each.
 si-si deps configured as SI1<-SI2<-SI3<-SI4
 csi-csi deps configured as CSI1/SI1<-CSI2/SI1<-CSI3<SI1 and 
CSI1/SI5<-CSI2/SI5<-CSI3<SI5
 

PL-4 was 
scenario:
 1. components on payload are made to delay the response. 
2. lock/unlock the SG.
 3. in the csiSetCbk with ha state=standby, the response is delayed. 


/var/log/messages on PL-4 show:
 

Dec 10 15:00:44 linux-xc76 osafamfnd[3398]: NO 
'safComp=COMP1SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' faulted due to 
'csiSetcallbackTimeout(10)' : Recovery is 'componentRestart(2)'
 some thing is spawnd cleanup for 
safComp=COMP1SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 39 <111, 2040f> (COMP1SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 40 <112, 2040f> (@COMP1SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 39 
<111, 2040f> (COMP1SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 40 
<112, 2040f> (@COMP1SU4TWONAPP)
 


CMD is instantiate
 APPDN is SYSAPPCOMPDN
 

some thing is spawnd instantiate for 
safComp=COMP1SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
Dec 10 15:00:44 linux-xc76 sysAppComp: logtrace: trace enabled to file 
/tmp/sysAppImmTrace, mask=0xffffffff
 Dec 10 15:00:44 linux-xc76 sysAppComp: NO IMMA library TRACE initialize done 
pid:3777 svid:26 file:/tmp/sysAppImmTrace
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer connected: 405 
(COMP1SU4TWONAPP) <273, 2040f>
 


CMD is cleanup
 APPDN is 
CMD is cleanup
 APPDN is 


some thing is spawnd cleanup for 
safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
some thing is spawnd cleanup for 
safComp=COMP3SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 



CMD is instantiate
 APPDN is SYSAPPCOMPDN
 

some thing is spawnd instantiate for 
safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
Dec 10 15:00:44 linux-xc76 osafamfnd[3398]: NO 
'safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' faulted due to 
'csiSetcallbackTimeout(10)' : Recovery is 'componentRestart(2)'
 Dec 10 15:00:44 linux-xc76 osafamfnd[3398]: NO 
'safComp=COMP3SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' faulted due to 
'csiSetcallbackTimeout(10)' : Recovery is 'suFailover(11)'
 Dec 10 15:00:44 linux-xc76 osafamfnd[3398]: NO 
'safSu=SU4,safSg=SGONE,safApp=TWONAPP' Presence State INSTANTIATED => 
TERMINATING
 Dec 10 15:00:44 linux-xc76 osafamfnd[3398]: NO Removing 'all SIs' from 
'safSu=SU4,safSg=SGONE,safApp=TWONAPP'
 Dec 10 15:00:44 linux-xc76 sysAppComp: logtrace: trace enabled to file 
/tmp/sysAppImmTrace, mask=0xffffffff
 Dec 10 15:00:44 linux-xc76 sysAppComp: NO IMMA library TRACE initialize done 
pid:3806 svid:26 file:/tmp/sysAppImmTrace
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 35 <89, 2040f> (COMP3SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 36 <90, 2040f> (@COMP3SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 37 <100, 2040f> (COMP2SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 38 <101, 2040f> (@COMP2SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 35 
<89, 2040f> (COMP3SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 36 
<90, 2040f> (@COMP3SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 37 
<100, 2040f> (COMP2SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 38 
<101, 2040f> (@COMP2SU4TWONAPP)
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: NO Implementer connected: 531 
(COMP2SU4TWONAPP) <284, 2040f>
 Dec 10 15:00:44 linux-xc76 osafimmnd[3380]: WA IMMND - Client went down so no 
response
 Dec 10 15:00:46 linux-xc76 osafimmnd[3380]: NO Ccb 273 COMMITTED 
(immcfg_linux-xc76_7950)
 Dec 10 15:00:46 linux-xc76 osafimmnd[3380]: NO Implementer (applier) 
connected: 1449 (@COMP1SU4TWONAPP) <274, 2040f>
 Dec 10 15:00:46 linux-xc76 osafimmnd[3380]: NO Implementer (applier) 
connected: 1450 (@COMP2SU4TWONAPP) <285, 2040f>
 Dec 10 15:00:47 linux-xc76 osafimmnd[3380]: NO Create of PERSISTENT runtime 
object 'CSI2SI3_COMP2SU4TWONAPP' (COMP2SU4TWONAPP).
 Dec 10 15:00:47 linux-xc76 osafimmnd[3380]: WA IMMND - Client went down so no 
response
 Dec 10 15:00:48 linux-xc76 osafimmnd[3380]: NO Create of PERSISTENT runtime 
object 'CSI1SI2_COMP1SU4TWONAPP' (COMP1SU4TWONAPP).
 Dec 10 15:00:48 linux-xc76 osafimmnd[3380]: WA IMMND - Client went down so no 
response
 Dec 10 15:00:50 linux-xc76 osafimmnd[3380]: NO Ccb 275 COMMITTED 
(immcfg_linux-xc76_7957)
 Dec 10 15:00:51 linux-xc76 osafimmnd[3380]: NO Create of PERSISTENT runtime 
object 'CSI2SI1_COMP2SU4TWONAPP' (COMP2SU4TWONAPP).
 Dec 10 15:00:51 linux-xc76 osafimmnd[3380]: NO ERR_BUSY: ccb 277 is active on 
object CSI2SI1 Can not add object applier
 Dec 10 15:00:51 linux-xc76 osafimmnd[3380]: NO Ccb 277 COMMITTED 
(immcfg_linux-xc76_7960)
 Dec 10 15:00:53 linux-xc76 osafimmnd[3380]: NO Ccb 278 COMMITTED 
(immcfg_linux-xc76_7963)
 Dec 10 15:00:53 linux-xc76 osafimmnd[3380]: NO Create of PERSISTENT runtime 
object 'CSI1SI3_COMP1SU4TWONAPP' (COMP1SU4TWONAPP).
 


CMD is cleanup
 APPDN is 


Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: NO 
'safComp=COMP1SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' faulted due to 
'csiSetcallbackTimeout(10)' : Recovery is 'suFailover(11)'
 some thing is spawnd cleanup for 
safComp=COMP1SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 405 <273, 2040f> (COMP1SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 1449 <274, 2040f> (@COMP1SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 405 
<273, 2040f> (COMP1SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 1449 
<274, 2040f> (@COMP1SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: WA IMMND - Client went down so no 
response
 


CMD is cleanup
 APPDN is 
CMD is cleanup
 APPDN is 
CMD is cleanup
 APPDN is 
CMD is cleanup
 APPDN is 


some thing is spawnd cleanup for 
safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP 
some thing is spawnd cleanup for 
safComp=COMP2SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP 
some thing is spawnd cleanup for 
safComp=COMP3SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP 
some thing is spawnd cleanup for 
safComp=COMP1SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP 
Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: NO 
'safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' faulted due to 
'csiSetcallbackTimeout(10)' : Recovery is 'nodeFailover(5)'
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: NO Terminating all application 
components (abruptly & unordered)
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP1SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
INSTANTIATED => TERMINATING
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' Presence State 
INSTANTIATED => TERMINATING
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP2SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
INSTANTIATED => TERMINATING
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP3SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
INSTANTIATED => TERMINATING
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP2SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
TERMINATING => UNINSTANTIATED
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP2SU4TWONAPP,safSu=SU4,safSg=SGONE,safApp=TWONAPP' Presence State 
TERMINATING => UNINSTANTIATED
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP3SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
TERMINATING => UNINSTANTIATED
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: IN 
'safComp=COMP1SU5TWONAPP,safSu=SU5,safSg=SGONE,safApp=TWONAPP' Presence State 
TERMINATING => UNINSTANTIATED
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: NO Terminated all application 
components
 Dec 10 15:00:54 linux-xc76 osafamfnd[3398]: NO Informing director of node 
fail-over
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 45 <164, 2040f> (COMP1SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 46 <165, 2040f> (@COMP1SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 43 <153, 2040f> (COMP2SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 44 <154, 2040f> (@COMP2SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 41 <142, 2040f> (COMP3SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 42 <143, 2040f> (@COMP3SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 531 <284, 2040f> (COMP2SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer locally 
disconnected. Marking it as doomed 1450 <285, 2040f> (@COMP2SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 45 
<164, 2040f> (COMP1SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 46 
<165, 2040f> (@COMP1SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 43 
<153, 2040f> (COMP2SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 44 
<154, 2040f> (@COMP2SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 41 
<142, 2040f> (COMP3SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 42 
<143, 2040f> (@COMP3SU5TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 531 
<284, 2040f> (COMP2SU4TWONAPP)
 Dec 10 15:00:54 linux-xc76 osafimmnd[3380]: NO Implementer disconnected 1450 
<285, 2040f> (@COMP2SU4TWONAPP)
 Dec 10 15:00:55 linux-xc76 osafimmnd[3380]: WA IMMND - Client went down so no 
response




---

Sent from sourceforge.net because [email protected] is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.
------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets

Reply via email to