Attaching the stack trace of amfd:
Attachments:
-
[amfd_crash.txt](https://sourceforge.net/p/opensaf/tickets/_discuss/thread/6e3a6dc7/04ba/attachment/amfd_crash.txt)
(2.1 kB; text/plain)
---
** [tickets:#2404] Amf : amfd crashed on active controller when executing the
campaign for application upgrade.**
**Status:** unassigned
**Milestone:** 5.2.RC2
**Created:** Thu Mar 30, 2017 09:49 AM UTC by Madhurika Koppula
**Last Updated:** Thu Mar 30, 2017 09:49 AM UTC
**Owner:** nobody
**Attachments:**
-
[amfd_crash.tgz](https://sourceforge.net/p/opensaf/tickets/2404/attachment/amfd_crash.tgz)
(739.4 kB; application/octet-stream)
**Environment Details:**
OS : Suse 64bit
GCC Version: 6.1
Setup : 4 nodes ( 2 controllers and 2 payloads with headless feature disabled &
PBE disabled ).
Changeset : 8701 ( 5.2.RC1)
**Summary**: amfd crashed on active controller when executing the campaign
modeled for testing SG upgrade of no redundancy model.
**Steps followed & Observed behaviour:**
1) Brought up the four nodes cluster successfully.
2) Brought up the No Redundancy model.
3) When executed campaign for testing SG upgrade, observed amfd crash on active
controller at the moment when SU hosted on PL-3 went to instantaiation failed
state after upgrade (as script exits with non-zero status).
4) Amfd got aborted when invoking saImmOiDispatch.
**Below is the timestamp on active controller SC-1:**
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO adminOperation:
immUtil.callAdminOperation() Fail SA_AIS_ERR_REPAIR_PENDING (29), Failed unit
is 'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp'
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: ER Failed to Restart activation
units
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: ER Step execution failed, Try
undoing the step
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO SmfStepStateUndoing::execute
start undoing step.
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO STEP: Rolling back AU restart
step
safSmfStep=0001,safSmfProc=amfClusterProc-1,safSmfCampaign=Campaign_1,safApp=safSmfService
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO STEP: Online installation of
old software
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: WA SU:
safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp failed after upgrade in
campaign
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO STEP: Create old
SaAmfNodeSwBundle objects
Apr 27 14:36:08 SLES-M-SLOT-1 osafimmnd[4115]: NO Ccb 56 COMMITTED (SMFSERVICE)
Apr 27 14:36:08 SLES-M-SLOT-1 osafsmfd[4199]: NO STEP: Reverse information
model and set maintenance status for deactivation units
Apr 27 14:36:08 SLES-M-SLOT-1 osafimmnd[4115]: NO Ccb 57 COMMITTED (SMFSERVICE)
**Apr 27 14:36:08 SLES-M-SLOT-1 osafamfnd[4181]: ER AMFD has unexpectedly
crashed. Rebooting node
Apr 27 14:36:08 SLES-M-SLOT-1 osafamfnd[4181]: Rebooting OpenSAF NodeId =
131343 EE **
Name = , Reason: AMFD has unexpectedly crashed. Rebooting node, OwnNodeId =
131343, SupervisionTime = 60
**Timestamp on PL-3:**
Apr 4 18:32:55 SLES-M-SLOT-3 osafamfnd[26567]: NO saAmfCompType changed to
'safVersion=5.0.0,safCompType=Comp_PxyApp_Proxy1_1_1' for
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp'
Apr 4 18:32:55 SLES-M-SLOT-3 osafimmnd[26556]: NO Ccb 54 COMMITTED (SMFSERVICE)
Apr 4 18:32:55 SLES-M-SLOT-3 osafamfnd[26567]: NO Admin restart requested for
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp'
Apr 4 18:32:56 SLES-M-SLOT-3 osafamfnd[26567]: NO
saAmfCtDefQuiescingCompleteTimeout for
'safVersion=5.0.0,safCompType=Comp_PxyApp_Proxy1_1_1' initialized with
saAmfCtDefCallbackTimeout
Apr 4 18:32:56 SLES-M-SLOT-3 osafamfnd[26567]: NO Instantiation of
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp' failed
Apr 4 18:32:56 SLES-M-SLOT-3 osafamfnd[26567]: NO Reason:'Exec of script
success, but script exits with non-zero status'
Apr 4 18:32:56 SLES-M-SLOT-3 osafamfnd[26567]: NO Exit code: 1
Apr 4 18:32:59 SLES-M-SLOT-3 osafamfnd[26567]: NO Instantiation of
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp' failed
Apr 4 18:32:59 SLES-M-SLOT-3 osafamfnd[26567]: NO Reason:'Exec of script
success, but script exits with non-zero status'
Apr 4 18:32:59 SLES-M-SLOT-3 osafamfnd[26567]: NO Exit code: 1
**Apr 4 18:33:02 SLES-M-SLOT-3 osafamfnd[26567]: NO Instantiation of
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp' failed
Apr 4 18:33:02 SLES-M-SLOT-3 osafamfnd[26567]: NO Reason:'Exec of script
success, but script exits with non-zero status'**
Apr 4 18:33:02 SLES-M-SLOT-3 osafamfnd[26567]: NO Exit code: 1
Apr 4 18:33:05 SLES-M-SLOT-3 osafamfnd[26567]: WA
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp'
Presence State RESTARTING => INSTANTIATION_FAILED
Apr 4 18:33:05 SLES-M-SLOT-3 osafamfnd[26567]: NO Component Failover trigerred
for 'safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp': Failed component:
'safComp=Proxy1,safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp'
Apr 4 18:33:05 SLES-M-SLOT-3 osafamfnd[26567]: NO
'safSu=dummy_Proxy_1,safSg=SG_dummy_Proxy,safApp=PxyApp' Presence State
INSTANTIATED => INSTANTIATION_FAILED.
**Attachments:**
1)Syslog, smf, amf traces of active controller and PL-3.
---
Sent from sourceforge.net because [email protected] is
subscribed to https://sourceforge.net/p/opensaf/tickets/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
