Analysis:
Problem is related to assginment counter as in the case of #307. During
shutdown operation
on quiescing callback was rejected with FAILED_OPERATION. Since recovery is
nodefailover SC-2 rebooted. But while deleting SUSIs
saAmfSINumCurrActiveAssignments was not decremented. So
saAmfSINumCurrActiveAssignments=1 even though SI is locked. When unlock
operation was performed on SI, saAmfSINumCurrActiveAssignments was incremented
to incorrect value 2. This caused assert in amfd. Existing issue of 2N model
#307 will solve this problem also.
---
** [tickets:#487] amf:amfd asserts during unlock of SI in NoRed model.**
**Status:** unassigned
**Created:** Sun Jul 07, 2013 11:08 AM UTC by Praveen
**Last Updated:** Tue Jul 16, 2013 12:19 PM UTC
**Owner:** nobody
changeset: 4334:f712a76ddda5 (opensaf-4.3.x).
configuration:
NoRed model with 1 SG, 2 SIs each with 2 csis in each, 2 SUs with 2 comps in
each.Components have nodefailover as recovery policy.
Steps to reproduce:
1) Perform shutdown operation on SI.
2) Reject the assignments.
3) Node will go for reboot and rejoin the cluster.
4) Try to unlock the SI, amfd will crash.
syslog:
Jul 7 16:21:32 CON-PC osafamfd[3122]: avd_si.c:1224: si_update_ass_state:
Assertion 'si->saAmfSINumCurrActiveAssignments == 1' failed.
Jul 7 16:21:32 CON-PC osafamfnd[3137]: ER AMF director unexpectedly crashed
Jul 7 16:21:32 CON-PC osafamfnd[3137]: Rebooting OpenSAF NodeId = 131599 EE
Name = , Reason: local AVD down(Adest) or both AVD down(Vdest) received,
OwnNodeId = 131599, SupervisionTime = 60
Jul 7 16:21:32 CON-PC opensaf_reboot: Rebooting local node; timeout=60
Jul 7 16:21:32 CON-PC osafimmnd[3049]: NO Implementer locally disconnected.
Marking it as doomed 13 <9, 2020f> (safAmfService)
Jul 7 16:21:32 CON-PC osafimmnd[3049]: NO Implementer disconnected 13 <9,
2020f> (safAmfService)
Jul 7 16:24:31 CON-PC syslogd 1.4.1: restart.
bt:
0 0x00000039ef630265 in raise () from /lib64/libc.so.6
(gdb) bt
0 0x00000039ef630265 in raise () from /lib64/libc.so.6
1 0x00000039ef631d10 in abort () from /lib64/libc.so.6
2 0x00007f4038c99ae7 in __osafassert_fail (__file=<value optimized out>,
__line=<value optimized out>, __func=<value optimized out>,
__assertion=<value optimized out>) at sysf_def.c:401
3 0x000000000045fee1 in si_update_ass_state (si=0xff1790) at avd_si.c:1224
4 0x000000000046aa48 in avd_susi_update_assignment_counters (susi=0xfd8db0,
action=AVSV_SUSI_ACT_ASGN, current_ha_state=SA_AMF_HA_ACTIVE,
new_ha_state=SA_AMF_HA_ACTIVE) at avd_siass.c:717
5 0x000000000046b82c in avd_susi_create (cb=0x697ce0, si=0xff1790,
su=0xff2cd0, state=SA_AMF_HA_ACTIVE, ckpt=false) at avd_siass.c:269
6 0x000000000045f4ce in avd_new_assgn_susi (cb=0x697ce0, su=0xff2cd0,
si=0xff1790, ha_state=SA_AMF_HA_ACTIVE, ckpt=false,
ret_ptr=0x7fff4b570100) at avd_sgproc.c:79
7 0x000000000044935b in avd_sg_nored_su_chose_asgn (cb=0x697ce0, sg=0xff0f50)
at avd_sgNoRfsm.c:95
8 0x000000000044a205 in avd_sg_nored_si_func (cb=0x697ce0, si=0xff1790) at
avd_sgNoRfsm.c:150
9 0x0000000000460f53 in si_admin_op_cb (immOiHandle=38654837263,
invocation=154618822657, objectName=<value optimized out>,
operationId=<value optimized out>, params=<value optimized out>) at
avd_si.c:812
10 0x0000000000428058 in admin_operation_cb (immoi_handle=38654837263,
invocation=154618822657, object_name=0xfd8438, op_id=1,
params=0xfa5ea0) at avd_imm.c:490
11 0x00007f403884b823 in imma_process_callback_info (cb=0x7f4038a68980,
cl_node=0xf8ed50, callback=0xfd8410, immHandle=38654837263)
at imma_proc.c:1901
12 0x00007f403884de87 in imma_hdl_callbk_dispatch_all (cb=0x7f4038a68980,
immHandle=38654837263) at imma_proc.c:1688
13 0x00007f4038845aaa in saImmOiDispatch (immOiHandle=38654837263,
dispatchFlags=SA_DISPATCH_ALL) at imma_oi_api.c:539
14 0x0000000000431cd0 in avd_main_proc () at avd_proc.c:533
15 0x0000000000408f9a in main (argc=<value optimized out>, argv=<value
optimized out>) at amfd_main.c:47
---
Sent from sourceforge.net because [email protected] is
subscribed to https://sourceforge.net/p/opensaf/tickets/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
