Analysis:
Logs contains lock of SC-1 and PL-3. I have analysed both of them:
SC-1 lock case:
==================
1) SI1-SI5 were quiesced in SU1 honoring SI Depedency.
2) AMFD sent active for SI1 and SI5 to SU2.
-status of counter for SI1 and Si5
Dec 24 16:24:53.652955 osafamfd [27659:si.cc:1329] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:24:53.658889 osafamfd [27659:si.cc:1329] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
3) AMFD gets disbaled event for SU2
-Delete sent to SU1.
-SUSIs are deleted in SU2
4)AMFD received deletion response for SU1
-SUSIs are deleted in Su1
-Creation of new SUSIs in SU3
-Status of counter
Dec 24 16:24:55.801870 osafamfd [27659:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:24:55.824442 osafamfd [27659:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
5)AMFD gets disabled event for SU3
-SUSIs are deleted in Su3
-status of counters
Dec 24 16:25:00.383905 osafamfd [27659:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1.
Dec 24 16:25:00.397734 osafamfd [27659:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
-New SUSIs are created in SU4
-Status of counters:
Dec 24 16:25:00.400775 osafamfd [27659:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:25:00.421214 osafamfd [27659:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
6)AMFD gets disabled event for SU4.
-SUSIs are deleted in SU4
-status of counters
Dec 24 16:29:31.020627 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:29:31.034826 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
-New SUSIs creation in Su5
-Status of counters
Dec 24 16:29:31.037851 osafamfd [19551:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2.
Dec 24 16:29:31.060360 osafamfd [19551:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
7)AMFD gets disabled event for SU5.
-SUSIs deletion in SU5.
-Status of counters
Dec 24 16:29:34.072233 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:29:34.085607 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
-
8)Unlock of Node
-New SUSI creation in SU1
-Status of counters
Dec 24 16:29:34.910268 osafamfd [19551:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:29:34.923460 osafamfd [19551:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
9)AMFd gets disbaled event for Su1
-SUSIs are deleted in SU1
-status of counters:
Dec 24 16:29:40.052607 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:29:40.061875 osafamfd [19551:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
10)Again lock of Node
Dec 24 16:38:56.691744 osafamfd [19551:node.cc:1052] >> node_admin_op_cb:
858993459201, 'safAmfNode=SC-1,safAmfCluster=myAmfCluster', 2
Dec 24 16:38:56.691754 osafamfd [19551:imm.cc:1773] >> report_admin_op_error:
inv:858993459201, res:6, Error String: 'Node undergoing admin operation'
This problem is same as #663 and #666
PL-3 lock case:
===============
1) SI1-SI5 were quiesced in SU1 honoring SI Dependency.
2) AMFD sent active for SI1 and SI5 to SU2.
-status of counter for SI1 and SI5
Dec 24 16:59:26.158516 osafamfd [23273:si.cc:1329] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:59:26.164284 osafamfd [23273:si.cc:1329] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
3) AMFD gets disbaled event for SU2
-Delete sent to SU1.
-SUSIs are deleted in SU2.
4)AMFD received deletion response for SU1
-SUSIs are deleted in Su1
-Creation of new SUSIs in SU4
-Status of counter
Dec 24 16:59:28.019461 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2.
Dec 24 16:59:28.040208 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
5)AMFD gets disabled event for SU4.
-SUSIs are deleted in SU4
-status of counters
Dec 24 16:59:31.557500 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1.
Dec 24 16:59:31.574788 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
-Creation of new SUSIs in SU5
-status of counters
Dec 24 16:59:31.578689 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:59:31.600584 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
6)AMFD gets disabled event for SU5 with nodefailover request for PL-4.
-SUSIs deletion in SU5.
-Status of counters
Dec 24 16:59:33.958549 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:59:33.981869 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
7) PL-3 unlock
-New SUSI creation in SU1
-Status of counters
Dec 24 16:59:34.107152 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:59:34.122546 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
8)AMFD gets disabled event for SU1.
-SUSIs are deleted in SU1
-status of counters
Dec 24 16:59:36.430038 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:59:36.442683 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
-New SUSIs in SU3
-status of counters
Dec 24 16:59:36.446205 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 16:59:36.464601 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
9)MDS down event for PL-4
10)AMFD gets disabled event for SU3.
-SUSIs are deleted in SU3
-status of counters
Dec 24 16:59:41.801139 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1
Dec 24 16:59:41.809237 osafamfd [23273:si.cc:1303] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=1.
11)Node PL-4 Joined the cluster,
-New SUSIs in SU4
-status of counters
Dec 24 17:00:41.841369 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI1,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2
Dec 24 17:00:41.850371 osafamfd [23273:si.cc:1295] TR
safSi=TWONSI5,safApp=TWONAPP saAmfSINumCurrActiveAssignments=2.
12)Sucessful assignments in SU4 for only for SI1, SI4 and SI5.
Here when AMF gets assignment responses for these SIs, no further
assignment has been made because for SI4 dep_state is still
FAILOVER_UNDER_PROGRESS. This is because dep_state of SI4 was not updated.
Issue of counters is already reported.
---
** [tickets:#692] No assignments exists for InServ SUs and sis show partially
assigned**
**Status:** unassigned
**Milestone:** future
**Created:** Tue Dec 24, 2013 11:51 AM UTC by surender khetavath
**Last Updated:** Tue Dec 24, 2013 11:51 AM UTC
**Owner:** nobody
changeset : 4733
model : 2n
configuration : 1App,1SG,5SUs with 3comps each, 5SIs with 3CSIs each
si-si deps configured as SI1 sponsor for SI2,3,4 resp
SU1,SU3 mapped to PL-3.
rest of SUs mapped to pl-4
saAmfSGAutoRepair=0(False)
SuFailover=1(True)
test:
Node lock of PL-3
continuous faults in components getting active cbk
safSu=SU1,safSg=SGONE,safApp=TWONAPP
saAmfSUAdminState=UNLOCKED(1)
saAmfSUOperState=DISABLED(2)
saAmfSUPresenceState=UNINSTANTIATED(1)
saAmfSUReadinessState=OUT-OF-SERVICE(1)
safSu=SU3,safSg=SGONE,safApp=TWONAPP
saAmfSUAdminState=UNLOCKED(1)
saAmfSUOperState=DISABLED(2)
saAmfSUPresenceState=UNINSTANTIATED(1)
saAmfSUReadinessState=OUT-OF-SERVICE(1)
safSu=SU2,safSg=SGONE,safApp=TWONAPP
saAmfSUAdminState=UNLOCKED(1)
saAmfSUOperState=ENABLED(1)
saAmfSUPresenceState=INSTANTIATED(3)
saAmfSUReadinessState=IN-SERVICE(2)
safSu=SU4,safSg=SGONE,safApp=TWONAPP
saAmfSUAdminState=UNLOCKED(1)
saAmfSUOperState=ENABLED(1)
saAmfSUPresenceState=INSTANTIATED(3)
saAmfSUReadinessState=IN-SERVICE(2)
safSu=SU5,safSg=SGONE,safApp=TWONAPP
saAmfSUAdminState=UNLOCKED(1)
saAmfSUOperState=ENABLED(1)
saAmfSUPresenceState=INSTANTIATED(3)
saAmfSUReadinessState=IN-SERVICE(2)
safSi=TWONSI1,safApp=TWONAPP
saAmfSIAdminState=UNLOCKED(1)
saAmfSIAssignmentState=PARTIALLY_ASSIGNED(3)
safSi=TWONSI3,safApp=TWONAPP
saAmfSIAdminState=UNLOCKED(1)
saAmfSIAssignmentState=UNASSIGNED(1)
safSi=TWONSI2,safApp=TWONAPP
saAmfSIAdminState=UNLOCKED(1)
saAmfSIAssignmentState=UNASSIGNED(1)
safSi=TWONSI4,safApp=TWONAPP
saAmfSIAdminState=UNLOCKED(1)
saAmfSIAssignmentState=PARTIALLY_ASSIGNED(3)
safSi=TWONSI5,safApp=TWONAPP
saAmfSIAdminState=UNLOCKED(1)
saAmfSIAssignmentState=PARTIALLY_ASSIGNED(3)
/etc/init.d/opensafd status
safSISU=safSu=SC-2\,safSg=NoRed\,safApp=OpenSAF,safSi=NoRed1,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=SC-2\,safSg=2N\,safApp=OpenSAF,safSi=SC-2N,safApp=OpenSAF
saAmfSISUHAState=STANDBY(2)
safSISU=safSu=SC-1\,safSg=2N\,safApp=OpenSAF,safSi=SC-2N,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=SC-1\,safSg=NoRed\,safApp=OpenSAF,safSi=NoRed2,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=PL-3\,safSg=NoRed\,safApp=OpenSAF,safSi=NoRed4,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=PL-5\,safSg=NoRed\,safApp=OpenSAF,safSi=NoRed3,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=PL-4\,safSg=NoRed\,safApp=OpenSAF,safSi=NoRed5,safApp=OpenSAF
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=SU4\,safSg=SGONE\,safApp=TWONAPP,safSi=TWONSI5,safApp=TWONAPP
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=SU4\,safSg=SGONE\,safApp=TWONAPP,safSi=TWONSI4,safApp=TWONAPP
saAmfSISUHAState=ACTIVE(1)
safSISU=safSu=SU4\,safSg=SGONE\,safApp=TWONAPP,safSi=TWONSI1,safApp=TWONAPP
saAmfSISUHAState=ACTIVE(1)
---
Sent from sourceforge.net because [email protected] is
subscribed to https://sourceforge.net/p/opensaf/tickets/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.------------------------------------------------------------------------------
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos. Get
unparalleled scalability from the best Selenium testing platform available.
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
