There were 2 ccb in sCcbVector with the same ccbId=1.
One was in IMM_CCB_COMMITTED state, and one was in IMM_CCB_EMPTYstate.

Jun 21 14:24:52.892207 osafimmnd [18906:ImmModel.cc:18532] IN Synced 67 classes
Jun 21 14:24:52.892226 osafimmnd [18906:ImmModel.cc:18563] T5 CCB 1 state 
COMMITTED
Jun 21 14:24:52.892297 osafimmnd [18906:ImmModel.cc:18640] T5 Synced 1 
CCB-outcomes
...
Jun 21 14:27:28.670671 osafimmnd [18906:immsv_evt.c:5473] T8 Received: 
IMMND_EVT_D2ND_CCBINIT (59) from 0
Jun 21 14:27:28.670678 osafimmnd [18906:ImmModel.cc:5162] >> ccbCreate 
Jun 21 14:27:28.670698 osafimmnd [18906:ImmModel.cc:5184] T5 CCB 1 created with 
admo 3
Jun 21 14:27:28.670705 osafimmnd [18906:ImmModel.cc:5186] << ccbCreate 

That's why immModel_abortNonCriticalCcbs() failed.

It seems there was something wrong with IMMD, it sent D2ND_CCBINIT with ccbId=1 
to IMMNDs.
Normally, after headless, IMMD will be updated with latestCcbId from the 
veteran IMMND (sending ND2D_INTRO message with ctrl_msg.refresh=2).

Please provide logs for other nodes (the SC ones).
SC-1.tar.bz2 doesn't have any log message on 'Jun 21'.




---

** [tickets:#1889] Immnd crashed on Payload during headless operation**

**Status:** unassigned
**Milestone:** 5.0.1
**Created:** Tue Jun 21, 2016 09:50 AM UTC by Ritu Raj
**Last Updated:** Tue Jun 21, 2016 09:50 AM UTC
**Owner:** nobody
**Attachments:**

- 
[SC-1.tar.bz2](https://sourceforge.net/p/opensaf/tickets/1889/attachment/SC-1.tar.bz2)
 (7.6 MB; application/x-bzip)
- 
[SCALE_SLOT-75.tar.bz2](https://sourceforge.net/p/opensaf/tickets/1889/attachment/SCALE_SLOT-75.tar.bz2)
 (4.8 MB; application/x-bzip)


setup:
Version - opensaf 5.0.GA
6-Node cluster(SC-1:Active, SC-2:Standby, SC-3:Spare PL:4,PL-5&PL-6: Payloads)

* Issue Observed:
Immnd crashed on Payload during headless operation

* Steps performed: 
(1). Invoke headless 
(2). Created logsv application stream after headless
(3). Closed the stream after performing write operation
(4). While reverting back to default configuration one of the CCB operation 
failed

>> SCALE_SLOT-75 osafimmnd[18906]: WA ERR_FAILED_OPERATION: ccb 1 is not in an 
>> expected state: 11 rejecting ccbObjectModify operation
>>
immcfg -a saLogStreamLogFullAction=3 
safLgStrCfg=saLogNotification,safApp=safLogService
error - saImmOmCcbObjectModify_2 FAILED: SA_AIS_ERR_FAILED_OPERATION (21)
OI reports: IMM: Resource abort: CCB is not in an expected state
error - saImmOmCcbApply FAILED: SA_AIS_ERR_FAILED_OPERATION (21)

(5). On invoking second headless immnd crashed on both the payload

>>
Jun 21 14:27:53 SCALE_SLOT-75 osafimmnd[18906]: ImmModel.cc:648: 
immModel_abortNonCriticalCcbs: **Assertion 'immModel_ccbAbort(cb, (*i3)->mId, 
&arrSize, &implConnArr, &clientArr, &clientArrSize, &nodeId, &pbeNodeId)' 
failed**.
Jun 21 14:27:53 SCALE_SLOT-75 osafamfnd[18925]: NO 
'safSu=PL-5,safSg=NoRed,safApp=OpenSAF' component restart probation timer 
started (timeout: 60000000000 ns)
Jun 21 14:27:53 SCALE_SLOT-75 osafamfnd[18925]: NO Restarting a component of 
'safSu=PL-5,safSg=NoRed,safApp=OpenSAF' (comp restart count: 1)
Jun 21 14:27:53 SCALE_SLOT-75 osafamfnd[18925]: NO 
'**safComp=IMMND,safSu=PL-5,safSg=NoRed,safApp=OpenSAF' faulted** due to 
'avaDown' : Recovery is 'componentRestart'
Jun 21 14:27:53 SCALE_SLOT-75 osafimmnd[19167]: Started


* Syslog and Immnd trace file is attached


---

Sent from sourceforge.net because [email protected] is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.
------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
Opensaf-tickets mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets

Reply via email to