Further testing results of "Error Escalations":
6. Kill component on PL-3 and restart controller, Amfd is crashing. Logs
attached(For No Red model).
7. 2N Red model, configure two SUs on PL-3 and assign two SIs, unlock
them(SU Failover true/false). Now, restart controller two times, Amfd crashes
second time. Logs attached.
8. 2N Red model, configure two SUs on PL-3 and assign two SIs, unlock
them(SU Failover false). Shutdown controller, kill comp in SU1. Start
controller and SU2 is given Standby and SU1 is given Act. Restart controller
now and Amfd crashes at the same place as #6 and #7:
Feb 8 18:03:39 PM_SC-1 osafamfd[24769]: NO Received node_up from 2010f: msg_id
1
Feb 8 18:03:39 PM_SC-1 osafamfd[24769]: siass.cc:842: avd_susi_recreate:
Assertion 'su' failed.
Feb 8 18:03:39 PM_SC-1 osafamfnd[24779]: WA AMF director unexpectedly crashed
9. Test Case #8 configuration except SU1 on PL-3 and SU2 on PL-4. Stop
controller and kill demo on PL-3 so that node failover comes and then since
PL-3 will reboot and come and stuck at immnd since controller is not there,
start controller. Amd crashes at the same place:
Feb 8 19:35:43 PM_SC-1 osafamfnd[28505]: Started
Feb 8 19:35:43 PM_SC-1 osafamfnd[28505]: NO Sending node up due to NCSMDS_UP
Feb 8 19:35:43 PM_SC-1 osafamfd[28495]: NO Received node_up from 2010f: msg_id
1
Feb 8 19:35:43 PM_SC-1 osafamfd[28495]: siass.cc:842: avd_susi_recreate:
Assertion 'su' failed.
Feb 8 19:35:43 PM_SC-1 osafamfnd[28505]: WA AMF director unexpectedly crashed
Feb 8 19:35:43 PM_SC-1 osafamfnd[28505]: WA AMF director unexpectedly crashed
10. Test Case #9 configuration: Configure saAmfSGNumPrefInserviceSUs as 2.
Stop controller and kill demo on PL-3 so that node failover comes and then
since PL-3 will reboot and come and stuck at immnd since controller is not
there, start controller. Amd crashes at the same place:
Feb 8 20:07:15 PM_SC-1 osafamfd[8588]: NO Received node_up_msg from all nodes
Feb 8 20:07:15 PM_SC-1 osafamfd[8588]: NO Received node_up from 2040f: msg_id 1
Feb 8 20:07:15 PM_SC-1 osafamfnd[8598]: Started
Feb 8 20:07:15 PM_SC-1 osafamfnd[8598]: NO Sending node up due to NCSMDS_UP
Feb 8 20:07:15 PM_SC-1 osafamfd[8588]: NO Received node_up from 2010f: msg_id 1
Feb 8 20:07:15 PM_SC-1 osafamfd[8588]: siass.cc:842: avd_susi_recreate:
Assertion 'su' failed.
Feb 8 20:07:15 PM_SC-1 osafamfnd[8598]: WA AMF director unexpectedly crashed
Feb 8 20:07:15 PM_SC-1 osafamfnd[8598]: WA AMF director unexpectedly crashed
Thanks
-Nagu
> -----Original Message-----
> From: Nagendra Kumar
> Sent: 05 February 2016 17:49
> To: Minh Hon Chau; hans.nordeb...@ericsson.com;
> gary....@dektech.com.au; Praveen Malviya
> Cc: opensaf-devel@lists.sourceforge.net
> Subject: [devel] FW: [PATCH 0 of 5] Review Request for amf: Add support for
> cloud resilience [#1620] V2
>
> Hi Minh,
>
> Doing some sanity testing and I am observing below problems:
>
> 1 controller and 1 payload. SU1 is hosted on payload PL-3.
>
> 1. Issue shutdown on SU1 and stop the controller. Start controller,
> Amfd is crashing and controller is not able to come up:
> Feb 5 13:51:08 PM_SC-1 osafamfd[9750]: NO NodeSync timeout Feb 5
> 13:51:08 PM_SC-1 osafamfd[9750]: NO Received node_up from 2030f:
> msg_id 1 Feb 5 13:51:09 PM_SC-1 osafamfd[9750]: NO Received node_up
> from 2010f: msg_id 1 Feb 5 13:51:09 PM_SC-1 osafamfd[9750]:
> siass.cc:842: avd_susi_recreate: Assertion 'su' failed.
> Feb 5 13:51:09 PM_SC-1 osafamfnd[9760]: WA AMF director unexpectedly
> crashed Feb 5 13:51:09 PM_SC-1 osafamfnd[9760]: WA AMF director
> unexpectedly crashed
>
> 2. In the test case #1, if I keep sleep of 4 sec before calling
> saAmfCSIQuiescingComplete, then SU states are not in proper after
> controller starts up:
> safSISU=safSu=SU1\,safSg=AmfDemo\,safApp=AmfDemo1,safSi=AmfDemo,s
> afApp=AmfDemo1
> saAmfSISUHAState=QUIESCING(4)
> saAmfSISUHAReadinessState=READY_FOR_ASSIGNMENT(1)
>
> Admin state is still Shutting down:
> saAmfSUAdminState SA_UINT32_T 4 (0x4)
>
> 3. Protection Group callback is subscribed by Amf demo app. When
> unlocked, it gets track callback. Now restart controller and lock the SU. Amf
> demo app is not getting the pg track callback. That means loses the
> information.
> 4. When headless is down, saAmfProtectionGroupTrack should return
> TRY_AGAIN ?? During headless, saAmfProtectionGroupTrackStop returns
> SUCCESS, even if it doesn't clean all the data related to PG.
>
> 5. Have you tested for Proxy-proxied components?
>
> Thanks
> -Nagu
>
> ------------------------------------------------------------------------------
> Site24x7 APM Insight: Get Deep Visibility into Application Performance APM +
> Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor
> end-to-end web transactions and take corrective actions now Troubleshoot
> faster and improve end-user experience. Signup Now!
> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
> _______________________________________________
> Opensaf-devel mailing list
> Opensaf-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/opensaf-devel
6.:
Syslog of controller:
Feb 8 12:42:26 PM_SC-1 osafamfnd[6623]: NO Shutdown completed, exiting
Feb 8 12:42:26 PM_SC-1 osafamfd[6613]: exiting for shutdown
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663006] tipc: Disabling bearer <eth:eth0>
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663025] tipc: Lost link
<1.1.1:eth0-1.1.3 :eth0> on
network plane A
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663031] tipc: Lost contact with <1.1.3>
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663062] tipc: Left network mode
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663273] NET: Unregistered protocol
family 30
Feb 8 12:42:27 PM_SC-1 kernel: [ 5096.663281] tipc: Deactivated
Feb 8 12:42:27 PM_SC-1 opensafd: OpenSAF services successfully stopped
Feb 8 12:42:29 PM_SC-1 opensafd: Starting OpenSAF Services(5.0.M0 -
6:25a117c59 474:) (Using TIPC)
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.576358] tipc: Activated (version 2.0.0)
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.576885] NET: Registered protocol family
3 0
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.576888] tipc: Started in single node mode
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.579880] tipc: Started in network mode
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.579884] tipc: Own node address <1.1.1>,
n etwork identity 7688
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.584064] tipc: Enabled bearer <eth:eth0>,
discovery domain <1.1.0>,
priority 10
Feb 8 12:42:29 PM_SC-1 kernel: [ 5098.586718] tipc: Established link
<1.1.1:eth 0-1.1.3:eth0> on
network plane A
Feb 8 12:42:29 PM_SC-1 osafrded[7156]: Started
Feb 8 12:42:31 PM_SC-1 osafrded[7156]: NO No peer available => Setting Active
r ole for this node
Feb 8 12:42:31 PM_SC-1 osaffmd[7165]: Started
Feb 8 12:42:31 PM_SC-1 osafimmd[7175]: Started
Feb 8 12:42:31 PM_SC-1 osafimmd[7175]: NO ******* SC_ABSENCE_ALLOWED (Headless
Hydra) is configured: 900
***********
Feb 8 12:42:31 PM_SC-1 osafimmd[7175]: NO Waiting 3 seconds to allow IMMND MDS
attachments to get processed.
Feb 8 12:42:34 PM_SC-1 osafimmnd[7186]: Started
Feb 8 12:42:34 PM_SC-1 osafimmnd[7186]: NO IMMD service is UP ...
ScAbsenseAllo wed?:0 introduced?:0
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO Payload node 2030f introduced before
first SC, can not yet verify
File/Directory base matches SC.
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO Attached Nodes:2 Accepted nodes:0
Kno wnVeteran:0 doReply:1
Feb 8 12:42:34 PM_SC-1 osafimmnd[7186]: NO SERVER STATE: IMM_SERVER_ANONYMOUS
- -> IMM_SERVER_CLUSTER_WAITING
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO New IMMND process is on ACTIVE
Contro ller at 2010f
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO First SC IMMND (OpenSAF 4.4 or
later) attached 2010f
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO First IMMND at SC to attach is NOT
co nfigured for PBE
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO Attached Nodes:2 Accepted nodes:1
Kno wnVeteran:0 doReply:1
Feb 8 12:42:34 PM_SC-1 osafimmd[7175]: NO First IMMND on SC found at 2010f
this IMMD at 2010f. Cluster is
loading, *not* 2PBE => designating that IMMND as coor
dinator
Feb 8 12:42:34 PM_SC-1 osafimmnd[7186]: NO This IMMND is now the NEW Coord
Feb 8 12:42:34 PM_SC-1 osafimmnd[7186]: NO SETTING COORD TO 1 CLOUD PROTO
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO SERVER STATE:
IMM_SERVER_CLUSTER_WAI TING -->
IMM_SERVER_LOADING_PENDING
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO Successfully announced loading. New
r uling epoch:1
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO SERVER STATE:
IMM_SERVER_LOADING_PEN DING -->
IMM_SERVER_LOADING_SERVER
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO NODE STATE-> IMM_NODE_LOADING
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO Load starting
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO ***** Loading from XML file imm.xml at
/etc/opensaf *****
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO The class OpensafImm has been created
s ince it was missing from the
imm.xml load file
Feb 8 12:42:37 PM_SC-1 osafimmloadd: IN Class OsafImmPbeRt created
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO The class OsafImmPbeRt has been
created since it was missing from
the imm.xml load file
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO The
opensafImm=opensafImm,safApp=safImm
Service object of class OpensafImm has been created since it was missing from
th e imm.xml load file
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Ccb 1 COMMITTED (IMMLOADER)
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Closing admin owner IMMLOADER
id(1), loading of IMM done
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO NODE STATE->
IMM_NODE_FULLY_AVAILABL E 2712
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO RepositoryInitModeT is
SA_IMM_INIT_F ROM_FILE
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: WA IMM Access Control mode is DISABLED!
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO opensafImmNostdFlags changed to:
0xf 6
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Epoch set to 2 in ImmModel
Feb 8 12:42:37 PM_SC-1 osafimmloadd: NO Load ending normally
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO ACT: New Epoch for IMMND process at
n ode 2030f old epoch: 0 new
epoch:2
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO Ruling epoch changed to:2
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO Attached Nodes:2 Accepted nodes:2
Kno wnVeteran:0 doReply:0
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO ACT: New Epoch for IMMND process at
n ode 2010f old epoch: 1 new
epoch:2
Feb 8 12:42:37 PM_SC-1 osafimmd[7175]: NO Attached Nodes:2 Accepted nodes:2
Kno wnVeteran:0 doReply:0
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO SERVER STATE:
IMM_SERVER_LOADING_SER VER -->
IMM_SERVER_READY
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO ABT ImmModel received
scAbsenceAllow ed 900
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: Started
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO LOGSV_DATA_GROUPNAME not found
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO LOG root directory is:
"/var/log/open saf/saflog"
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO LOG data group is: ""
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO LGS_MBCSV_VERSION = 5
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Implementer connected: 1
(safLogServ ice) <2, 2010f>
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'OpenSafLogCon fig' is
safLogService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaLogStreamCo nfig' is
safLogService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO lgs_imm_init_configStreams:
log_strea m_open_file_restore Fail
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO lgs_imm_init_configStreams:
log_strea m_open_file_restore Fail
Feb 8 12:42:37 PM_SC-1 osaflogd[7199]: NO lgs_imm_init_configStreams:
log_strea m_open_file_restore Fail
Feb 8 12:42:37 PM_SC-1 osafntfd[7210]: Started
Feb 8 12:42:37 PM_SC-1 osafclmd[7220]: Started
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Implementer connected: 2
(safClmServ ice) <14, 2010f>
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaClmNode'
is safClmService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaClmCluster' is safClmService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafclmna[7230]: Started
Feb 8 12:42:37 PM_SC-1 osafclmna[7230]: NO
safNode=SC-1,safCluster=myClmCluster
Joined cluster, nodeid=2010f
Feb 8 12:42:37 PM_SC-1 osafamfd[7239]: Started
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO Implementer connected: 3
(safAmfServ ice) <19, 2010f>
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCompBase Type' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSUBaseTy pe' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSGBaseTy pe' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfAppBaseT ype' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSvcBaseT ype' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCSBaseTy pe' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCompGlob alAttributes' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCompType ' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfCSType'
is safAmfService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCtCsType ' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfHealthch eckType' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSvcType' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSvcTypeC STypes' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfSUType'
is safAmfService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSutCompT ype' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfSGType'
is safAmfService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfAppType' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCluster' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfNode'
is safAmfService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfNodeGrou p' is safAmfService
=> class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfNodeSwBu ndle' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfApplicat ion' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfSG' is
s afAmfService => class extent is
safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfSI' is
s afAmfService => class extent is
safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfCSI' is
safAmfService => class extent is
safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCSIAttri bute' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfSU' is
s afAmfService => class extent is
safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class 'SaAmfComp'
is safAmfService => class extent
is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfHealthch eck' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfCompCsTy pe' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSIDepend ency' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafimmnd[7186]: NO implementer for class
'SaAmfSIRanked SU' is
safAmfService => class extent is safe.
Feb 8 12:42:37 PM_SC-1 osafamfd[7239]: NO Receive message with event type:12,
m sg_type:31, from node:2030f,
msg_id:0
Feb 8 12:42:37 PM_SC-1 osafamfd[7239]: NO Receive message with event type:13,
m sg_type:32, from node:2030f,
msg_id:0
Feb 8 12:42:37 PM_SC-1 osafamfnd[7249]: Started
Feb 8 12:42:37 PM_SC-1 osafamfnd[7249]: NO Sending node up due to NCSMDS_UP
Feb 8 12:42:38 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:39 PM_SC-1 osafamfd[7239]: ER avd_data_update_req_evh: node 2030f,
receive msg_id(2) in invalid node
state 0
Feb 8 12:42:39 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:40 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:42 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:43 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:44 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:45 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:46 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:47 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:47 PM_SC-1 osafamfd[7239]: NO NodeSync timeout
Feb 8 12:42:48 PM_SC-1 osafamfd[7239]: NO Received node_up from 2030f: msg_id 1
Feb 8 12:42:48 PM_SC-1 osafamfd[7239]: NO Received node_up from 2010f: msg_id 1
Feb 8 12:42:48 PM_SC-1 osafamfd[7239]: siass.cc:842: avd_susi_recreate:
Asserti on 'su' failed.
Feb 8 12:42:48 PM_SC-1 osafamfnd[7249]: WA AMF director unexpectedly crashed
Feb 8 12:42:48 PM_SC-1 osafamfnd[7249]: WA AMF director unexpectedly crashed
Feb 8 12:42:48 PM_SC-1 osafimmnd[7186]: NO Implementer locally disconnected.
Ma rking it as doomed 3 <19,
2010f> (safAmfService)
Feb 8 12:42:48 PM_SC-1 osafimmnd[7186]: NO Implementer disconnected 3 <19,
2010 f> (safAmfService)
Syslog of PL-3:
Feb 8 12:41:40 PM_PL-3 osafimmnd[5216]: NO Implementer connected: 21
(safLckService) <0, 2010f>
Feb 8 12:41:40 PM_PL-3 osafimmnd[5216]: NO Implementer connected: 22
(safEvtService) <0, 2010f>
Feb 8 12:42:19 PM_PL-3 osafamfnd[5235]: NO
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' component restart probation timer
started (timeout: 20000000000 ns)
Feb 8 12:42:19 PM_PL-3 osafamfnd[5235]: NO Restarting a component of
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' (comp restart count: 1)
Feb 8 12:42:19 PM_PL-3 osafamfnd[5235]: NO
'safComp=AmfDemo,safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' faulted due to
'avaDown' : Recovery is 'componentRestart'
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]:
'safComp=AmfDemo,safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' started
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: HC started with AMF
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: Registered with AMF
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: CSI Set - add
'safCsi=AmfDemo,safSi=AmfDemo,safApp=AmfDemo1' HAState Active
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: name: abcdef, value: val1
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: name: abcdef, value: val2
Feb 8 12:42:19 PM_PL-3 amf_demo[5419]: Health check 1
Feb 8 12:42:26 PM_PL-3 osafimmnd[5216]: NO Implementer disconnected 21 <0,
2010f> (safLckService)
Feb 8 12:42:26 PM_PL-3 osafimmnd[5216]: WA SC Absence IS allowed:900 IMMD
service is DOWN
Feb 8 12:42:26 PM_PL-3 osafimmnd[5216]: WA This IMMND coord has to exit
allowing restarted IMMD to select new coord
Feb 8 12:42:26 PM_PL-3 osafamfnd[5235]: NO
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' component restart probation timer
started (timeout: 60000000000 ns)
Feb 8 12:42:26 PM_PL-3 osafamfnd[5235]: NO Restarting a component of
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' (comp restart count: 1)
Feb 8 12:42:26 PM_PL-3 osafamfnd[5235]: NO
'safComp=IMMND,safSu=PL-3,safSg=NoRed,safApp=OpenSAF' faulted due to 'avaDown'
: Recovery is 'componentRestart'
Feb 8 12:42:26 PM_PL-3 osafimmnd[5438]: Started
Feb 8 12:42:27 PM_PL-3 osafamfnd[5235]: WA AMF director unexpectedly crashed
Feb 8 12:42:27 PM_PL-3 osafamfnd[5235]: NO Checking
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' for pending messages
Feb 8 12:42:27 PM_PL-3 osafamfnd[5235]: NO Checking
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 12:42:29 PM_PL-3 kernel: [ 4930.732047] TIPC: Resetting link
<1.1.3:eth0-1.1.1:eth0>, peer not responding
Feb 8 12:42:29 PM_PL-3 kernel: [ 4930.732054] TIPC: Lost link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 12:42:29 PM_PL-3 kernel: [ 4930.732057] TIPC: Lost contact with <1.1.1>
Feb 8 12:42:30 PM_PL-3 kernel: [ 4931.039758] TIPC: Established link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 12:42:35 PM_PL-3 osafimmnd[5438]: NO IMMD service is UP ...
ScAbsenseAllowed?:0 introduced?:0
Feb 8 12:42:35 PM_PL-3 osafimmnd[5438]: NO SERVER STATE: IMM_SERVER_ANONYMOUS
--> IMM_SERVER_CLUSTER_WAITING
Feb 8 12:42:35 PM_PL-3 osafimmnd[5438]: NO SETTING COORD TO 0 CLOUD PROTO
Feb 8 12:42:35 PM_PL-3 osafimmnd[5438]: NO SERVER STATE:
IMM_SERVER_CLUSTER_WAITING --> IMM_SERVER_LOADING_PENDING
Feb 8 12:42:35 PM_PL-3 osafimmnd[5438]: NO SERVER STATE:
IMM_SERVER_LOADING_PENDING --> IMM_SERVER_LOADING_CLIENT
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO NODE STATE-> IMM_NODE_LOADING
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO Ccb 1 COMMITTED (IMMLOADER)
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO Closing admin owner IMMLOADER
id(1), loading of IMM done
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO NODE STATE->
IMM_NODE_FULLY_AVAILABLE 2712
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO RepositoryInitModeT is
SA_IMM_INIT_FROM_FILE
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: WA IMM Access Control mode is DISABLED!
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO opensafImmNostdFlags changed to:
0xf6
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO Epoch set to 2 in ImmModel
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO SERVER STATE:
IMM_SERVER_LOADING_CLIENT --> IMM_SERVER_READY
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO ABT ImmModel received
scAbsenceAllowed 900
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO Implementer connected: 1
(safLogService) <0, 2010f>
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO implementer for class
'OpenSafLogConfig' is safLogService => class extent is safe.
Feb 8 12:42:37 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaLogStreamConfig' is safLogService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafckptnd[5255]: NO Bad CLM handle. Reinitializing.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO Implementer connected: 2
(safClmService) <0, 2010f>
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaClmNode'
is safClmService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaClmCluster' is safClmService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafclmna[5226]: NO
safNode=PL-3,safCluster=myClmCluster Joined cluster, nodeid=2030f
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO AVD NEW_ACTIVE, adest:1
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO Sending node up due to
NCSMDS_NEW_ACTIVE
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO 2 SISU states sent
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO 2 SU states sent
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO 8 CSICOMP states synced
Feb 8 12:42:38 PM_PL-3 osafamfnd[5235]: NO 8 SU states sent
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO Implementer connected: 3
(safAmfService) <0, 2010f>
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCompBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSUBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSGBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfAppBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSvcBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCSBaseType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCompGlobalAttributes' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCompType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfCSType'
is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCtCsType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfHealthcheckType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSvcType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSvcTypeCSTypes' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfSUType'
is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSutCompType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfSGType'
is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfAppType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCluster' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfNode'
is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfNodeGroup' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfNodeSwBundle' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfApplication' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfSG' is
safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfSI' is
safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfCSI' is
safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCSIAttribute' is safAmfService => class extent is safe
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfSU' is
safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class 'SaAmfComp'
is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfHealthcheck' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfCompCsType' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSIDependency' is safAmfService => class extent is safe.
Feb 8 12:42:38 PM_PL-3 osafimmnd[5438]: NO implementer for class
'SaAmfSIRankedSU' is safAmfService => class extent is safe.
Feb 8 12:42:39 PM_PL-3 osafamfnd[5235]: NO
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' Component or SU restart probation
timer expired
Feb 8 12:42:49 PM_PL-3 osafamfnd[5235]: WA AMF director unexpectedly crashed
Feb 8 12:42:49 PM_PL-3 osafamfnd[5235]: ER ncsmds_api for 0 FAILED, dest=0
Feb 8 12:42:49 PM_PL-3 osafamfnd[5235]: NO Checking
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' for pending messages
Feb 8 12:42:49 PM_PL-3 osafamfnd[5235]: NO Checking
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 12:42:49 PM_PL-3 osafimmnd[5438]: NO Implementer disconnected 3 <0,
2010f> (safAmfService)
Feb 8 12:43:26 PM_PL-3 osafamfnd[5235]: NO
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' Component or SU restart probation timer
expired
Feb 8 12:43:49 PM_PL-3 amf_demo[5419]: Health check 2
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: WA SC Absence IS allowed:900 IMMD
service is DOWN
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO IMMD SERVICE IS DOWN, HYDRA IS
CONFIGURED => UNREGISTERING IMMND form MDS
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO Removing client id:330002030f
sv_id:27
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO ABT discard_connection OK
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO ABT Client node REMOVED
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO ABT DONE REMOVING CLIENTS ENTERING
immModel_isolateThisNode(cb)
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO Implementer disconnected 1 <0,
2010f(down)> (safLogService)
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO Implementer disconnected 2 <0,
2010f(down)> (safClmService)
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO Impl Discarded node 2010f
Feb 8 12:44:51 PM_PL-3 osafimmnd[5438]: NO MDS unregisterede. sleeping ...
Feb 8 12:44:51 PM_PL-3 kernel: [ 5072.476321] TIPC: Resetting link
<1.1.3:eth0-1.1.1:eth0>, peer not responding
Feb 8 12:44:51 PM_PL-3 kernel: [ 5072.476349] TIPC: Lost link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 12:44:51 PM_PL-3 kernel: [ 5072.476374] TIPC: Lost contact with <1.1.1>
Feb 8 12:44:52 PM_PL-3 osafimmnd[5438]: NO Sleep done registering IMMND with
MDS
========================================================
7.
Controller log:
1
Feb 8 17:26:21 PM_SC-1 osafamfd[20437]: NO Received node_up from 2030f: msg_id
1
Feb 8 17:26:21 PM_SC-1 osafamfd[20437]: NO NodeSync timeout
Feb 8 17:26:22 PM_SC-1 osafamfd[20437]: NO Received node_up from 2030f: msg_id
1
Feb 8 17:26:22 PM_SC-1 osafamfd[20437]: NO Received node_up from 2010f: msg_id
1
Feb 8 17:26:22 PM_SC-1 osafamfd[20437]: siass.cc:842: avd_susi_recreate:
Assert ion 'su' failed.
Feb 8 17:26:22 PM_SC-1 osafamfnd[20447]: WA AMF director unexpectedly crashed
Feb 8 17:26:22 PM_SC-1 osafamfnd[20447]: WA AMF director unexpectedly crashed
Feb 8 17:26:22 PM_SC-1 osafimmnd[20384]: NO Implementer locally disconnected.
M arking it as doomed 3 <19,
2010f> (safAmfService)
Feb 8 17:26:22 PM_SC-1 osafimmnd[20384]: NO Implementer disconnected 3 <19,
201 0f> (safAmfService)
PL-3 logs:
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigning
'safSi=AmfDemo,safApp=AmfDemo1' ACTIVE to
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigning
'safSi=AmfDemo1,safApp=AmfDemo1' ACTIVE to
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 amf_demo[11107]: CSI Set - add
'safCsi=AmfDemo,safSi=AmfDemo,safApp=AmfDemo1' HAState Active
Feb 8 17:25:16 PM_PL-3 amf_demo[11107]: name: abcdef, value: val1
Feb 8 17:25:16 PM_PL-3 amf_demo[11107]: name: abcdef, value: val2
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigned
'safSi=AmfDemo,safApp=AmfDemo1' ACTIVE to
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 amf_demo[11107]: CSI Set - add
'safCsi=AmfDemo,safSi=AmfDemo1,safApp=AmfDemo1' HAState Active
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigned
'safSi=AmfDemo1,safApp=AmfDemo1' ACTIVE to
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1' Presence State UNINSTANTIATED =>
INSTANTIATING
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]:
'safComp=AmfDemo,safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1' started
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1' Presence State INSTANTIATING =>
INSTANTIATED
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: HC started with AMF
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: Registered with AMF
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: Health check 1
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigning
'safSi=AmfDemo,safApp=AmfDemo1' STANDBY to
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigning
'safSi=AmfDemo1,safApp=AmfDemo1' STANDBY to
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: CSI Set - add
'safCsi=AmfDemo,safSi=AmfDemo,safApp=AmfDemo1' HAState Standby
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: name: abcdef, value: val1
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: name: abcdef, value: val2
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigned
'safSi=AmfDemo,safApp=AmfDemo1' STANDBY to
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:16 PM_PL-3 amf_demo[11124]: CSI Set - add
'safCsi=AmfDemo,safSi=AmfDemo1,safApp=AmfDemo1' HAState Standby
Feb 8 17:25:16 PM_PL-3 osafamfnd[10673]: NO Assigned
'safSi=AmfDemo1,safApp=AmfDemo1' STANDBY to
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1'
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 9 <0,
2010f> (safLckService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 8 <0,
2010f> (safSmfService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 6 <0,
2010f> (safMsgGrpService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 1 <0,
2010f> (safLogService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: WA SC Absence IS allowed:900 IMMD
service is DOWN
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO IMMD SERVICE IS DOWN, HYDRA IS
CONFIGURED => UNREGISTERING IMMND form MDS
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Removing client id:330002030f
sv_id:27
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 11 <51,
2030f> (MsgQueueService131855)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO ABT discard_connection OK
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO ABT Client node REMOVED
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO ABT DONE REMOVING CLIENTS ENTERING
immModel_isolateThisNode(cb)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 2 <0,
2010f(down)> (safClmService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 3 <0,
2010f(down)> (safAmfService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 4 <0,
2010f(down)> (MsgQueueService131343)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 7 <0,
2010f(down)> (safCheckPointService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 10 <0,
2010f(down)> (safEvtService)
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO Impl Discarded node 2010f
Feb 8 17:25:24 PM_PL-3 osafimmnd[10654]: NO MDS unregisterede. sleeping ...
Feb 8 17:25:24 PM_PL-3 osafamfnd[10673]: WA AMF director unexpectedly crashed
Feb 8 17:25:24 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' for pending messages
Feb 8 17:25:24 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 17:25:24 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 17:25:25 PM_PL-3 osafimmnd[10654]: NO Sleep done registering IMMND with
MDS
Feb 8 17:25:25 PM_PL-3 osafimmnd[10654]: NO MDS: mds_register_callback: dest
2030fed288010 already exist
Feb 8 17:25:25 PM_PL-3 osafimmnd[10654]: NO SUCCESS IN REGISTERING IMMND WITH
MDS
Feb 8 17:25:25 PM_PL-3 osafimmnd[10654]: NO Re-introduce-me
highestProcessed:1248 highestReceived:1248
Feb 8 17:25:27 PM_PL-3 kernel: [21908.088527] TIPC: Resetting link
<1.1.3:eth0-1.1.1:eth0>, peer not responding
Feb 8 17:25:27 PM_PL-3 kernel: [21908.088535] TIPC: Lost link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 17:25:27 PM_PL-3 kernel: [21908.088541] TIPC: Lost contact with <1.1.1>
Feb 8 17:25:28 PM_PL-3 kernel: [21909.470388] TIPC: Established link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 17:25:30 PM_PL-3 osafimmnd[10654]: WA MDS Send Failed to service:IMMD
rc:2
Feb 8 17:25:31 PM_PL-3 osafimmnd[10654]: NO Re-introduce-me
highestProcessed:1248 highestReceived:1248
Feb 8 17:25:31 PM_PL-3 osafimmnd[10654]: WA MDS Send Failed to service:IMMD
rc:2
Feb 8 17:25:32 PM_PL-3 osafimmnd[10654]: NO Re-introduce-me
highestProcessed:1248 highestReceived:1248
Feb 8 17:25:32 PM_PL-3 osafimmnd[10654]: WA MDS Send Failed to service:IMMD
rc:2
Feb 8 17:25:33 PM_PL-3 osafimmnd[10654]: NO IMMD service is UP ...
ScAbsenseAllowed?:900 introduced?:2
Feb 8 17:25:33 PM_PL-3 osafimmnd[10654]: NO Re-introduce-me
highestProcessed:1248 highestReceived:1248
Feb 8 17:25:33 PM_PL-3 osafimmnd[10654]: NO This IMMND is now the NEW Coord
Feb 8 17:25:33 PM_PL-3 osafimmnd[10654]: NO SETTING COORD TO 1 CLOUD PROTO
Feb 8 17:25:33 PM_PL-3 osafimmnd[10654]: NO This IMMND re-elected coord
redundantly, failover ?
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO Announce sync, epoch:3
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO SERVER STATE: IMM_SERVER_READY -->
IMM_SERVER_SYNC_SERVER
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO NODE STATE-> IMM_NODE_R_AVAILABLE
Feb 8 17:25:34 PM_PL-3 osafimmloadd: NO Sync starting
Feb 8 17:25:34 PM_PL-3 osafimmloadd: IN Synced 421 objects in total
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO NODE STATE->
IMM_NODE_FULLY_AVAILABLE 17320
Feb 8 17:25:34 PM_PL-3 osafimmloadd: NO Sync ending normally
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO Epoch set to 3 in ImmModel
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 12
(MsgQueueService131855) <51, 2030f>
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 13
(safLogService) <0, 2010f>
Feb 8 17:25:34 PM_PL-3 osafckptnd[10726]: NO Bad CLM handle. Reinitializing.
Feb 8 17:25:34 PM_PL-3 osafmsgnd[10693]: ER saClmDispatch Failed with error 9
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 14
(safClmService) <0, 2010f>
Feb 8 17:25:34 PM_PL-3 osafimmnd[10654]: NO SERVER STATE:
IMM_SERVER_SYNC_SERVER --> IMM_SERVER_READY
Feb 8 17:25:34 PM_PL-3 osafclmna[10664]: NO
safNode=PL-3,safCluster=myClmCluster Joined cluster, nodeid=2030f
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO AVD NEW_ACTIVE, adest:1
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO Sending node up due to
NCSMDS_NEW_ACTIVE
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO 5 SISU states sent
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO 3 SU states sent
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO 11 CSICOMP states synced
Feb 8 17:25:34 PM_PL-3 osafamfnd[10673]: NO 9 SU states sent
Feb 8 17:25:35 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 15
(safAmfService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 16
(safCheckPointService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 16 <0,
2010f> (safCheckPointService)
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 17
(MsgQueueService131343) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 18
(safMsgGrpService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 19
(safCheckPointService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 20
(safLckService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 21
(safEvtService) <0, 2010f>
Feb 8 17:25:46 PM_PL-3 osafimmnd[10654]: NO Implementer connected: 22
(safSmfService) <0, 2010f>
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 20 <0,
2010f> (safLckService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 19 <0,
2010f> (safCheckPointService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 13 <0,
2010f> (safLogService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 18 <0,
2010f> (safMsgGrpService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 21 <0,
2010f> (safEvtService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 22 <0,
2010f> (safSmfService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 14 <0,
2010f> (safClmService)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: NO Implementer disconnected 17 <0,
2010f> (MsgQueueService131343)
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: WA SC Absence IS allowed:900 IMMD
service is DOWN
Feb 8 17:25:58 PM_PL-3 osafimmnd[10654]: WA This IMMND coord has to exit
allowing restarted IMMD to select new coord
Feb 8 17:25:58 PM_PL-3 osafamfnd[10673]: NO
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' component restart probation timer
started (timeout: 60000000000 ns)
Feb 8 17:25:58 PM_PL-3 osafamfnd[10673]: NO Restarting a component of
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' (comp restart count: 1)
Feb 8 17:25:58 PM_PL-3 osafamfnd[10673]: NO
'safComp=IMMND,safSu=PL-3,safSg=NoRed,safApp=OpenSAF' faulted due to 'avaDown'
: Recovery is 'componentRestart'
Feb 8 17:25:58 PM_PL-3 osafimmnd[11162]: Started
Feb 8 17:25:59 PM_PL-3 osafamfnd[10673]: WA AMF director unexpectedly crashed
Feb 8 17:25:59 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=PL-3,safSg=NoRed,safApp=OpenSAF' for pending messages
Feb 8 17:25:59 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=SU1,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 17:25:59 PM_PL-3 osafamfnd[10673]: NO Checking
'safSu=SU2,safSg=AmfDemo,safApp=AmfDemo1' for pending messages
Feb 8 17:26:02 PM_PL-3 kernel: [21943.748816] TIPC: Resetting link
<1.1.3:eth0-1.1.1:eth0>, peer not responding
Feb 8 17:26:02 PM_PL-3 kernel: [21943.748825] TIPC: Lost link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 17:26:02 PM_PL-3 kernel: [21943.748832] TIPC: Lost contact with <1.1.1>
Feb 8 17:26:04 PM_PL-3 kernel: [21945.751569] TIPC: Established link
<1.1.3:eth0-1.1.1:eth0> on network plane A
Feb 8 17:26:09 PM_PL-3 osafimmnd[11162]: NO IMMD service is UP ...
ScAbsenseAllowed?:0 introduced?:0
Feb 8 17:26:09 PM_PL-3 osafimmnd[11162]: NO SERVER STATE: IMM_SERVER_ANONYMOUS
--> IMM_SERVER_CLUSTER_WAITING
Feb 8 17:26:09 PM_PL-3 osafimmnd[11162]: NO SETTING COORD TO 0 CLOUD PROTO
Feb 8 17:26:09 PM_PL-3 osafimmnd[11162]: NO SERVER STATE:
IMM_SERVER_CLUSTER_WAITING --> IMM_SERVER_LOADING_PENDING
Feb 8 17:26:10 PM_PL-3 osafimmnd[11162]: NO SERVER STATE:
IMM_SERVER_LOADING_PENDING --> IMM_SERVER_LOADING_CLIENT
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO NODE STATE-> IMM_NODE_LOADING
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Ccb 1 COMMITTED (IMMLOADER)
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Closing admin owner IMMLOADER
id(1), loading of IMM done
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO NODE STATE->
IMM_NODE_FULLY_AVAILABLE 2712
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO RepositoryInitModeT is
SA_IMM_INIT_FROM_FILE
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: WA IMM Access Control mode is
DISABLED!
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO opensafImmNostdFlags changed to:
0xf6
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Epoch set to 2 in ImmModel
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO SERVER STATE:
IMM_SERVER_LOADING_CLIENT --> IMM_SERVER_READY
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO ABT ImmModel received
scAbsenceAllowed 900
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Implementer connected: 1
(safLogService) <0, 2010f>
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'OpenSafLogConfig' is safLogService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaLogStreamConfig' is safLogService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafckptnd[10726]: NO Bad CLM handle. Reinitializing.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Implementer connected: 2
(safClmService) <0, 2010f>
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaClmNode'
is safClmService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaClmCluster' is safClmService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafclmna[10664]: NO
safNode=PL-3,safCluster=myClmCluster Joined cluster, nodeid=2030f
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO AVD NEW_ACTIVE, adest:1
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO Sending node up due to
NCSMDS_NEW_ACTIVE
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO 5 SISU states sent
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO 3 SU states sent
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO 11 CSICOMP states synced
Feb 8 17:26:12 PM_PL-3 osafamfnd[10673]: NO 9 SU states sent
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO Implementer connected: 3
(safAmfService) <0, 2010f>
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCompBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSUBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSGBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfAppBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSvcBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCSBaseType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCompGlobalAttributes' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCompType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCSType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCtCsType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfHealthcheckType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSvcType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSvcTypeCSTypes' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSUType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSutCompType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSGType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfAppType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCluster' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfNode'
is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfNodeGroup' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfNodeSwBundle' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfApplication' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfSG' is
safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfSI' is
safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfCSI'
is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCSIAttribute' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfSU' is
safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class 'SaAmfComp'
is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfHealthcheck' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfCompCsType' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSIDependency' is safAmfService => class extent is safe.
Feb 8 17:26:12 PM_PL-3 osafimmnd[11162]: NO implementer for class
'SaAmfSIRankedSU' is safAmfService => class extent is safe.
Feb 8 17:26:24 PM_PL-3 osafamfnd[10673]: WA AMF director unexpectedly crashed
=============================================
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
Opensaf-devel mailing list
Opensaf-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-devel
