[tickets] [opensaf:tickets] #2955 base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN

2018-11-04 Thread Thuan via Opensaf-tickets
- **status**: assigned --> review



---

** [tickets:#2955] base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN**

**Status:** review
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 07:01 AM UTC by Thuan
**Last Updated:** Mon Nov 05, 2018 07:16 AM UTC
**Owner:** Thuan


Valgrind detect memleak in OM agent as following:
~~~
0x4C2A0F3  mallocvalgrind/valgrind-3.13.0/coregrind/m_replacemalloc   
vg_replace_malloc.c   299
0x714C7C3  ncs_os_taskopensaf/src/base   os_defs.c   231
0x7156110  ncs_task_createopensaf/src/base   sysf_tsk.c   62
0x714BDB7  sysfTmrCreateopensaf/src/base   ncssysf_tmr.cc   165
0x7152824  leap_env_initopensaf/src/base   sysf_def.c   97
0x7149363  ncs_leap_startupopensaf/src/base   ncs_main_pub.c   155
0x7149676  ncs_core_agents_startupopensaf/src/base   ncs_main_pub.c   
261
0x7149968  ncs_agents_startupopensaf/src/base   ncs_main_pub.c   107
0x7831BC4  imma_startup(ncsmds_svc_id)opensaf/src/imm/agent   
imma_init.cc   281
0x7848FDD  initialize_common(unsigned long long*, imma_client_node*, 
SaVersionT*)opensaf/src/imm/agent   imma_om_api.cc   246
0x7849CF9  saImmOmInitializeopensaf/src/imm/agent   imma_om_api.cc   228
~~~

Proposal fix:
~~~
diff --git a/src/base/os_defs.c b/src/base/os_defs.c
index fbca376..da38cd7 100644
--- a/src/base/os_defs.c
+++ b/src/base/os_defs.c
@@ -307,9 +307,11 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
 
if (pthread_join(*(pthread_t *)task->info.release.i_handle,
 ) != 0) {
+   free(task->info.release.i_handle);
return (NCSCC_RC_FAILURE);
}
 
+   free(task->info.release.i_handle);
} break;
case NCS_OS_TASK_DETACH:
if (pthread_detach(*(pthread_t *)task->info.release.i_handle) !=
~~~



---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2955 base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN

2018-11-04 Thread Thuan via Opensaf-tickets
- Description has changed:

Diff:



--- old
+++ new
@@ -16,15 +16,18 @@
 Proposal fix:
 ~~~
 diff --git a/src/base/os_defs.c b/src/base/os_defs.c
-index fbca376..91744ba 100644
+index fbca376..da38cd7 100644
 --- a/src/base/os_defs.c
 +++ b/src/base/os_defs.c
-@@ -310,6 +310,8 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
+@@ -307,9 +307,11 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
+ 
+if (pthread_join(*(pthread_t *)task->info.release.i_handle,
+ ) != 0) {
++   free(task->info.release.i_handle);
 return (NCSCC_RC_FAILURE);
 }
  
 +   free(task->info.release.i_handle);
-+
 } break;
 case NCS_OS_TASK_DETACH:
 if (pthread_detach(*(pthread_t *)task->info.release.i_handle) 
!=






---

** [tickets:#2955] base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN**

**Status:** assigned
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 07:01 AM UTC by Thuan
**Last Updated:** Mon Nov 05, 2018 07:05 AM UTC
**Owner:** Thuan


Valgrind detect memleak in OM agent as following:
~~~
0x4C2A0F3  mallocvalgrind/valgrind-3.13.0/coregrind/m_replacemalloc   
vg_replace_malloc.c   299
0x714C7C3  ncs_os_taskopensaf/src/base   os_defs.c   231
0x7156110  ncs_task_createopensaf/src/base   sysf_tsk.c   62
0x714BDB7  sysfTmrCreateopensaf/src/base   ncssysf_tmr.cc   165
0x7152824  leap_env_initopensaf/src/base   sysf_def.c   97
0x7149363  ncs_leap_startupopensaf/src/base   ncs_main_pub.c   155
0x7149676  ncs_core_agents_startupopensaf/src/base   ncs_main_pub.c   
261
0x7149968  ncs_agents_startupopensaf/src/base   ncs_main_pub.c   107
0x7831BC4  imma_startup(ncsmds_svc_id)opensaf/src/imm/agent   
imma_init.cc   281
0x7848FDD  initialize_common(unsigned long long*, imma_client_node*, 
SaVersionT*)opensaf/src/imm/agent   imma_om_api.cc   246
0x7849CF9  saImmOmInitializeopensaf/src/imm/agent   imma_om_api.cc   228
~~~

Proposal fix:
~~~
diff --git a/src/base/os_defs.c b/src/base/os_defs.c
index fbca376..da38cd7 100644
--- a/src/base/os_defs.c
+++ b/src/base/os_defs.c
@@ -307,9 +307,11 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
 
if (pthread_join(*(pthread_t *)task->info.release.i_handle,
 ) != 0) {
+   free(task->info.release.i_handle);
return (NCSCC_RC_FAILURE);
}
 
+   free(task->info.release.i_handle);
} break;
case NCS_OS_TASK_DETACH:
if (pthread_detach(*(pthread_t *)task->info.release.i_handle) !=
~~~



---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2955 base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN

2018-11-04 Thread Thuan via Opensaf-tickets
- **summary**: base: memleak in sysfTmrCreate/sysfTmrDestroy --> base: memleak 
in ncs_os_task() case NCS_OS_TASK_JOIN



---

** [tickets:#2955] base: memleak in ncs_os_task() case NCS_OS_TASK_JOIN**

**Status:** assigned
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 07:01 AM UTC by Thuan
**Last Updated:** Mon Nov 05, 2018 07:01 AM UTC
**Owner:** Thuan


Valgrind detect memleak in OM agent as following:
~~~
0x4C2A0F3  mallocvalgrind/valgrind-3.13.0/coregrind/m_replacemalloc   
vg_replace_malloc.c   299
0x714C7C3  ncs_os_taskopensaf/src/base   os_defs.c   231
0x7156110  ncs_task_createopensaf/src/base   sysf_tsk.c   62
0x714BDB7  sysfTmrCreateopensaf/src/base   ncssysf_tmr.cc   165
0x7152824  leap_env_initopensaf/src/base   sysf_def.c   97
0x7149363  ncs_leap_startupopensaf/src/base   ncs_main_pub.c   155
0x7149676  ncs_core_agents_startupopensaf/src/base   ncs_main_pub.c   
261
0x7149968  ncs_agents_startupopensaf/src/base   ncs_main_pub.c   107
0x7831BC4  imma_startup(ncsmds_svc_id)opensaf/src/imm/agent   
imma_init.cc   281
0x7848FDD  initialize_common(unsigned long long*, imma_client_node*, 
SaVersionT*)opensaf/src/imm/agent   imma_om_api.cc   246
0x7849CF9  saImmOmInitializeopensaf/src/imm/agent   imma_om_api.cc   228
~~~

Proposal fix:
~~~
diff --git a/src/base/os_defs.c b/src/base/os_defs.c
index fbca376..91744ba 100644
--- a/src/base/os_defs.c
+++ b/src/base/os_defs.c
@@ -310,6 +310,8 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
return (NCSCC_RC_FAILURE);
}
 
+   free(task->info.release.i_handle);
+
} break;
case NCS_OS_TASK_DETACH:
if (pthread_detach(*(pthread_t *)task->info.release.i_handle) !=
~~~



---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2953 Set sticky bit for socket and pipe files

2018-11-04 Thread Minh Anh Du via Opensaf-tickets
- **status**: unassigned --> assigned



---

** [tickets:#2953] Set sticky bit for socket and pipe files**

**Status:** assigned
**Milestone:** 5.18.12
**Created:** Fri Nov 02, 2018 09:41 AM UTC by Minh Anh Du
**Last Updated:** Fri Nov 02, 2018 10:35 AM UTC
**Owner:** Minh Anh Du


There are files, sockets and pipes have world writable permission, but only 
root user and owner should be able to create/delete these files. Sticky bit 
should be set for these sockets and pipes for security reason.

immnd.sock, osaf_log.sock
nodeinit.fifo, osafamfd.fifo, osafamfnd.fifo, osafamfwd.fifo, osafckptd.fifo, 
osafckptnd.fifo, osafclmd.fifo, osafclmna.fifo, osafdtd.fifo, osaffmd.fifo, 
osafimmd.fifo, osafimmnd.fifo, osaflogd.fifo, osafntfd.fifo, osafrded.fifo, 
osafsmfd.fifo, osafsmfnd.fifo, osaftransportd.fifo



---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2955 base: memleak in sysfTmrCreate/sysfTmrDestroy

2018-11-04 Thread Thuan via Opensaf-tickets



---

** [tickets:#2955] base: memleak in sysfTmrCreate/sysfTmrDestroy**

**Status:** assigned
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 07:01 AM UTC by Thuan
**Last Updated:** Mon Nov 05, 2018 07:01 AM UTC
**Owner:** Thuan


Valgrind detect memleak in OM agent as following:
~~~
0x4C2A0F3  mallocvalgrind/valgrind-3.13.0/coregrind/m_replacemalloc   
vg_replace_malloc.c   299
0x714C7C3  ncs_os_taskopensaf/src/base   os_defs.c   231
0x7156110  ncs_task_createopensaf/src/base   sysf_tsk.c   62
0x714BDB7  sysfTmrCreateopensaf/src/base   ncssysf_tmr.cc   165
0x7152824  leap_env_initopensaf/src/base   sysf_def.c   97
0x7149363  ncs_leap_startupopensaf/src/base   ncs_main_pub.c   155
0x7149676  ncs_core_agents_startupopensaf/src/base   ncs_main_pub.c   
261
0x7149968  ncs_agents_startupopensaf/src/base   ncs_main_pub.c   107
0x7831BC4  imma_startup(ncsmds_svc_id)opensaf/src/imm/agent   
imma_init.cc   281
0x7848FDD  initialize_common(unsigned long long*, imma_client_node*, 
SaVersionT*)opensaf/src/imm/agent   imma_om_api.cc   246
0x7849CF9  saImmOmInitializeopensaf/src/imm/agent   imma_om_api.cc   228
~~~

Proposal fix:
~~~
diff --git a/src/base/os_defs.c b/src/base/os_defs.c
index fbca376..91744ba 100644
--- a/src/base/os_defs.c
+++ b/src/base/os_defs.c
@@ -310,6 +310,8 @@ unsigned int ncs_os_task(NCS_OS_TASK *task, 
NCS_OS_TASK_REQUEST request)
return (NCSCC_RC_FAILURE);
}
 
+   free(task->info.release.i_handle);
+
} break;
case NCS_OS_TASK_DETACH:
if (pthread_detach(*(pthread_t *)task->info.release.i_handle) !=
~~~



---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2954 osaf: takeover request without lease

2018-11-04 Thread Gary Lee via Opensaf-tickets
- Description has changed:

Diff:



--- old
+++ new
@@ -15,3 +15,5 @@
}
  
if (rc == SA_AIS_ERR_EXIST) {
+
+Also, when it is set (eg. with the result on etcd3) the timeout no longer 
works.






---

** [tickets:#2954] osaf: takeover request without lease**

**Status:** unassigned
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 02:37 AM UTC by Gary Lee
**Last Updated:** Mon Nov 05, 2018 02:37 AM UTC
**Owner:** nobody


Sometimes a takeover request is created without a timeout (lease), if the 
initial attempt fails.

Possible fix:

diff --git a/src/osaf/consensus/consensus.cc b/src/osaf/consensus/consensus.cc
index 1136c37..1713d09 100644
--- a/src/osaf/consensus/consensus.cc
+++ b/src/osaf/consensus/consensus.cc
@@ -338,7 +338,7 @@ SaAisErrorT Consensus::CreateTakeoverRequest(const 
std::string& current_owner,
   while (rc == SA_AIS_ERR_FAILED_OPERATION && retries < kMaxRetry) {
 ++retries;
 std::this_thread::sleep_for(kSleepInterval);
-rc = KeyValue::Create(kTakeoverRequestKeyname, takeover_request);
+rc = KeyValue::Create(kTakeoverRequestKeyname, takeover_request, 
takeover_valid_time);
   }
 
   if (rc == SA_AIS_ERR_EXIST) {

Also, when it is set (eg. with the result on etcd3) the timeout no longer works.


---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2943 imm: coredump is generated during roaming test

2018-11-04 Thread Vu Minh Nguyen via Opensaf-tickets
- **status**: review --> fixed
- **Comment**:

commit f8a6848a1cdbff0b518c3db951e4689e260226c7 (HEAD -> develop, 
origin/develop, ticket-2943)
Author: Vu Minh Nguyen 
Date:   Mon Nov 5 11:29:12 2018 +0700

imm: fix coredump generated during roaming test [#2943]

The fix of ticket [#2934] was not covered the roaming SC case.
With roaming, IMMND veteran could run on system controller node type.

Instead of going to accept_node directly in previous fix, it should go to
update_node_type.




---

** [tickets:#2943] imm: coredump is generated during roaming test**

**Status:** fixed
**Milestone:** 5.18.12
**Created:** Tue Oct 23, 2018 02:49 AM UTC by Vu Minh Nguyen
**Last Updated:** Tue Oct 23, 2018 04:37 AM UTC
**Owner:** Vu Minh Nguyen
**Attachments:**

- 
[bt_core.1539905156.osafimmd.196.SC-2](https://sourceforge.net/p/opensaf/tickets/2943/attachment/bt_core.1539905156.osafimmd.196.SC-2)
 (16.5 kB; application/octet-stream)


I missed handling the roaming SC case in the ticket [#2934] . Instead of going 
to `accept_node` directly, it should go to `update_node_type`. With roaming, 
IMMND veteran could run on system controller node type.

diff --git a/src/imm/immd/immd_evt.c b/src/imm/immd/immd_evt.c
index 9cd82da64..a0f632b7e 100644
— a/src/imm/immd/immd_evt.c
+++ b/src/imm/immd/immd_evt.c
@@ -1814,7 +1814,7 @@ static uint32_t immd_evt_proc_immnd_intro(IMMD_CB *cb, 
IMMD_EVT *evt,
   cb->ccb_id_count, 
msg->ccb_id_count,
   cb->impl_count, msg->impl_count);
}
-   goto accept_node;
+   goto update_node_type;
}
if (cb->fevsSendCount < evt->info.ctrl_msg.fevs_count) 
{ @@ -1887,6 +1887,7 @@ static uint32_t immd_evt_proc_immnd_intro(IMMD_CB *cb, 
IMMD_EVT *evt, } 
}
+update_node_type:
/* Determine type of node. */
if (sinfo->dest == cb->loc_immnd_dest) {
node_info->isOnController = true;




---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2954 osaf: takeover request without lease

2018-11-04 Thread Gary Lee via Opensaf-tickets



---

** [tickets:#2954] osaf: takeover request without lease**

**Status:** unassigned
**Milestone:** 5.18.12
**Created:** Mon Nov 05, 2018 02:37 AM UTC by Gary Lee
**Last Updated:** Mon Nov 05, 2018 02:37 AM UTC
**Owner:** nobody


Sometimes a takeover request is created without a timeout (lease), if the 
initial attempt fails.

Possible fix:

diff --git a/src/osaf/consensus/consensus.cc b/src/osaf/consensus/consensus.cc
index 1136c37..1713d09 100644
--- a/src/osaf/consensus/consensus.cc
+++ b/src/osaf/consensus/consensus.cc
@@ -338,7 +338,7 @@ SaAisErrorT Consensus::CreateTakeoverRequest(const 
std::string& current_owner,
   while (rc == SA_AIS_ERR_FAILED_OPERATION && retries < kMaxRetry) {
 ++retries;
 std::this_thread::sleep_for(kSleepInterval);
-rc = KeyValue::Create(kTakeoverRequestKeyname, takeover_request);
+rc = KeyValue::Create(kTakeoverRequestKeyname, takeover_request, 
takeover_valid_time);
   }
 
   if (rc == SA_AIS_ERR_EXIST) {


---

Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is 
subscribed to https://sourceforge.net/p/opensaf/tickets/

To unsubscribe from further messages, a project admin can change settings at 
https://sourceforge.net/p/opensaf/admin/tickets/options.  Or, if this is a 
mailing list, you can unsubscribe from the mailing list.___
Opensaf-tickets mailing list
Opensaf-tickets@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/opensaf-tickets


[tickets] [opensaf:tickets] #2941 mds: Miss to send MDSDOWN after split brain detection

2018-11-04 Thread Minh Hon Chau via Opensaf-tickets
- **status**: review --> fixed
- **assigned_to**: Minh Hon Chau -->  nobody 
- **Comment**:

[develop]
commit 7194f743c08fa336e143949b39fbb19d4723457f
Author: Minh Chau 
Date:   Mon Nov 5 12:08:59 2018 +1100

mds: Send NCSMDS_DOWN with vdest if there is no any adest [#2941]




---

** [tickets:#2941] mds: Miss to send MDSDOWN after split brain detection**

**Status:** fixed
**Milestone:** 5.18.12
**Created:** Tue Oct 16, 2018 12:42 PM UTC by Minh Hon Chau
**Last Updated:** Thu Oct 25, 2018 02:41 AM UTC
**Owner:** nobody
**Attachments:**

- 
[mds.pl3.osafamfnd.log](https://sourceforge.net/p/opensaf/tickets/2941/attachment/mds.pl3.osafamfnd.log)
 (1.4 MB; text/x-log)
- 
[mds.pl5.osafamfnd.log](https://sourceforge.net/p/opensaf/tickets/2941/attachment/mds.pl5.osafamfnd.log)
 (1.5 MB; text/x-log)
- 
[pl3.syslog](https://sourceforge.net/p/opensaf/tickets/2941/attachment/pl3.syslog)
 (34.5 kB; application/octet-stream)
- 
[pl5.syslog](https://sourceforge.net/p/opensaf/tickets/2941/attachment/pl5.syslog)
 (40.3 kB; application/octet-stream)


**Configuration:**
 - Cluster with 2SCs, 6 PLs with MDS/TCP
- Split cluster to two partitions: #1 {SC1, PL3, PL4}, #2 {SC2, PL5, PL6, PL7, 
PL8)
- Network merge, both SC go reboot dueto split-brain detection

**Observation:**
PL3, PL4 did not get NCSMDS_DOWN vdest, thuse PL3, PL4 did not get headless and 
resync afterward.

**Outlined Logs:**
After network merge:

<143>1 2018-10-16T22:53:42.184459+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9668"] >> mds_mcm_svc_up
<143>1 2018-10-16T22:53:42.184463+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9669"] MCM:API: LOCAL SVC INFO  : svc_id = AVND(13) | PWE id = 1 | 
VDEST id = 65535 |
<143>1 2018-10-16T22:53:42.184467+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9670"] MCM:API: REMOTE SVC INFO : svc_id = AVD(12) | PWE id = 1 | 
VDEST id = 1 | POLICY = 2 | SCOPE = 4 | ROLE = 1 | MY_PCON = 0 |
<143>1 2018-10-16T22:53:42.184471+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9671"] >> mds_svc_tbl_query
<143>1 2018-10-16T22:53:42.184475+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9672"] << mds_svc_tbl_query
<143>1 2018-10-16T22:53:42.184478+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9673"] >> mds_subtn_tbl_get_details
<143>1 2018-10-16T22:53:42.184482+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9674"] << mds_subtn_tbl_get_details
<143>1 2018-10-16T22:53:42.184485+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9675"] >> mds_mcm_validate_scope
<143>1 2018-10-16T22:53:42.184489+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9676"] << mds_mcm_validate_scope
<143>1 2018-10-16T22:53:42.184492+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9677"] >> mds_get_subtn_res_tbl_by_adest
<143>1 2018-10-16T22:53:42.184496+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9678"] MDS:DB: Subscription Result not present
<143>1 2018-10-16T22:53:42.184499+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9679"] << mds_get_subtn_res_tbl_by_adest
<143>1 2018-10-16T22:53:42.184502+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9680"] >> mds_subtn_res_tbl_get
<143>1 2018-10-16T22:53:42.184506+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9681"] << mds_subtn_res_tbl_get
<143>1 2018-10-16T22:53:42.184509+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9682"] >> mds_subtn_res_tbl_add
<143>1 2018-10-16T22:53:42.184515+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9683"] MDS:DB: adest_details:  
<143>1 2018-10-16T22:53:42.184519+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9684"] << get_subtn_adest_details
<143>1 2018-10-16T22:53:42.184524+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9685"] MDS:DB: sub_adest_details: 
<143>1 2018-10-16T22:53:42.184527+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9686"] << mds_subtn_res_tbl_add
<143>1 2018-10-16T22:53:42.184531+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9687"] << mds_mcm_svc_up
...
<143>1 2018-10-16T22:53:45.3608+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9837"] >> mds_mcm_svc_down
<143>1 2018-10-16T22:53:45.360804+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9838"] MCM:API: LOCAL SVC INFO  : svc_id = AVND(13) | PWE id = 1 | 
VDEST id = 65535 |
<143>1 2018-10-16T22:53:45.360809+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9839"] MCM:API: REMOTE SVC INFO : svc_id = AVD(12) | PWE id = 1 | 
VDEST id = 1 | POLICY = 2 | SCOPE = 4 | ROLE = 1 | MY_PCON = 0 | adest = 
565213401186557
<143>1 2018-10-16T22:53:45.360814+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9840"] >> mds_svc_tbl_query
<143>1 2018-10-16T22:53:45.360818+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9841"] << mds_svc_tbl_query
<143>1 2018-10-16T22:53:45.360822+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9842"] >> mds_subtn_tbl_get_details
<143>1 2018-10-16T22:53:45.360826+11:00 PL-3 osafamfnd 193 mds.log [meta 
sequenceId="9843"] << mds_subtn_tbl_get_details
<143>1