Re: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-11-12 Thread Jonas Kellens


On 11-10-16 14:44, Joshua Colp wrote:

Jonas Kellens wrote:

Hello

I am experiencing a freeze of the Asterisk proces when issuing a 'sip
reload'.

I have this issue every time on asterisk versions : 13.11.2, 13.11.1,
13.10.0 and certified-13.8-cert3.

I do not have this on versions certified-13.8-cert2,
certified-13.8-cert1 and asterisk 1.8.32.3.

The only solution is a cold restart of Asterisk.

I can execute any command on CLI except 'sip reload'.


This doesn't ring a bell on any issues filed or any posts anywhere. 
Getting a backtrace[1] would show precisely where it is hanging 
though. Is it possible a host is having DNS issues? That can cause 
chan_sip to lock up for a period of time.


[1] 
https://wiki.asterisk.org/wiki/display/AST/Getting+a+Backtrace#GettingaBacktrace-GettingInformationForADeadlock




Hello

backtrace was generated and issue is reported : 
https://issues.asterisk.org/jira/browse/ASTERISK-26585




Kind regards.

J.


--
_
-- Bandwidth and Colocation Provided by http://www.api-digital.com --

Check out the new Asterisk community forum at: https://community.asterisk.org/

New to Asterisk? Start here:
 https://wiki.asterisk.org/wiki/display/AST/Getting+Started

asterisk-users mailing list
To UNSUBSCRIBE or update options visit:
  http://lists.digium.com/mailman/listinfo/asterisk-users


Re: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-10-12 Thread Victor Villarreal
Hi Jonas!

Do you currently use any TLS technology in your Asterisk? Like SIP-TLS o
pjSIP-TLS support ? If don't, please go to modules.conf and start disabling
some modules that you don't use.

For example, I can see some other modules related to calendars. If you
don't use this, please disable it. You gain a lower memory footprint, and
maybe fix your issue.

I hope this help you. Cheers.

2016-10-11 9:41 GMT-03:00 Jonas Kellens :

> Hello
>
> I am experiencing a freeze of the Asterisk proces when issuing a 'sip
> reload'.
>
> I have this issue every time on asterisk versions : 13.11.2, 13.11.1,
> 13.10.0 and certified-13.8-cert3.
>
> I do not have this on versions certified-13.8-cert2, certified-13.8-cert1
> and asterisk 1.8.32.3.
>
> The only solution is a cold restart of Asterisk.
>
> I can execute any command on CLI except 'sip reload'.
>
> This is what I have on CLI :
>
> sip5*CLI> sip reload
> [Oct  7 23:58:40]  Reloading SIP
> [Oct  7 23:58:40]   == Parsing '/etc/asterisk/sip.conf': Found
> [Oct  7 23:58:40]   == Parsing '/etc/asterisk/sipTemplates.conf': Found
> [Oct  7 23:58:40]   == Parsing '/etc/asterisk/users.conf': Found
> [Oct  7 23:58:40]   == Using SIP TOS bits 96
> [Oct  7 23:58:40]   == Using SIP CoS mark 3
> [Oct  7 23:58:40]   == TLS/SSL ECDH initialized (secp256r1), faster PFS
> cipher-suites enabled
> [Oct  7 23:58:40]   == TLS/SSL certificate ok
>
> --> no more output on CLI. Asterisk has gone completely !
>
> Another 'sip reload' gives :
>
> sip5*CLI> sip reload
> [Oct  8 00:01:10] Previous SIP reload not yet done
>
> sip5*CLI> sip reload
> sip5*CLI>
>
>
> Other commands are no problem on the CLI (while the freeze occurs ! ) :
>
> sip5*CLI> core show  version
> Asterisk certified/13.8-cert3 built by root @ sip5.mydomain.tld on a
> x86_64 running Linux on 2016-10-07 21:27:15 UTC
>
>
> sip5*CLI> sip show channelstats
> Peer Call ID  Duration Recv: Pack  Lost   ( %)
> Jitter Send: Pack  Lost   ( %) Jitter
> 0 active SIP channels
>
>
> sip5*CLI> core show threads
> 0x7f97ff0fb700 2849 netconsole   started at [ 1639] asterisk.c
> listener()
> 0x7f97fe843700 2760 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff367700 2759 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97fe8bf700 2758 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97fe93b700 2173 monitor_sig_flagsstarted at [ 4768] asterisk.c
> asterisk_daemon()
> 0x7f97fe9b7700 2172 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97fea33700 2171 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97feaaf700 2170 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97feb2b700 2169 scan_thread  started at [  920] pbx_spool.c
> load_module()
> 0x7f97feba7700 2167 cleanup  started at [  400] pbx_realtime.c
> load_module()
> 0x7f97fec23700 2165 lock_broker  started at [  524] func_lock.c
> load_module()
> 0x7f97fee13700 2161 cal->tech->load_calendar started at [  489]
> res_calendar.c build_calendar()
> 0x7f97fec9f700 2164 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97fed1b700 2163 cal->tech->load_calendar started at [  489]
> res_calendar.c build_calendar()
> 0x7f97fed97700 2162 cal->tech->load_calendar started at [  489]
> res_calendar.c build_calendar()
> 0x7f97fee8f700 2160 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97fef0b700 2159 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97fef87700 2158 default_tps_processing_function started at [  200]
> taskprocessor.c default_listener_start()
> 0x7f97ff003700 2157 do_monitor   started at [11645] chan_dahdi.c
> restart_monitor()
> 0x7f97ff07f700 2156 do_monitor   started at [29518] chan_sip.c
> restart_monitor()
> 0x7f97ff1f3700 2153 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff2eb700 2151 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff26f700 2152 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff3e3700 2149 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff45f700 2148 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff4db700 2147 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff5d3700 2145 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff557700 2146 worker_start started at [ 1077] threadpool.c
> worker_thread_start()
> 0x7f97ff64f700 2144 worker_start started at [ 1077] threadpool.c
> 

Re: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-10-12 Thread Jonas Kellens

Hello Edilson


I have removed all sip peer definition in sip.conf.

I only have rtcachefriends=yes for my mysql realtime sip peers (IP-phones).

But what I don't understand is why I have no issue when for example 
using asterisk 1.8.32.3 again.





Kind regards.



On 11-10-16 14:50, Edilson Amaral wrote:

Hi

This happens to me when one peer (provider) is bad !
Try to remove all peers from your sip.conf and gradually add them back!







*From:* Jonas Kellens <jonas.kell...@telenet.be>
*To:* Asterisk Users Mailing List - Non-Commercial Discussion 
<asterisk-users@lists.digium.com>

*Sent:* Tuesday, October 11, 2016 8:41 AM
*Subject:* [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and 
certified-13.8-cert3 : freeze on 'sip reload'


Hello

I am experiencing a freeze of the Asterisk proces when issuing a 'sip 
reload'.


I have this issue every time on asterisk versions : 13.11.2, 13.11.1, 
13.10.0 and certified-13.8-cert3.


I do not have this on versions certified-13.8-cert2, 
certified-13.8-cert1 and asterisk 1.8.32.3.


The only solution is a cold restart of Asterisk.

I can execute any command on CLI except 'sip reload'.

This is what I have on CLI :

sip5*CLI> sip reload
[Oct  7 23:58:40]  Reloading SIP
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/sip.conf': Found
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/sipTemplates.conf': Found
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/users.conf': Found
[Oct  7 23:58:40]   == Using SIP TOS bits 96
[Oct  7 23:58:40]   == Using SIP CoS mark 3
[Oct  7 23:58:40]   == TLS/SSL ECDH initialized (secp256r1), faster 
PFS cipher-suites enabled

[Oct  7 23:58:40]   == TLS/SSL certificate ok

--> no more output on CLI. Asterisk has gone completely !

Another 'sip reload' gives :

sip5*CLI> sip reload
[Oct  8 00:01:10] Previous SIP reload not yet done

sip5*CLI> sip reload
sip5*CLI>


Other commands are no problem on the CLI (while the freeze occurs ! ) :

sip5*CLI> core show  version
Asterisk certified/13.8-cert3 built by root @ sip5.mydomain.tld on a 
x86_64 running Linux on 2016-10-07 21:27:15 UTC



sip5*CLI> sip show channelstats
Peer Call ID  Duration Recv: Pack Lost   ( %) 
Jitter Send: Pack  Lost ( %) Jitter

0 active SIP channels


sip5*CLI> core show threads
0x7f97ff0fb700 2849 netconsole   started at [ 1639] asterisk.c 
listener()
0x7f97fe843700 2760 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff367700 2759 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97fe8bf700 2758 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97fe93b700 2173 monitor_sig_flagsstarted at [ 4768] asterisk.c 
asterisk_daemon()
0x7f97fe9b7700 2172 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97fea33700 2171 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97feaaf700 2170 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97feb2b700 2169 scan_thread  started at [  920] 
pbx_spool.c load_module()
0x7f97feba7700 2167 cleanup  started at [  400] 
pbx_realtime.c load_module()
0x7f97fec23700 2165 lock_broker  started at [  524] 
func_lock.c load_module()
0x7f97fee13700 2161 cal->tech->load_calendar started at [  489] 
res_calendar.c build_calendar()
0x7f97fec9f700 2164 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97fed1b700 2163 cal->tech->load_calendar started at [  489] 
res_calendar.c build_calendar()
0x7f97fed97700 2162 cal->tech->load_calendar started at [  489] 
res_calendar.c build_calendar()
0x7f97fee8f700 2160 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97fef0b700 2159 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97fef87700 2158 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
0x7f97ff003700 2157 do_monitor   started at [11645] 
chan_dahdi.c restart_monitor()
0x7f97ff07f700 2156 do_monitor   started at [29518] chan_sip.c 
restart_monitor()
0x7f97ff1f3700 2153 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff2eb700 2151 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff26f700 2152 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff3e3700 2149 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff45f700 2148 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff4db700 2147 worker_start started at [ 1077] 
threadpool.c worker_thread_start()
0x7f97ff5d3700 2145

Re: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-10-11 Thread Edilson Amaral
Hi 
This happens to me when one peer (provider) is bad !Try to remove all peers 
from your sip.conf and gradually add them back!





  From: Jonas Kellens <jonas.kell...@telenet.be>
 To: Asterisk Users Mailing List - Non-Commercial Discussion 
<asterisk-users@lists.digium.com> 
 Sent: Tuesday, October 11, 2016 8:41 AM
 Subject: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and 
certified-13.8-cert3 : freeze on 'sip reload'
   
  Hello
 
 I am experiencing a freeze of the Asterisk proces when issuing a 'sip reload'.
 
 I have this issue every time on asterisk versions : 13.11.2, 13.11.1, 13.10.0 
and certified-13.8-cert3.
 
 I do not have this on versions certified-13.8-cert2, certified-13.8-cert1 and 
asterisk 1.8.32.3.
 
 The only solution is a cold restart of Asterisk.
 
 I can execute any command on CLI except 'sip reload'.
 
 This is what I have on CLI :
 
 sip5*CLI> sip reload 
 [Oct  7 23:58:40]  Reloading SIP
 [Oct  7 23:58:40]   == Parsing '/etc/asterisk/sip.conf': Found
 [Oct  7 23:58:40]   == Parsing '/etc/asterisk/sipTemplates.conf': Found
 [Oct  7 23:58:40]   == Parsing '/etc/asterisk/users.conf': Found
 [Oct  7 23:58:40]   == Using SIP TOS bits 96
 [Oct  7 23:58:40]   == Using SIP CoS mark 3
 [Oct  7 23:58:40]   == TLS/SSL ECDH initialized (secp256r1), faster PFS 
cipher-suites enabled
 [Oct  7 23:58:40]   == TLS/SSL certificate ok
 
 --> no more output on CLI. Asterisk has gone completely !
 
 Another 'sip reload' gives :
 
 sip5*CLI> sip reload 
 [Oct  8 00:01:10] Previous SIP reload not yet done
 
 sip5*CLI> sip reload 
 sip5*CLI> 
 
 
 Other commands are no problem on the CLI (while the freeze occurs ! ) :
 
 sip5*CLI> core show  version
 Asterisk certified/13.8-cert3 built by root @ sip5.mydomain.tld on a x86_64 
running Linux on 2016-10-07 21:27:15 UTC
 
 
 sip5*CLI> sip show channelstats 
 Peer Call ID  Duration Recv: Pack  Lost   ( %) Jitter 
Send: Pack  Lost   ( %) Jitter
 0 active SIP channels
 
 
 sip5*CLI> core show threads 
 0x7f97ff0fb700 2849 netconsole   started at [ 1639] asterisk.c 
listener()
 0x7f97fe843700 2760 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff367700 2759 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97fe8bf700 2758 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97fe93b700 2173 monitor_sig_flags    started at [ 4768] asterisk.c 
asterisk_daemon()
 0x7f97fe9b7700 2172 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97fea33700 2171 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97feaaf700 2170 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97feb2b700 2169 scan_thread  started at [  920] pbx_spool.c 
load_module()
 0x7f97feba7700 2167 cleanup  started at [  400] pbx_realtime.c 
load_module()
 0x7f97fec23700 2165 lock_broker  started at [  524] func_lock.c 
load_module()
 0x7f97fee13700 2161 cal->tech->load_calendar started at [  489] res_calendar.c 
build_calendar()
 0x7f97fec9f700 2164 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97fed1b700 2163 cal->tech->load_calendar started at [  489] res_calendar.c 
build_calendar()
 0x7f97fed97700 2162 cal->tech->load_calendar started at [  489] res_calendar.c 
build_calendar()
 0x7f97fee8f700 2160 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97fef0b700 2159 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97fef87700 2158 default_tps_processing_function started at [  200] 
taskprocessor.c default_listener_start()
 0x7f97ff003700 2157 do_monitor   started at [11645] chan_dahdi.c 
restart_monitor()
 0x7f97ff07f700 2156 do_monitor   started at [29518] chan_sip.c 
restart_monitor()
 0x7f97ff1f3700 2153 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff2eb700 2151 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff26f700 2152 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff3e3700 2149 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff45f700 2148 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff4db700 2147 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff5d3700 2145 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff557700 2146 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff64f700 2144 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
 0x7f97ff6cb700 214

Re: [asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-10-11 Thread Joshua Colp

Jonas Kellens wrote:

Hello

I am experiencing a freeze of the Asterisk proces when issuing a 'sip
reload'.

I have this issue every time on asterisk versions : 13.11.2, 13.11.1,
13.10.0 and certified-13.8-cert3.

I do not have this on versions certified-13.8-cert2,
certified-13.8-cert1 and asterisk 1.8.32.3.

The only solution is a cold restart of Asterisk.

I can execute any command on CLI except 'sip reload'.


This doesn't ring a bell on any issues filed or any posts anywhere. 
Getting a backtrace[1] would show precisely where it is hanging though. 
Is it possible a host is having DNS issues? That can cause chan_sip to 
lock up for a period of time.


[1] 
https://wiki.asterisk.org/wiki/display/AST/Getting+a+Backtrace#GettingaBacktrace-GettingInformationForADeadlock


--
Joshua Colp
Digium, Inc. | Senior Software Developer
445 Jan Davis Drive NW - Huntsville, AL 35806 - US
Check us out at: www.digium.com & www.asterisk.org


--
_
-- Bandwidth and Colocation Provided by http://www.api-digital.com --

Join the Asterisk Community at the 13th AstriCon, September 27-29, 2016
 http://www.asterisk.org/community/astricon-user-conference

New to Asterisk? Start here:
 https://wiki.asterisk.org/wiki/display/AST/Getting+Started

asterisk-users mailing list
To UNSUBSCRIBE or update options visit:
  http://lists.digium.com/mailman/listinfo/asterisk-users


[asterisk-users] Asterisk 13.11.2, 13.11.1, 13.10.0 and certified-13.8-cert3 : freeze on 'sip reload'

2016-10-11 Thread Jonas Kellens

Hello

I am experiencing a freeze of the Asterisk proces when issuing a 'sip 
reload'.


I have this issue every time on asterisk versions : 13.11.2, 13.11.1, 
13.10.0 and certified-13.8-cert3.


I do not have this on versions certified-13.8-cert2, 
certified-13.8-cert1 and asterisk 1.8.32.3.


The only solution is a cold restart of Asterisk.

I can execute any command on CLI except 'sip reload'.

This is what I have on CLI :

sip5*CLI> sip reload
[Oct  7 23:58:40]  Reloading SIP
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/sip.conf': Found
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/sipTemplates.conf': Found
[Oct  7 23:58:40]   == Parsing '/etc/asterisk/users.conf': Found
[Oct  7 23:58:40]   == Using SIP TOS bits 96
[Oct  7 23:58:40]   == Using SIP CoS mark 3
[Oct  7 23:58:40]   == TLS/SSL ECDH initialized (secp256r1), faster PFS 
cipher-suites enabled

[Oct  7 23:58:40]   == TLS/SSL certificate ok

--> no more output on CLI. Asterisk has gone completely !

Another 'sip reload' gives :

sip5*CLI> sip reload
[Oct  8 00:01:10] Previous SIP reload not yet done

sip5*CLI> sip reload
sip5*CLI>


Other commands are no problem on the CLI (while the freeze occurs ! ) :

sip5*CLI> core show  version
Asterisk certified/13.8-cert3 built by root @ sip5.mydomain.tld on a 
x86_64 running Linux on 2016-10-07 21:27:15 UTC



sip5*CLI> sip show channelstats
Peer Call ID  Duration Recv: Pack  Lost ( %) Jitter 
Send: Pack  Lost   ( %) Jitter

0 active SIP channels


sip5*CLI> core show threads
0x7f97ff0fb700 2849 netconsole   started at [ 1639] asterisk.c 
listener()
0x7f97fe843700 2760 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff367700 2759 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97fe8bf700 2758 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97fe93b700 2173 monitor_sig_flagsstarted at [ 4768] asterisk.c 
asterisk_daemon()
0x7f97fe9b7700 2172 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97fea33700 2171 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97feaaf700 2170 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97feb2b700 2169 scan_thread  started at [  920] pbx_spool.c 
load_module()
0x7f97feba7700 2167 cleanup  started at [  400] 
pbx_realtime.c load_module()
0x7f97fec23700 2165 lock_broker  started at [  524] func_lock.c 
load_module()
0x7f97fee13700 2161 cal->tech->load_calendar started at [ 489] 
res_calendar.c build_calendar()
0x7f97fec9f700 2164 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97fed1b700 2163 cal->tech->load_calendar started at [ 489] 
res_calendar.c build_calendar()
0x7f97fed97700 2162 cal->tech->load_calendar started at [ 489] 
res_calendar.c build_calendar()
0x7f97fee8f700 2160 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97fef0b700 2159 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97fef87700 2158 default_tps_processing_function started at [ 200] 
taskprocessor.c default_listener_start()
0x7f97ff003700 2157 do_monitor   started at [11645] chan_dahdi.c 
restart_monitor()
0x7f97ff07f700 2156 do_monitor   started at [29518] chan_sip.c 
restart_monitor()
0x7f97ff1f3700 2153 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff2eb700 2151 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff26f700 2152 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff3e3700 2149 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff45f700 2148 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff4db700 2147 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff5d3700 2145 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff557700 2146 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff64f700 2144 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff6cb700 2143 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff747700 2142 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff7c3700 2141 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff83f700 2140 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff8bb700 2139 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff937700 2138 worker_start started at [ 1077] threadpool.c 
worker_thread_start()
0x7f97ff9b3700 2137 worker_start