Great, Thanks very much Matt, . . . The full logs for those times are gone. :-7 However just now I did chat and airport mode and got a sprout core. I have collected .pcap and logs* (see attached)* . . . however I realise now sprout debug logging is not on. Anyway I will send these to you and turn up sprout logging and do it again. I presume the full sprout debug logs would be useful.
I find Wireshark - Telephony - VoIP flow is quite useful to get an overview of what is happening. Can see that the BYE messages go a bit funny. I'm not sure why but the handset that doesn't go into airport mode initiates BYE. I'm guessing something happening on the MSRP session triggered that. I should capture debug or .pcap on the MAS to see that. BYE from that handset transitions through sprout to MAS okay BYE from MAS to other handset is retried . . . every 4 secs . . . 8 times 408 request timeout response to BYE 408 request timeout response to an OPTIONS OPTIONS 100 trying 480 temporarily unavailable response to OPTIONS **sprout core dump** answering questions inline below . . . in colour . . . Thanks for digging into this! James. On 28 May 2014 15:11, Matt Williams <[email protected]> wrote: > James, > > Thanks for raising this issue - I've been digging into it. > > I was hoping I could get a bit more detail on the SIP flow here. I've > stated what I understand (with some gaps) below - please could you correct > any errors, and provide any missing details? > - You're sending a SIP MESSAGE from one UE. > - You're trying to send the SIP MESSAGE to another UE that is registered > but uncontactable (because it's in airplane mode). > *Yes. A normal chat session happens first. * *INVITE from one handset -> bono -> sprout -> mas -> sprout -> bono -> other handset* * then 200 ok* * then ACK* * then chat messages exchange on MSRP session* *I have just one ims and one mas so anything going to mas (OPTIONS or INVITES or other messages) comes straight back out on the other leg.* > - You're going via an AS. (Is that right?) - What (if anything) does the AS do to the SIP flow? > *Yes. . . sprout -> mas -> sprout generally for SIP messages . . . * *The flow is split into 2 legs (handset1 to mas and mas to handset2).* *MSRP session for chat or file transfer or other happens on MAS.* > - Do you have I-CSCF enabled? > *I think so, in /etc/clearwater/config:* *# I-CSCF/S-CSCF configuration* *scscf=5054icscf=5052My clearwater node is an all-in-one single-node instance in Amazon.* > - Do you have Rf billing enabled? > *No, ralf is not running (or installed I think).* > > Also, is it possible to share the full logs, right from the initial > receipt of the SIP MESSAGE (maybe as an attachment rather than inline)? > *Yes, well, . . :) see attached and I'm turning up debug now to get some more . . .* > Please let me know. > > Thanks for your help, > > Matt > > -----Original Message----- > From: [email protected] [mailto: > [email protected]] On Behalf Of James Coleman > Sent: 22 May 2014 18:22 > To: Eleanor Merry > Cc: [email protected] > Subject: Re: [Clearwater] sprout exception if one handset in active chat > session loses connection > > Issue opened for this: > #564 sprout exception if one handset in active chat session loses > connection<https://github.com/Metaswitch/sprout/issues/564> > > https://github.com/Metaswitch/sprout/issues/564 > > Thanks, > > James. > > > On 22 May 2014 14:09, Eleanor Merry <[email protected]> wrote: > > > Hi James, > > > > Yes - please do raise this as an issue in github! Please can you link > > to this email in the writeup as well please (link is > > http://lists.projectclearwater.org/mail-archive/msg00625.html ) > > > > Thanks, > > > > Ellie > > > > -----Original Message----- > > From: [email protected] [mailto: > > [email protected]] On Behalf Of James > > Coleman > > Sent: 22 May 2014 13:57 > > To: [email protected] > > Subject: Re: [Clearwater] sprout exception if one handset in active > > chat session loses connection > > > > here is an instance of that core dump again but with more logging in > > sprout: > > > > 22-05-2014 12:21:54.297 Debug stack.cpp:411: Queuing cloned received > > message 0x7f2724039238 for worker threads > > 22-05-2014 12:21:54.297 Debug stack.cpp:189: Worker thread dequeue > > message > > 0x7f2724039238 > > 22-05-2014 12:21:54.297 Debug pjsip: sip_endpoint.c Distributing rdata > > to > > modules: Request msg OPTIONS/cseq=177 (rdata0x7f2724039238) > > 22-05-2014 12:21:54.297 Debug pjsip: tsx0x7f272812c Incoming Request > > msg > > OPTIONS/cseq=177 (rdata0x7f2724039238) in state Completed > > 22-05-2014 12:21:54.297 Debug pjsip: tsx0x7f272812c Retransmiting > > Response msg 408/OPTIONS/cseq=177 (tdta0x7f27283b66b0), count=0, > > restart?=0 > > *22-05-2014 12:21:54.297 Verbose stack.cpp:242: TX 944 bytes Response > > msg > > 408/OPTIONS/cseq=177 (tdta0x7f27283b66b0) to UDP 176.34.92.238:5060 > > <http://176.34.92.238:5060>:* > > --start msg-- > > > > *SIP/2.0 404 Not Found* > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK4.1400761313.sputnik- > > 1-23962.fb-mas > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > ;rport;branch=z9hG4bKPjNuBLcxKC3x36BeINKYttmpHuK6Ib9-m7 > > Via: SIP/2.0/TCP 10.124.51.133:39254 > > > > ;rport=39254;received=10.124.51.133;branch=z9hG4bKPjdM2Du97uz9j1CJamBe > > pwKSZuaTLqzbrQ > > Via: SIP/2.0/UDP 192.168.127.239:5060 > > > > ;rport=22727;received=89.101.214.194;branch=z9hG4bKea27a8895bc50f40682 > > e437b646141d6363635 > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > Record-Route: > > <sip:[email protected]:5060 > > ;transport=UDP;lr> > > Call-ID: 10.63.22.246:5060sputnik.hbhpkydrdicl@fb-mas > > From: <sip:[email protected]>;tag=psiaxqsmdnwc > > To: <sip:[email protected] > > ;user=phone>;tag=z9hG4bK4.1400761313.sputnik-1-23962.fb-mas > > CSeq: 177 OPTIONS > > Content-Length: 0 > > > > > > --end msg-- > > *22-05-2014 12:21:54.297 Debug stack.cpp:191: Worker thread completed > > processing message 0x7f2724039238* > > *22-05-2014 12:21:54.297 Debug stack.cpp:197: Request latency = 191us* > > *22-05-2014 12:21:54.297 Debug pjsip: tsx0x7f271c15c Timeout timer > > event* > > *22-05-2014 12:21:54.297 Debug pjsip: tsx0x7f271c15c State changed > > from Proceeding to Terminated, event=TIMER* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:362: > > tsx0x7f271c15cd78 - tu_on_tsx_state UAC, TSX_STATE TIMER > > state=Terminated* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:3994: > > tsx0x7f271c15cd78 > > - uac_data = 0x7f271c1e5c40, uas_data = 0x7f271c088980* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:4013: Failed to > > connected to server, so add to blacklist* > > *22-05-2014 12:21:54.297 Debug baseresolver.cpp:471: Add > > 176.34.92.238:5060 <http://176.34.92.238:5060> transport 17 to > > blacklist for 30 seconds* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:4053: > > tsx0x7f271c15cd78 > > - UAC tsx terminated while still connected to UAS tsx* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:4057: Timeout or > > transport error* > > *22-05-2014 12:21:54.297 Debug stateful_proxy.cpp:3044: > > tsx0x7f271c15cd78 > > - Not forked request* > > > > *Signal 11 caught* > > > > Basic stack dump: > > 22-05-2014 12:21:54.298 Debug httpconnection.cpp:482: Received HTTP > > error response : > > > > http://10.124.51.133:8888/impu/sip%3A%2B353852796615%40openims.test/lo > > cation > > : > > HTTP response code said error > > 22-05-2014 12:21:54.298 Error httpconnection.cpp:523: > > > > http://10.124.51.133:8888/impu/sip%3A%2B353852796615%40openims.test/lo > > cationfailed at server 10.124.51.133 : HTTP response code said error > > (22 503) : > > retrying > > 22-05-2014 12:21:54.298 Debug httpconnection.cpp:456: Sending HTTP > > request > > : > > > > http://10.124.51.133:8888/impu/sip%3A%2B353852796615%40openims.test/lo > > cation(try > > 1) on new connection > > /usr/share/clearwater/bin/sprout[0x42823d] > > /usr/share/clearwater/bin/sprout[0x4ca8ff] > > /usr/share/clearwater/bin/sprout[0x500079] > > /lib/x86_64-linux-gnu/libc.so.6(+0x364a0)[0x7f275cfcb4a0] > > /usr/share/clearwater/bin/sprout[0x458ef4] > > /usr/share/clearwater/bin/sprout[0x4592f4] > > /usr/share/clearwater/bin/sprout[0x45a2a7] > > /usr/share/clearwater/bin/sprout[0x53df7a] > > /usr/share/clearwater/bin/sprout[0x54188a] > > /usr/share/clearwater/bin/sprout[0x53dd67] > > /usr/share/clearwater/bin/sprout[0x56dc2f] > > /usr/share/clearwater/bin/sprout[0x527665] > > /usr/share/clearwater/bin/sprout[0x5277d6] > > /usr/share/clearwater/bin/sprout[0x4297ff] > > /usr/share/clearwater/bin/sprout[0x55d6b8] > > /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f275ddcce9a] > > /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f275d0893fd] > > > > Advanced stack dump (requires gdb): > > 22-05-2014 12:21:54.433 Debug httpconnection.cpp:482: Received HTTP > > error response : > > > > http://10.124.51.133:8888/impu/sip%3A%2B353852796615%40openims.test/lo > > cation > > : > > HTTP response code said error > > 22-05-2014 12:21:54.433 Error httpconnection.cpp:536: > > > > http://10.124.51.133:8888/impu/sip%3A%2B353852796615%40openims.test/lo > > cationfailed at server 10.124.51.133 : HTTP response code said error > > (22 404) : > > fatal > > 22-05-2014 12:21:54.433 Error httpconnection.cpp:574: cURL failure > > with cURL error code 22 (see man 3 libcurl-errors) and HTTP error code > > 404 > > 22-05-2014 12:21:54.433 Debug acr.cpp:82: Sending Null ACR > > (0x7f27480898b0) > > 22-05-2014 12:21:54.433 Debug stateful_proxy.cpp:2370: No valid > > S-CSCFs found > > 22-05-2014 12:21:54.433 Debug acr.cpp:82: Sending Null ACR > > (0x7f27480898b0) > > 22-05-2014 12:21:54.433 Debug acr.cpp:53: Destroyed ACR > > (0x7f27480898b0) > > 22-05-2014 12:21:54.433 Debug pjsip: tsx0x7f27481b4 Sending Response > > msg > > 408/OPTIONS/cseq=855 (tdta0x7f2748211a10) in state Trying > > 22-05-2014 12:21:54.434 Verbose stack.cpp:242: TX 945 bytes Response > > msg > > 408/OPTIONS/cseq=855 (tdta0x7f2748211a10) to UDP 176.34.92.238:5060: > > --start msg-- > > > > SIP/2.0 404 Not Found > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK5.1400761313.sputnik- > > 1-23962.fb-mas > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > ;rport;branch=z9hG4bKPjZJkk0F7rE1be.c.gx0JmOaxWWgsWAzKG > > Via: SIP/2.0/TCP 10.124.51.133:55432 > > > > ;rport=55432;received=10.124.51.133;branch=z9hG4bKPjycskS-sx6UT-1Oroz0 > > HmcMfRqd.K2mPh > > Via: SIP/2.0/UDP 192.168.127.239:5060 > > > > ;rport=22727;received=89.101.214.194;branch=z9hG4bK3458b6b3a58192c72b1 > > 147070c2dd478363635 > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > Record-Route: > > <sip:[email protected]:5060 > > ;transport=UDP;lr> > > Call-ID: 10.63.22.246:5060sputnik.hghvkyfsqbjn@fb-mas > > From: <sip:[email protected]>;tag=ehfmdxoikuqc > > To: <sip:[email protected] > > ;user=phone>;tag=z9hG4bK5.1400761313.sputnik-1-23962.fb-mas > > CSeq: 855 OPTIONS > > Content-Length: 0 > > > > > > --end msg-- > > 22-05-2014 12:21:54.434 Debug pjsip: tsx0x7f27481b4 State changed from > > Trying to Completed, event=TX_MSG > > 22-05-2014 12:21:54.434 Debug stateful_proxy.cpp:362: > > tsx0x7f27481b4498 - tu_on_tsx_state UAS, TSX_STATE TX_MSG > > state=Completed > > 22-05-2014 12:21:54.434 Debug stateful_proxy.cpp:3318: Report SAS end > > marker - trail (6511) > > 22-05-2014 12:21:54.434 Debug stack.cpp:191: Worker thread completed > > processing message 0x7f2724093958 > > 22-05-2014 12:21:54.434 Debug stack.cpp:197: Request latency = > > 345247us > > 22-05-2014 12:21:54.434 Debug load_monitor.cpp:175: Accepted > > 100.000000% of requests, latency error = -0.886155, overload responses > > = 3 > > 22-05-2014 12:21:54.434 Debug load_monitor.cpp:190: Decrease rate to > > 117.489708 > > [Thread debugging using libthread_db enabled] Using host libthread_db > > library "/lib/x86_64-linux-gnu/libthread_db.so.1". > > [New Thread 0x7f27337fe700 (LWP 4101)] [New Thread 0x7f2733fff700 (LWP > > 4100)] [New Thread 0x7f2738ff9700 (LWP 4099)] .. > > . > > > > > > Thread 4 (Thread 0x7f2738ff9700 (LWP 4099)): > > #0 0x00007f275d054ccd in __libc_waitpid (pid=<optimized out>, > > stat_loc=<optimized out>, options=<optimized out>) at > > ../sysdeps/unix/sysv/linux/waitpid.c:41 > > #1 0x00007f275cfda29e in do_system (line=0x7f2738ff6440 "/usr/bin/gdb > > -nx --batch /proc/3990/exe 3990 -ex 'thread apply all bt'") at > > ../sysdeps/posix/system.c:149 > > #2 0x00007f275cfda6b0 in __libc_system (line=<optimized out>) at > > ../sysdeps/posix/system.c:190 > > #3 0x00000000004282f3 in Logger::backtrace (this=0x2379b90, > > data=<optimized out>) at > > > > /var/lib/jenkins/workspace/sprout-ubuntu-master/modules/cpp-common/src > > /logger.cpp:272 > > #4 0x00000000004ca8ff in Log::backtrace (fmt=<optimized out>) at > > > > /var/lib/jenkins/workspace/sprout-ubuntu-master/modules/cpp-common/src > > /log.cpp:145 > > *#5 0x0000000000500079 in exception_handler (sig=11) at main.cpp:770* > > *#6 <signal handler called>* > > *#7 0x0000000000458ef4 in handle_final_response (this=0x7f271c088980) > > at > > stateful_proxy.cpp:3144* > > *#8 UASTransaction::handle_final_response (this=0x7f271c088980) at > > stateful_proxy.cpp:3104* > > *#9 0x00000000004592f4 in UASTransaction::on_client_not_responding > > (this=0x7f271c088980, uac_data=0x7f271c1e5c40) at > > stateful_proxy.cpp:3046* > > #10 0x000000000045a2a7 in UACTransaction::on_tsx_state > > (this=0x7f271c1e5c40, event=0x7f2738ff8bb0) at stateful_proxy.cpp:4058 > > #11 0x000000000053df7a in tsx_set_state (tsx=0x7f271c15cd78, > > state=PJSIP_TSX_STATE_TERMINATED, event_src_type=PJSIP_EVENT_TIMER, > > event_src=0x7f271c15cf30) at ../src/pjsip/sip_transaction.c:1199 > > #12 0x000000000054188a in tsx_on_state_proceeding_uac > > (tsx=0x7f271c15cd78, > > event=0x7f2738ff8cc0) at ../src/pjsip/sip_transaction.c:2916 > > #13 0x000000000053dd67 in tsx_timer_callback (theap=0x7f27547bb3e0, > > entry=0x7f271c15cf30) at ../src/pjsip/sip_transaction.c:1142 > > #14 0x000000000056dc2f in pj_timer_heap_poll (ht=0x7f27547bb3e0, > > next_delay=0x7f2738ff8e00) at ../src/pj/timer.c:631 > > #15 0x0000000000527665 in pjsip_endpt_handle_events2 > > (endpt=0x7f27547bb0b8, max_timeout=0x7f2738ff8e50, p_count=0x0) at > > ../src/pjsip/sip_endpoint.c:711 > > #16 0x00000000005277d6 in pjsip_endpt_handle_events > > (endpt=0x7f27547bb0b8, > > max_timeout=0x7f2738ff8e50) at ../src/pjsip/sip_endpoint.c:768 > > #17 0x00000000004297ff in pjsip_thread (p=<optimized out>) at > > stack.cpp:161 > > #18 0x000000000055d6b8 in thread_main (param=0x237bd68) at > > ../src/pj/os_core_unix.c:523 > > #19 0x00007f275ddcce9a in start_thread (arg=0x7f2738ff9700) at > > pthread_create.c:308 > > #20 0x00007f275d0893fd in clone () at > > ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 > > #21 0x0000000000000000 in ?? () > > > > > > > > > > . > > > > > > > > On 22 May 2014 10:50, James Coleman > > <[email protected] > > >wrote: > > > > > Hello, > > > > > > I have a reproducible core dump with sprout . . . > > > e.g. phones do ims chat, one phone into airport mode -> we get a > > > sprout core dump. > > > > > > . > > > .. > > > #5 0x0000000000500079 in exception_handler (sig=11) at main.cpp:770 > > > #6 <signal handler called> > > > *#7 0x00000000019a4ce0 in ?? ()* > > > *#8 0x0000000000458efa in handle_final_response > > > (this=0x7fa788004800) at > > > stateful_proxy.cpp:3144* > > > *#9 UASTransaction::handle_final_response (this=0x7fa788004800) at > > > stateful_proxy.cpp:3104* > > > *#10 0x00000000004592f4 in UASTransaction::on_client_not_responding > > > (this=0x7fa788004800, uac_data=0x7fa788058c40) at > > > stateful_proxy.cpp:3046* > > > *#11 0x000000000045a2a7 in UACTransaction::on_tsx_state > > > (this=0x7fa788058c40, event=0x7fa7867fbbb0) at > > > stateful_proxy.cpp:4058* > > > *..* > > > . > > > > > > I hope someone can take a look . . . > > > Should I go and open a bug on this? > > > > > > Thanks! > > > > > > James. > > > > > > > > > VERSION: > > > root@ec2-54-198-205-191:/var/log# dpkg-query -W "*sprout*" > > > clearwater-snmp-handler-sprout 1.0-140508.035036 sprout > > > 1.0-140512.231812 > > > sprout-dbg 1.0-140512.231812 > > > sprout-libs 1.0-140512.231812 > > > sprout-libs-dbg 1.0-140512.231812 > > > root@ec2-54-198-205-191:/var/log# dpkg-query -W "*bono*" > > > bono 1.0-140512.231812 > > > bono-dbg 1.0-140512.231812 > > > clearwater-snmp-handler-bono 1.0-140508.035036 > > > root@ec2-54-198-205-191:/var/log# dpkg-query -W "*clearwater*" > > > clearwater-auto-config > > > clearwater-auto-config-aws 1.0-140508.123932 > > > clearwater-auto-upgrade > > > clearwater-cassandra 1.0-140508.035136 > > > clearwater-diags-monitor 1.0-140508.123932 > > > clearwater-infinispan > > > clearwater-infrastructure 1.0-140508.123932 > > > clearwater-log-cleanup 1.0-140508.123932 clearwater-logging > > > clearwater-memcached 1.0-140508.123932 > > > clearwater-secure-connections > > > clearwater-snmp-handler-bono 1.0-140508.035036 > > > clearwater-snmp-handler-homestead > > > clearwater-snmp-handler-sprout 1.0-140508.035036 > > > clearwater-snmpd 1.0-140508.123932 > > > clearwater-tcp-scalability 1.0-140508.123932 > > > > > > > > > > > > this backtrace from core: > > > > > > Thread 4 (Thread 0x7fa7867fc700 (LWP 796)): > > > #0 0x00007fa7af46eccd in __libc_waitpid (pid=<optimized out>, > > > stat_loc=<optimized out>, options=<optimized out>) at > > > ../sysdeps/unix/sysv/linux/waitpid.c:41 > > > #1 0x00007fa7af3f429e in do_system (line=0x7fa7867f9400 > > > "/usr/bin/gdb -nx --batch /proc/678/exe 678 -ex 'thread apply all > > > bt'") at > > > ../sysdeps/posix/system.c:149 > > > #2 0x00007fa7af3f46b0 in __libc_system (line=<optimized out>) at > > > ../sysdeps/posix/system.c:190 > > > #3 0x00000000004282f3 in Logger::backtrace (this=0x17ddb90, > > > data=<optimized out>) at > > > /var/lib/jenkins/workspace/sprout-ubuntu-master/modules/cpp-common/s > > > rc > > > /logger.cpp:272 > > > #4 0x00000000004ca8ff in Log::backtrace (fmt=<optimized out>) at > > > /var/lib/jenkins/workspace/sprout-ubuntu-master/modules/cpp-common/s > > > rc > > > /log.cpp:145 > > > #5 0x0000000000500079 in exception_handler (sig=11) at main.cpp:770 > > > #6 <signal handler called> > > > *#7 0x00000000019a4ce0 in ?? ()* > > > *#8 0x0000000000458efa in handle_final_response > > > (this=0x7fa788004800) at > > > stateful_proxy.cpp:3144* > > > *#9 UASTransaction::handle_final_response (this=0x7fa788004800) at > > > stateful_proxy.cpp:3104* > > > *#10 0x00000000004592f4 in UASTransaction::on_client_not_responding > > > (this=0x7fa788004800, uac_data=0x7fa788058c40) at > > > stateful_proxy.cpp:3046* > > > *#11 0x000000000045a2a7 in UACTransaction::on_tsx_state > > > (this=0x7fa788058c40, event=0x7fa7867fbbb0) at > > > stateful_proxy.cpp:4058* > > > #12 0x000000000053df7a in tsx_set_state (tsx=0x7fa7880584d8, > > > state=PJSIP_TSX_STATE_TERMINATED, event_src_type=PJSIP_EVENT_TIMER, > > > event_src=0x7fa788058690) at ../src/pjsip/sip_transaction.c:1199 > > > #13 0x000000000054188a in tsx_on_state_proceeding_uac > > > (tsx=0x7fa7880584d8, > > > event=0x7fa7867fbcc0) at ../src/pjsip/sip_transaction.c:2916 > > > #14 0x000000000053dd67 in tsx_timer_callback (theap=0x7fa7a6bd53e0, > > > entry=0x7fa788058690) at ../src/pjsip/sip_transaction.c:1142 > > > #15 0x000000000056dc2f in pj_timer_heap_poll (ht=0x7fa7a6bd53e0, > > > next_delay=0x7fa7867fbe00) at ../src/pj/timer.c:631 > > > #16 0x0000000000527665 in pjsip_endpt_handle_events2 > > > (endpt=0x7fa7a6bd50b8, max_timeout=0x7fa7867fbe50, p_count=0x0) at > > > ../src/pjsip/sip_endpoint.c:711 > > > #17 0x00000000005277d6 in pjsip_endpt_handle_events > > > (endpt=0x7fa7a6bd50b8, > > > max_timeout=0x7fa7867fbe50) at ../src/pjsip/sip_endpoint.c:768 > > > #18 0x00000000004297ff in pjsip_thread (p=<optimized out>) at > > > stack.cpp:161 > > > #19 0x000000000055d6b8 in thread_main (param=0x17dfd68) at > > > ../src/pj/os_core_unix.c:523 > > > #20 0x00007fa7b01e6e9a in start_thread (arg=0x7fa7867fc700) at > > > pthread_create.c:308 > > > #21 0x00007fa7af4a33fd in clone () at > > > ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 > > > #22 0x0000000000000000 in ?? () > > > > > > > > > sprout log: > > > 19-05-2014 09:32:44.974 Verbose stack.cpp:242: TX 1106 bytes > > > Response msg > > > 100/OPTIONS/cseq=255 (tdta0x7f50001b7200) to UDP 176.34.92.238:5060: > > > --start msg-- > > > > > > SIP/2.0 100 Trying > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491933.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjrROYJIyNzv.Ebk4GeJoCx30qKWp.aJnF > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491932.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjXy4So1J-TBagoBsMcNRVnMXa-3hVMrO1 > > > Via: SIP/2.0/TCP 10.124.51.133:35856 > > > ;rport=35856;received=10.124.51.133;branch=z9hG4bKPjydld567tPBTwG2vb > > > Xh > > > jrNt59U-QGi9az > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Call-ID: 10.63.22.246:5060sputnik.usfucbljsbta@fb-mas > > > From: <sip:[email protected]>;tag=vdvibetidnas > > > To: <sip:[email protected];user=phone> > > > CSeq: 255 OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > *19-05-2014 09:32:45.065* Verbose stack.cpp:226: RX 801 bytes > > > Response msg 480/OPTIONS/cseq=1 (rdata0x7f50002b5ed8) from UDP > > > 176.34.92.238:1024 > > : > > > --start msg-- > > > > > > SIP/2.0 480 Temporarily Unavailable > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjXy4So1J-TBagoBsMcNRVnMXa-3hVMrO1 > > > Via: SIP/2.0/TCP 10.124.51.133:35856 > > > ;rport=35856;received=10.124.51.133;branch=z9hG4bKPjydld567tPBTwG2vb > > > Xh > > > jrNt59U-QGi9az > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > From: <sip:[email protected]>;tag=Wlu0TYU+cE > > > To: <sip:[email protected];user=phone>;tag=ugpsvrasglnt > > > Call-ID: [email protected] > > > CSeq: 1 OPTIONS > > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Allow: OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > > > > Signal 11 caught > > > > > > Basic stack dump: > > > 19-05-2014 09:33:06.503 Status main.cpp:1001: Log level set to 4 > > > 19-05-2014 09:33:06.503 Info main.cpp:1011: Command-line options were: > > > /usr/share/clearwater/bin/sprout --domain openims.test --localhost > > > 10.124.51.133 --realm openims.test --memstore > > > /etc/clearwater/cluster_settings --hss10.124.51.133:8888 --chronos > > > localhost:7253 --xdms 10.124.51.133:7888 --enum 10.124.51.133 > > > --enum-suffix .e164.arpa --sas 0.0.0.0, > > > [email protected] --pjsip-threads 1 > > > --worker-threads 10 --record-routing-model pcscf > > > --default-session-expires > > > 600 --authentication -T 10.124.51.133 -o 9888 -a /var/log/sprout -F > > > /var/log/sprout -L 4 --scscf 5054 --scscf_uri > > > sip:10.124.51.133:5054;transport=TCP > > > --icscf 5052 > > > 19-05-2014 09:33:06.503 Info main.cpp:490: Override home domain set > > > to openims.test . . . sprout process restarting > > > > > > > > > ================================================== > > > bono log: > > > > > > --end msg-- > > > 19-05-2014 09:32:41.625 Verbose stack.cpp:242: TX 327 bytes Response > > > msg > > > 100/OPTIONS/cseq=1 (tdta0x7fd490057690) to UDP 89.101.214.194:5060: > > > --start msg-- > > > > > > SIP/2.0 100 Trying > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > From: <sip:[email protected]>;tag=Wlu0TYU+cE > > > To: <sip:[email protected];user=phone> > > > Call-ID: [email protected] > > > CSeq: 1 OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > 19-05-2014 09:32:44.822 Verbose stack.cpp:242: TX 386 bytes Response > > > msg > > > 408/OPTIONS/cseq=1 (tdta0x7fd474091bf0) to UDP 89.101.214.194:5060: > > > --start msg-- > > > > > > SIP/2.0 408 Request Timeout > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > Call-ID: [email protected] > > > From: <sip:[email protected]>;tag=Wlu0TYU+cE > > > To: <sip:+353861953134 > > > @openims.test;user=phone>;tag=z9hG4bK1ae0b61a991b1020632c8f213883c69 > > > c3 > > > 73034 > > > CSeq: 1 OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > 19-05-2014 09:32:44.986 Verbose stack.cpp:226: RX 658 bytes Response > > > msg > > > 408/OPTIONS/cseq=1 (rdata0x7fd478094be8) from TCP 10.124.51.133:5054: > > > --start msg-- > > > > > > SIP/2.0 408 Request Timeout > > > Via: SIP/2.0/TCP 10.124.51.133:35856 > > > ;rport=35856;received=10.124.51.133;branch=z9hG4bKPjydld567tPBTwG2vb > > > Xh > > > jrNt59U-QGi9az > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Call-ID: [email protected] > > > From: <sip:[email protected]>;tag=Wlu0TYU+cE > > > To: <sip:+353861953134 > > > @openims.test;user=phone>;tag=z9hG4bKPjydld567tPBTwG2vbXhjrNt59U-QGi > > > 9a > > > z > > > CSeq: 1 OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > 19-05-2014 09:32:45.155 Verbose stack.cpp:242: TX 2345 bytes Request > > > msg > > > OPTIONS/cseq=255 (tdta0x7fd480000b60) to UDP 89.101.214.194:22118: > > > --start msg-- > > > > > > OPTIONS sip:[email protected]:5060;transport=udp SIP/2.0 > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Via: SIP/2.0/UDP ec2-54-198-205-191.compute-1.amazonaws.com:5060 > > > ;rport;branch=z9hG4bKPjhYvv4cHC6S.DekcGNYr46dGVj83Tt.l8 > > > Via: SIP/2.0/TCP 10.124.51.133:49520 > > > ;rport=49520;received=10.124.51.133;branch=z9hG4bKPjSSn2g3JjG0Tn5lhE > > > T8 > > > GeZjfDfGC90z-I > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491933.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjrROYJIyNzv.Ebk4GeJoCx30qKWp.aJnF > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491932.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjXy4So1J-TBagoBsMcNRVnMXa-3hVMrO1 > > > Via: SIP/2.0/TCP 10.124.51.133:35856 > > > ;rport=35856;received=10.124.51.133;branch=z9hG4bKPjydld567tPBTwG2vb > > > Xh > > > jrNt59U-QGi9az > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > Max-Forwards: 65 > > > Accept: application/sdp > > > Accept-Contact: *;+g.3gpp.iari-ref="urn%3Aurn-7% > > > 3A3gpp-application.ims.iari.rcse.im<http://3a3gpp-application.ims.ia > > > ri > > > .rcse.im/> > > > ,urn%3Aurn-7%3A3gpp-application.ims.iari.rcse.ft,urn%3Aurn-7%3A3gpp- > > > ap > > > plication.ims.iari.rcs.geop > > > ush" > > > User-Agent: IM-client/OMA1.0 > > > Neusoft-Silta-RCSe-client/2.0.1344.33_TR > > > P-Asserted-Identity: <sip:[email protected]> > > > Session-Expires: 600 > > > CSeq: 255 OPTIONS > > > Allow: INVITE, UPDATE, ACK, CANCEL, BYE, NOTIFY, OPTIONS, MESSAGE, > > > REFER > > > From: <sip:[email protected]>;tag=vdvibetidnas > > > To: <sip:[email protected];user=phone> > > > Contact: <sip:[email protected]:5060 > > > ;transport=udp>;+sip.instance="<urn:uuid:9d6d8b7a-4589-3dab-ab1f-787 > > > 7c > > > 67243a9>";+g.3gpp.iari-ref="urn%3Aurn-7%3A3gpp-application.ims.iari. > > > 67243a9>rc > > > se.im > > > > > > ,urn%3Aurn-7%3A3gpp-application.ims.iari.rcse.ft,urn%3Aurn-7%3A3gpp-application.ims.iari.rcs.geopush" > > > Call-ID: 10.63.22.246:5060sputnik.usfucbljsbta@fb-mas > > > P-Called-Party-ID: <sip:[email protected]> > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > 19-05-2014 09:32:45.474 Verbose stack.cpp:242: TX 1283 bytes > > > Response msg > > > 408/OPTIONS/cseq=255 (tdta0x7fd4800619d0) to TCP 10.124.51.133:49520: > > > --start msg-- > > > > > > SIP/2.0 408 Request Timeout > > > Via: SIP/2.0/TCP 10.124.51.133:49520 > > > ;rport=49520;received=10.124.51.133;branch=z9hG4bKPjSSn2g3JjG0Tn5lhE > > > T8 > > > GeZjfDfGC90z-I > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491933.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjrROYJIyNzv.Ebk4GeJoCx30qKWp.aJnF > > > Via: SIP/2.0/UDP 10.63.22.246:5060 > > > ;rport=5060;received=176.34.92.238;branch=z9hG4bK0.1400491932.sputni > > > k- > > > 1-23962.fb-mas > > > Via: SIP/2.0/UDP 10.124.51.133:5052 > > > ;rport;branch=z9hG4bKPjXy4So1J-TBagoBsMcNRVnMXa-3hVMrO1 > > > Via: SIP/2.0/TCP 10.124.51.133:35856 > > > ;rport=35856;received=10.124.51.133;branch=z9hG4bKPjydld567tPBTwG2vb > > > Xh > > > jrNt59U-QGi9az > > > Via: SIP/2.0/UDP 192.168.128.211:5060 > > > ;rport=5060;received=89.101.214.194;branch=z9hG4bK1ae0b61a991b102063 > > > 2c > > > 8f213883c69c373034 > > > Record-Route: <sip:10.124.51.133:5054;transport=TCP;lr> > > > Record-Route: <sip:10.124.51.133:5058;transport=TCP;lr> > > > Record-Route: > > > <sip:[email protected]:5060 > > > ;transport=UDP;lr> > > > Call-ID: 10.63.22.246:5060sputnik.usfucbljsbta@fb-mas > > > From: <sip:[email protected]>;tag=vdvibetidnas > > > To: <sip:+353861953134 > > > @openims.test;user=phone>;tag=z9hG4bKPjSSn2g3JjG0Tn5lhET8GeZjfDfGC90 > > > z- > > > I > > > CSeq: 255 OPTIONS > > > Content-Length: 0 > > > > > > > > > --end msg-- > > > *19-05-2014 09:32:48.157 Verbose pjsip: tcpc0x7fd47803 TCP > > > connection > > > closed* > > > *19-05-2014 09:32:48.158 Verbose pjsip: tcps0x7fd47401 TCP > > > connection > > > closed* > > > *19-05-2014 09:32:48.158 Verbose pjsip: tcpc0x7fd4780e TCP > > > connection > > > closed* > > > > > > > -- > > > > > > <http://www.linkedin.com/company/76647?trk=fc_badge> > > > > openmindnetworks.com > > _______________________________________________ > > Clearwater mailing list > > [email protected] > > http://lists.projectclearwater.org/listinfo/clearwater > > > > -- > > > <http://www.linkedin.com/company/76647?trk=fc_badge> > > openmindnetworks.com > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater > -- <http://www.golgi.io/> <https://www.linkedin.com/company/openmind-networks?trk=fc_badge> <https://twitter.com/Openmind_Ntwks> openmindnetworks.com
_______________________________________________ Clearwater mailing list [email protected] http://lists.projectclearwater.org/listinfo/clearwater
