Hello Bogdan,
Please find another trace in attachment.
Thanks for your help,
Yuriy
From: Bogdan-Andrei Iancu [mailto:[email protected]]
Sent: Friday, September 7, 2018 4:11 PM
To: OpenSIPS users mailling list <[email protected]>; zzz
<[email protected]>
Subject: Re: [OpenSIPS-Users] Opensips crashes
Hi Yuriy,
I see a corefile is generated - could you extract a full brancktrace please ?
See
http://www.opensips.org/Documentation/TroubleShooting-Crash
the "Extracting a back trace from the core file" chapter.
Thanks,
Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
http://www.opensips-solutions.com
OpenSIPS Bootcamp 2018
http://opensips.org/training/OpenSIPS_Bootcamp_2018/
On 09/07/2018 02:15 PM, zzz wrote:
Hello team,
Opensips is getting crashed after acc_aaa_request().
Sep 7 09:49:20 voip-45 /opensips[32172]: CRITICAL:core:sig_usr: segfault in
process pid: 32172, id: 6
Sep 7 09:50:29 voip-45 /opensips[32200]: CRITICAL:core:handle_worker: dead
child 7 (EOF received), pid 32173
Sep 7 09:50:29 voip-45 /opensips[32166]: INFO:core:handle_sigs: child process
32173 exited by a signal 11
Sep 7 09:50:29 voip-45 /opensips[32166]: INFO:core:handle_sigs: core was
generated
If I remove this function from the script , the Opensips works stable.
The Opensips config file is pretty much the same as default one, just with
additional modules in Module section.
I’m using opensips version
version: opensips 2.4.2 (x86_64/linux)
flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, F_MALLOC,
FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16,
MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll, sigio_rt, select.
git revision: acc45d1
main.c compiled on 21:41:30 Sep 6 2018 with gcc 4.9.2
I have done core dump with gdb, don’t know what would be the best to send it to
you.
Best regards,
Yuriy
_______________________________________________
Users mailing list
[email protected]<mailto:[email protected]>
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
For help, type "help".
Type "apropos word" to search for commands related to "word".
(gdb) dir /opt/src/glibc/sysdeps/x86_64/multiarch
Source directories searched: /opt/src/glibc/sysdeps/x86_64/multiarch:$cdir:$cwd
(gdb) file /usr/local/opensips_proxy/sbin/opensips
Reading symbols from /usr/local/opensips_proxy/sbin/opensips...done.
(gdb) core-file /data_sdb1/opensips/corefiles/core.opensips.sig11.31676
[New LWP 31676]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/local/opensips_proxy/sbin/opensips -P
/var/run/opensips/opensips.pid -m 10'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 __strncpy_sse2_unaligned () at
../sysdeps/x86_64/multiarch/strcpy-sse2-unaligned.S:63
warning: Source file is more recent than executable.
63 cmp $16, %r8
(gdb) bt full
#0 __strncpy_sse2_unaligned () at
../sysdeps/x86_64/multiarch/strcpy-sse2-unaligned.S:63
No locals.
#1 0x00007fbb122fdbc9 in rc_send_server () from
/usr/lib/x86_64-linux-gnu/libfreeradius-client.so.2
No symbol table info available.
#2 0x00007fbb122fcd9c in rc_aaa () from
/usr/lib/x86_64-linux-gnu/libfreeradius-client.so.2
No symbol table info available.
#3 0x00007fbb122fd0a3 in rc_acct () from
/usr/lib/x86_64-linux-gnu/libfreeradius-client.so.2
No symbol table info available.
#4 0x00007fbb12509cd4 in rad_send_message (rh=0xe3e070,
request=0x7fbb5ffa5790, reply=<optimized out>) at rad.c:312
msg = '\000' <repeats 16 times>,
"P\211\000\000\000\000\000\000\000\020\000\000\000\000\000\000H\000\000\000\000\000\000\000\070\304\367_\273\177\000\000\260>\372_\273\177\000\000\002\000\000\000\000\000\000\000\260>\372_\273\177\000\000\030\305\367_\273\177\000\000\002\000\000\000\000\000\000\000\335[H\000\000\000\000\000ر\367_\273\177\000\000DdF\033\273\177",
'\000' <repeats 18 times>,
"\003\000\000\000\000\000\000\000E\235J\000\000\000\000\000`Ða\273\177",
'\000' <repeats 29 times>,
"\200\000\000\000\000\322\001\213\000\000\000\000\000\017\000\000\000\000\000\000\000\240\000\000\000\000\000\000\000"...
vp = <optimized out>
attr = <optimized out>
result = <optimized out>
__FUNCTION__ = "rad_send_message"
#5 0x00007fbb12f3e633 in acc_aaa_request (req=req@entry=0x7fbb5ffa3eb0,
rpl=rpl@entry=0x0, cdr_flag=cdr_flag@entry=0) at acc.c:925
attr_cnt = 4
extra_len = <optimized out>
send = 0x7fbb5ffa5790
offset = 4
i = <optimized out>
av_type = 1536404520
_created = <optimized out>
_setup_time = <optimized out>
extra = <optimized out>
ctx = 0x0
__FUNCTION__ = "acc_aaa_request"
#6 0x00007fbb12f48bfe in w_acc_aaa_request (rq=0x7fbb5ffa3eb0,
comment=0x7fbb5ff93600, foo=<optimized out>) at acc_logic.c:383
accp = {code = 0, code_s = {s = 0x0, len = 0}, reason = {s =
0x7fbb5ff7eb98 "Some ACCOUNTING comment", len = 23}}
__FUNCTION__ = "w_acc_aaa_request"
#7 0x000000000047f60e in do_action (a=a@entry=0x7fbb5ff7ec30,
msg=msg@entry=0x7fbb5ffa3eb0) at action.c:1866
increment = <optimized out>
decrement = <optimized out>
val_number = <optimized out>
j = <optimized out>
val_s = {s = 0x6a <error: Cannot access memory at address 0x6a>, len =
1610033448}
cdb_reply = 0x7fbb61339300 <_nl_C_LC_TIME>
aux = {s = 0x6a <error: Cannot access memory at address 0x6a>, len =
1610033448}
---Type <return> to continue, or q <return> to quit---
i = <optimized out>
key_number = 0
it = <optimized out>
avp_val = <optimized out>
avp_name = {n = 106, s = {s = 0x6a <error: Cannot access memory at
address 0x6a>, len = 1610033448}}
avp_type = 2584
ret = -5
v = <optimized out>
sec = <optimized out>
usec = <optimized out>
to = <optimized out>
p = <optimized out>
tmp = <optimized out>
new_uri = <optimized out>
end = <optimized out>
crt = <optimized out>
len = <optimized out>
i = <optimized out>
user = 0
expires = 0
vals = {{s = 0x0, len = -791302352}, {s = 0x7ffcd0d5afd0 "\177", len =
1627687761}, {s = 0x7fbb6133dae0 <tz_rules> "\220", <incomplete sequence \341>,
len = 8180}, {
s = 0x6 <error: Cannot access memory at address 0x6>, len = 16}, {s
= 0x7ffcd0d5b0d0 "", len = -791302496}}
result = {s = 0x1000 <error: Cannot access memory at address 0x1000>,
len = 1627387222}
uri = {user = {s = 0x7fbb61339300 <_nl_C_LC_TIME>
"\033\251\017a\273\177", len = -791302049}, passwd = {s = 0xe16e90 "MSK", len =
-791302464}, host = {
s = 0x7ffcd0d5af90 <incomplete sequence \363\210>, len =
-791302252}, port = {s = 0x7ffcd0d5af38 "\200\061\266\031\273\177", len = 1},
params = {
s = 0x1 <error: Cannot access memory at address 0x1>, len =
-791302048}, headers = {s = 0x3031363133068d60 <error: Cannot access memory at
address 0x3031363133068d60>, len = -791302400},
port_no = 12672, proto = 6582, type = 32699, transport = {s =
0x7fbb202df908 "", len = 429255174}, ttl = {s = 0x7ffcd0d5b028 "
\266\063a\273\177", len = 0}, user_param = {
s = 0x7fbb5ff72478 "F", len = 431370624}, maddr = {s =
0x7fbb610023fb <__IO_vsprintf+107> "H\213T$(H;T$0\211\305s\023\306\002", len =
-72515583}, method = {
s = 0x7fbb19b63180 <cook> "31676_10 ", len = 431370624}, lr = {s =
0x7fbb19b63180 <cook> "31676_10 ", len = 431370624}, r2 = {s = 0x7fbb19b63189
<cook+9> "", len = -1}, gr = {
s = 0x7fbb19b63180 <cook> "31676_10 ", len = -1}, transport_val =
{s = 0x3531000000000000 <error: Cannot access memory at address
0x3531000000000000>, len = 808728115}, ttl_val = {
s = 0x7ffcd0d5afa0 "\001\200\255\373\377\377\377\377]", len =
8975182}, user_param_val = {s = 0x7ffcd0d5afa0
"\001\200\255\373\377\377\377\377]", len = 6528239}, maddr_val = {
s = 0x7ffcd0d5b108 "", len = 65457}, method_val = {s =
0x7ffcd0d5b480 "0\256\253\032\273\177", len = 8975182}, lr_val = {
s = 0x7fbb61008409 <_IO_vsnprintf+121> "H\201\303", <incomplete
sequence \360>, len = -72515583}, r2_val = {s = 0x7fbb1e00005d
<vio_read_buff+221> "H\001\235H\001", len = 511}, gr_val = {
s = 0x5 <error: Cannot access memory at address 0x5>, len = 511},
u_name = {{s = 0x2010 <error: Cannot access memory at address 0x2010>, len =
127}, {
s = 0x7fbb000000af <error: Cannot access memory at address
0x7fbb000000af>, len = 15}, {s = 0x6a <error: Cannot access memory at address
0x6a>, len = 1}, {s = 0x0, len = 111}, {s = 0x0,
len = 124}, {s = 0x7fbb5ffa3188 " \335", <incomplete sequence
\345>, len = 7}, {s = 0x7fbb6133b620 <main_arena> "", len = 8160}, {
s = 0x410 <error: Cannot access memory at address 0x410>, len =
8160}, {s = 0x89f300 <sql_str> "", len = 0}, {
s = 0x7fbb61012020 <__GI___libc_malloc+96>
"H\205\300H\211\302tx\203=\245\347\062", len = 0}}, u_val = {{s = 0x1fe0
<error: Cannot access memory at address 0x1fe0>, len = 1610232968}, {
s = 0x7fbb1e00005d <vio_read_buff+221> "H\001\235H\001", len =
0}, {s = 0x5 <error: Cannot access memory at address 0x5>, len = 15083152}, {s
= 0x7ffcd0d5b0d7 "", len = 0}, {
s = 0x7fbb1dfefa3e
"H\205\300I\211\307\177\332I\213\006H\211\307\377\220\250\001", len =
1610232200}, {s = 0x5 <error: Cannot access memory at address 0x5>, len = 2}, {
---Type <return> to continue, or q <return> to quit---
s = 0x7ffcd0d5b130 "\220\244\253\032\273\177", len = 0}, {s =
0x7fbb5ffa3df8 "\210", len = 1609949200}, {
s = 0x51c89a <fm_malloc+453>
"H\215C\030H\203\304([]A\\A]A^A_Ã\301\001\201\371\063\b", len = 15091360}, {s
= 0x7fbb5ff93730 "`\251\366_\273\177", len = -791301840}}, u_params_no = 46336}
next_hop = {user = {s = 0x6a <error: Cannot access memory at address
0x6a>, len = 1610033448}, passwd = {s = 0x4 <error: Cannot access memory at
address 0x4>, len = 1610234256}, host = {
s = 0x7fbb1aaba490 <query_str> "TI\213\032\273\177", len =
-791300864}, port = {s = 0x86dfc8 <log_level> "\250\065\061 \273\177", len =
5914205}, params = {
s = 0x6a <error: Cannot access memory at address 0x6a>, len =
1627463712}, headers = {s = 0x7fbb5ff72928 "\001", len = 4}, port_no = 14736,
proto = 24570, type = 32699, transport = {
s = 0x7fbb1aaba490 <query_str> "TI\213\032\273\177", len =
-791300864}, ttl = {
s = 0x7fbb1e4fb806 <db_mysql_get_columns+726>
"\213s\020\205\366\017\216\255\375\377\377H\215hpE1\344E1\355L\215\\$HL\211\\$\020D\211t$<O\215\064$L\211\360H\003\003H\213\020H\213}\220H\211:H\213\bI\211\371I\211\370A\203\340\003t%I\203\370\002t\vw\023\200?",
len = 15091360}, user_param = {s = 0x5 <error: Cannot access memory at address
0x5>, len = -791301672}, maddr = {
s = 0x7fbb1dfe9dbb <cli_read_rows+123> "\213L$\fI\307G(\030", len =
110}, method = {s = 0x400000000 <error: Cannot access memory at address
0x400000000>, len = -791301616}, lr = {
s = 0xe666a0 "", len = -791301536}, r2 = {s = 0x7fbb5ff6aad0 "@",
len = 1609949200}, gr = {s = 0x51c89a <fm_malloc+453>
"H\215C\030H\203\304([]A\\A]A^A_Ã\301\001\201\371\063\b",
len = 1610234256}, transport_val = {s = 0x7fbb5ff93730
"`\251\366_\273\177", len = 447456400}, ttl_val = {s = 0x7ffcd0d5b500 "", len =
106}, user_param_val = {
s = 0x8b01a5 <buf+101> "rport\r\nContent-Length: 0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=3664356635303264313363340131393532333132363435\r\nAccept:
application/sdp\r\nUser-Agent: friendly-scanner\r\nTo:
\"sipvicious\"<sip:[email protected]."..., len = 9109867}, maddr_val = {s = 0x8b02df
<buf+415> "", len = 1610237776}, method_val = {s = 0x7fbb5ffa4750 "\001", len =
9109924}, lr_val = {
s = 0x551c54 <parse_via+8678>
"H\211D$0H\205\300D\017\266T$8D\017\266\\$H\017\204t&", len = 1610235408},
r2_val = {s = 0x22494966 <error: Cannot access memory at address 0x22494966>,
len = 3}, gr_val = {s = 0x5 <error: Cannot access memory at address
0x5>, len = 0}, u_name = {{
s = 0x8b01a5 <buf+101> "rport\r\nContent-Length: 0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=3664356635303264313363340131393532333132363435\r\nAccept:
application/sdp\r\nUser-Agent: friendly-scanner\r\nTo:
\"sipvicious\"<sip:[email protected]."..., len = 1610001128}, {s = 0x7fbb5ffa4706 "",
len = 1609949200}, {s = 0x51c800 <fm_malloc+299> "\367A\201\306\363\a", len =
-791301168}, {
s = 0x892525 <sql_buf+12837> "", len = -791301184}, {
s = 0x7fbb1e509b24 <db_mysql_val2str>
"AVAUATUSH\203\354\020H\205\377t!H\205\366t\034I\211\324H\205\322t\024H\211\315H\205\311t\fD\213)E\205\355\017\205\263",
len = 0}, {
s = 0x8b016b <buf+43> "SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=3664356635303264313363340131393532333132363435\r\nAccept:
application/sdp\r\nUse"..., len = 9110239}, {s = 0x7fbb5ffa3e10 "\001", len =
0}, {s = 0x1 <error: Cannot access memory at address 0x1>, len = 1610237776}, {
s = 0x5480d3 <get_hdr_field+1155>
"H\211\303A\203?\377\017\204\264\t", len = 0}, {s = 0x7fbb6196e630 "\354\016A",
len = -791301024}}, u_val = {{s = 0x7fbb5ffa3df8 "\210",
len = 1609949200}, {s = 0x51c89a <fm_malloc+453>
"H\215C\030H\203\304([]A\\A]A^A_Ã\301\001\201\371\063\b", len = 1}, {
s = 0x7fbb6176596d <_dl_lookup_symbol_x+349> "\203", <incomplete
sequence \370>, len = 0}, {s = 0x7fbb6196e630 "\354\016A", len = 5}, {
s = 0x8b0166 <buf+38> "Via: SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=3664356635303264313363340131393532333132363435\r\nAccept:
application/sdp"..., len = 2}, {s = 0x8b02df <buf+415> "", len = 0}, {s =
0x7fbb5ffa3e10 "\001", len = 1610235568}, {
s = 0x549311 <parse_headers+372>
"I\211\303A\213\066D\215N\001A\203\371,\017\207\307\b", len = 0}, {s =
0x7fbb00000024 <error: Cannot access memory at address 0x7fbb00000024>,
len = -791301168}, {s = 0x7ffcd0d5b3c0 "\020\340\365_\273\177",
len = 575228262}}, u_params_no = 18496}
u = <optimized out>
port = 0
cmatch = <optimized out>
aitem = <optimized out>
adefault = <optimized out>
spec = <optimized out>
model = <optimized out>
val = {rs = {s = 0xa18 <error: Cannot access memory at address 0xa18>,
len = 1630775136}, ri = 0, flags = 0}
pve = <optimized out>
name_s = {s = 0xffffffffffffffff <error: Cannot access memory at
address 0xffffffffffffffff>, len = 0}
start = {tv_sec = 1, tv_usec = 33188}
aux_counter = 0
---Type <return> to continue, or q <return> to quit---
__FUNCTION__ = "do_action"
#8 0x0000000000485cbd in run_action_list (msg=<optimized out>, a=<optimized
out>) at action.c:172
ret = -1
t = 0x7fbb5ff7ec30
#9 run_actions (msg=0x7fbb5ffa3eb0, a=<optimized out>) at action.c:137
ret = -791328080
#10 run_top_route (a=<optimized out>, msg=msg@entry=0x7fbb5ffa3eb0) at
action.c:214
bk_action_flags = 0
bk_rec_lev = 0
ret = <optimized out>
ctx = 0x0
__FUNCTION__ = "run_top_route"
#11 0x000000000045fb12 in receive_msg (
buf=0x8b0140 <buf> "OPTIONS sip:[email protected] SIP/2.0\r\nVia:
SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=366435663530326431336334013139353"...,
len=<optimized out>, rcv_info=rcv_info@entry=0x7ffcd0d5b520,
existing_context=existing_context@entry=0x0, flags=flags@entry=0) at
receive.c:209
ctx = 0x7fbb5ffa4858
msg = 0x7fbb5ffa3eb0
start = {tv_sec = 415, tv_usec = 5109}
rc = 3
in_buff = {
s = 0x8b0140 <buf> "OPTIONS sip:[email protected] SIP/2.0\r\nVia:
SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=366435663530326431336334013139353"..., len
= 415}
__FUNCTION__ = "receive_msg"
#12 0x00000000005f515b in udp_read_req (si=<optimized out>,
bytes_read=<optimized out>) at net/proto_udp/proto_udp.c:181
ri = {src_ip = {af = 2, len = 4, u = {addrl = {1872407870, 0}, addr32 =
{1872407870, 0, 0, 0}, addr16 = {44350, 28570, 0, 0, 0, 0, 0, 0}, addr =
">\255\232o", '\000' <repeats 11 times>}},
dst_ip = {af = 2, len = 4, u = {addrl = {760242029, 0}, addr32 =
{760242029, 0, 0, 0}, addr16 = {24429, 11600, 0, 0, 0, 0, 0, 0}, addr = "m_P-",
'\000' <repeats 11 times>}}, src_port = 5109,
dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0,
src_su = {s = {sa_family = 2, sa_data =
"\023\365>\255\232o\000\000\000\000\000\000\000"}, sin = {sin_family = 2,
sin_port = 62739, sin_addr = {s_addr = 1872407870}, sin_zero =
"\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 62739,
sin6_flowinfo = 1872407870, sin6_addr = {
__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16
= {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id =
1610180176}}, bind_address = 0x7fbb5ff66650}
len = <optimized out>
buf = "OPTIONS sip:[email protected] SIP/2.0\r\nVia: SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=366435663530326431336334013139353"...
fromlen = 16
p = <optimized out>
msg = {
s = 0x8b0140 <buf> "OPTIONS sip:[email protected] SIP/2.0\r\nVia:
SIP/2.0/UDP
62.173.154.111:5109;branch=z9hG4bK-2427203249;rport\r\nContent-Length:
0\r\nFrom:
\"sipvicious\"<sip:[email protected]>;tag=366435663530326431336334013139353"..., len
= 415}
__FUNCTION__ = "udp_read_req"
#13 0x00000000005c8692 in handle_io (idx=<optimized out>, event_type=2,
fm=<optimized out>) at net/net_udp.c:261
n = 0
---Type <return> to continue, or q <return> to quit---
read = 0
#14 io_wait_loop_epoll (h=<optimized out>, t=<optimized out>, repeat=<optimized
out>) at net/../io_wait_loop.h:284
ep_event = {events = 8839120, data = {ptr = 0x0, fd = 0, u32 = 0, u64 =
0}}
ret = <optimized out>
n = 1
r = 0
e = <optimized out>
fd = <optimized out>
i = <optimized out>
#15 udp_start_processes (chd_rank=chd_rank@entry=0x88c1e4 <chd_rank>,
startup_done=startup_done@entry=0x0) at net/net_udp.c:389
si = <optimized out>
pid = <optimized out>
i = <optimized out>
__FUNCTION__ = "udp_start_processes"
#16 0x000000000041c12e in main_loop () at main.c:780
startup_done = 0x0
chd_rank = 4
#17 main (argc=<optimized out>, argv=<optimized out>) at main.c:1426
cfg_stream = <optimized out>
c = <optimized out>
r = <optimized out>
tmp = 0x7ffcd0d5be28 ""
tmp_len = <optimized out>
port = <optimized out>
proto = <optimized out>
protos_no = <optimized out>
options = 0x620728 "f:cCm:M:b:l:n:N:rRvdDFEVhw:t:u:g:P:G:W:o:"
ret = -1
seed = 68184984
rfd = <optimized out>
__FUNCTION__ = "main"
(gdb)
(gdb)
(gdb)
_______________________________________________
Users mailing list
[email protected]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
