Hi team,
I was trying to a load test in OpenSIPS 2.2.2 version. Below are the few
scenario's I have tested and their observance as follows.
We have two REST Server, out of which I find different behavior when I use REST
API asynchronously - Scenario 3 and Scenario 5.
Am testing on a Vitual machine with 8 core CPU and 20 GB RAM.
Below are the configurations made:
* Children = 24 (opensips.cfg)
* Cps = 100 (sipp)
* S_MEMORY = 1024 (/etc/default/opensips)
* P_MEMORY = 64 (/etc/default/opensips)
No
Scenario - Script used
Result observed
Time when crash occurred
1
Default script
No crash observed
2
REST API service used with rest_put() - synchronous - Rest Server 1
Crash occurs when load testing. Single call works fine
Randomly at any point when it crosses more than 1000 calls
3
REST API service used with rest_put() - asynchronous - Rest Server 1
No crash observed
4
REST API service used with rest_put() - synchronous - Rest Server 2
Crash occurs when load testing. Single call works fine
Randomly at any point when it crosses more than 1000 calls
5
REST API service used with rest_put() - asynchronous -Rest Server 2
Crash occurs for even single call.
When processing the response received.
Am attaching the crash dump with this email. First two dumps are when rest api
is used synchronously
3rd dump is when rest api is used asynchronously, when processing response.
Please let me know if any more information is needed.
Regards,
Agalya
Missing separate debuginfos, use: debuginfo-install
cyrus-sasl-lib-2.1.26-20.el7_2.x86_64 glibc-2.17-106.el7_2.4.x86_64
keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.13.2-12.el7_2.x86_64
libcom_err-1.42.9-7.el7.x86_64 libcurl-7.29.0-25.el7.centos.x86_64
libidn-1.28-4.el7.x86_64 libselinux-2.2.2-6.el7.x86_64
libssh2-1.4.3-10.el7_2.1.x86_64 nspr-4.10.8-2.el7_1.x86_64
nss-3.19.1-19.el7_2.x86_64 nss-softokn-freebl-3.16.2.3-13.el7_1.x86_64
nss-util-3.19.1-9.el7_2.x86_64 openldap-2.4.40-9.el7_2.x86_64
openssl-libs-1.0.1e-51.el7_2.4.x86_64 pcre-8.32-15.el7.x86_64
xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-15.el7.x86_64
(gdb) bt
#0 0x000000000001769a in ?? ()
#1 0x00007f6041ce54fb in curl_thread_create_thunk () from /lib64/libcurl.so.4
#2 0x00007f6040627dc5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007f6087bbb28d in clone () from /lib64/libc.so.6
Program terminated with signal 11, Segmentation fault.
#0 0x00007f8b01830a1e in Curl_raw_nequal () from /lib64/libcurl.so.4
Missing separate debuginfos, use: debuginfo-install
cyrus-sasl-lib-2.1.26-20.el7_2.x86_64 glibc-2.17-106.el7_2.4.x86_64
keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.13.2-12.el7_2.x86_64
libcom_err-1.42.9-7.el7.x86_64 libcurl-7.29.0-25.el7.centos.x86_64
libidn-1.28-4.el7.x86_64 libselinux-2.2.2-6.el7.x86_64
libssh2-1.4.3-10.el7_2.1.x86_64 nspr-4.10.8-2.el7_1.x86_64
nss-3.19.1-19.el7_2.x86_64 nss-softokn-freebl-3.16.2.3-13.el7_1.x86_64
nss-util-3.19.1-9.el7_2.x86_64 openldap-2.4.40-9.el7_2.x86_64
openssl-libs-1.0.1e-51.el7_2.4.x86_64 pcre-8.32-15.el7.x86_64
xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-15.el7.x86_64
(gdb) bt
#0 0x00007f8b01830a1e in Curl_raw_nequal () from /lib64/libcurl.so.4
#1 0x00007f8b017fed0f in Curl_checkheaders () from /lib64/libcurl.so.4
#2 0x00007f8b018001e5 in Curl_http () from /lib64/libcurl.so.4
#3 0x00007f8b01810b4b in Curl_do () from /lib64/libcurl.so.4
#4 0x00007f8b01820a1b in multi_runsingle () from /lib64/libcurl.so.4
#5 0x00007f8b01821121 in curl_multi_perform () from /lib64/libcurl.so.4
#6 0x00007f8b018184a3 in curl_easy_perform () from /lib64/libcurl.so.4
#7 0x00007f8b01a5e020 in rest_put_method (msg=msg@entry=0x7f8b436690a8,
url=<optimized out>, body=<optimized out>,
ctype=<optimized out>, body_pv=body_pv@entry=0x7f8b4364a0d8,
ctype_pv=ctype_pv@entry=0x7f8b4364a170,
code_pv=code_pv@entry=0x7f8b4364a238) at rest_methods.c:844
#8 0x00007f8b01a608d6 in w_rest_put (msg=0x7f8b436690a8, gp_url=<optimized
out>, gp_body=0x7f8b4362b6a8 "\003",
gp_ctype=0x7f8b4364a0a8 "\001", body_pv=0x7f8b4364a0d8 "N",
ctype_pv=0x7f8b4364a170 "N", code_pv=0x7f8b4364a238 "N")
at rest_client.c:380
#9 0x000000000044ecb4 in do_action (a=a@entry=0x7f8b4362caa0,
msg=msg@entry=0x7f8b436690a8) at action.c:1845
#10 0x0000000000455d9c in run_action_list (a=<optimized out>,
msg=msg@entry=0x7f8b436690a8) at action.c:172
#11 0x0000000000496491 in eval_elem (e=0x7f8b4362cb80, msg=0x7f8b436690a8,
val=0x0) at route.c:1618
#12 0x0000000000495f97 in eval_expr (e=0x7f8b4362cb80, msg=0x7f8b436690a8,
val=0x0) at route.c:1968
#13 0x0000000000495fab in eval_expr (e=0x7f8b4362cbd0, msg=0x7f8b436690a8,
val=0x0) at route.c:1984
#14 0x0000000000495f87 in eval_expr (e=0x7f8b4362cc20,
msg=msg@entry=0x7f8b436690a8, val=val@entry=0x0) at route.c:1989
#15 0x000000000044e850 in do_action (a=a@entry=0x7f8b4362cde8,
msg=msg@entry=0x7f8b436690a8) at action.c:1090
#16 0x0000000000455d9c in run_action_list (a=<optimized out>,
msg=0x7f8b436690a8) at action.c:172
#17 0x0000000000452339 in do_action (a=a@entry=0x7f8b43633f90,
msg=msg@entry=0x7f8b436690a8) at action.c:1108
#18 0x000000000045611d in run_action_list (msg=<optimized out>, a=<optimized
out>) at action.c:172
#19 run_actions (a=<optimized out>, msg=0x7f8b436690a8) at action.c:137
#20 0x00000000004514a7 in do_action (a=a@entry=0x7f8b436294b0,
msg=msg@entry=0x7f8b436690a8) at action.c:745
#21 0x0000000000455d9c in run_action_list (a=<optimized out>,
msg=0x7f8b436690a8) at action.c:172
#22 0x0000000000452339 in do_action (a=a@entry=0x7f8b43629590,
msg=msg@entry=0x7f8b436690a8) at action.c:1108
#23 0x0000000000455f63 in run_action_list (msg=<optimized out>, a=<optimized
out>) at action.c:172
#24 run_actions (msg=0x7f8b436690a8, a=<optimized out>) at action.c:137
#25 run_top_route (a=<optimized out>, msg=msg@entry=0x7f8b436690a8) at
action.c:204
#26 0x0000000000458f4a in receive_msg (
buf=0x868c20 <buf.8277> "INVITE sip:[email protected]:5060
SIP/2.0\r\nTo: sut <sip:[email protected]:5060;user=phone>\r\nFrom: sipp
<sip:[email protected]:5060;user=phone>;tag=26527SIPpTag001917\r\nCall"...,
len=<optimized out>,
rcv_info=rcv_info@entry=0x7ffc0cf3aa20,
existing_context=existing_context@entry=0x0) at receive.c:208
#27 0x00000000005b9f73 in udp_read_req (si=<optimized out>,
bytes_read=<optimized out>) at net/proto_udp/proto_udp.c:192
#28 0x000000000059b950 in handle_io (idx=<optimized out>, event_type=<optimized
out>, fm=<optimized out>) at net/net_udp.c:259
#29 io_wait_loop_epoll (h=<optimized out>, t=<optimized out>, repeat=<optimized
out>) at net/../io_wait_loop.h:225
#30 udp_rcv_loop (si=si@entry=0x7f8b4361f6c8) at net/net_udp.c:308
Missing separate debuginfos, use: debuginfo-install
cyrus-sasl-lib-2.1.26-20.el7_2.x86_64 glibc-2.17-106.el7_2.4.x86_64
keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.13.2-12.el7_2.x86_64
libcom_err-1.42.9-7.el7.x86_64 libcurl-7.29.0-25.el7.centos.x86_64
libidn-1.28-4.el7.x86_64 libselinux-2.2.2-6.el7.x86_64
libssh2-1.4.3-10.el7_2.1.x86_64 nspr-4.10.8-2.el7_1.x86_64
nss-3.19.1-19.el7_2.x86_64 nss-softokn-3.16.2.3-13.el7_1.x86_64
nss-softokn-freebl-3.16.2.3-13.el7_1.x86_64 nss-sysinit-3.19.1-19.el7_2.x86_64
nss-util-3.19.1-9.el7_2.x86_64 openldap-2.4.40-9.el7_2.x86_64
openssl-libs-1.0.1e-51.el7_2.4.x86_64 pcre-8.32-15.el7.x86_64
sqlite-3.7.17-8.el7.x86_64 xz-libs-5.1.2-12alpha.el7.x86_64
zlib-1.2.7-15.el7.x86_64
(gdb) bt
#0 0x00007fb0db8c9a1e in Curl_raw_nequal () from /lib64/libcurl.so.4
#1 0x00007fb0db897d0f in Curl_checkheaders () from /lib64/libcurl.so.4
#2 0x00007fb0db8991e5 in Curl_http () from /lib64/libcurl.so.4
#3 0x00007fb0db8a9b4b in Curl_do () from /lib64/libcurl.so.4
#4 0x00007fb0db8b9a1b in multi_runsingle () from /lib64/libcurl.so.4
#5 0x00007fb0db8ba121 in curl_multi_perform () from /lib64/libcurl.so.4
#6 0x00007fb0dbaf313e in resume_async_http_req (fd=9, msg=0x7fb0dd08e140
<faked_req.10690>, _param=0x7fb11d6fdbb8)
at rest_methods.c:384
#7 0x00007fb0dce3857e in t_resume_async (fd=0x7fb11d6ef908,
param=0x7fb0dd93dd38) at async.c:125
#8 0x000000000059b8f8 in handle_io (idx=<optimized out>, event_type=<optimized
out>, fm=<optimized out>) at net/net_udp.c:267
#9 io_wait_loop_epoll (h=<optimized out>, t=<optimized out>, repeat=<optimized
out>) at net/../io_wait_loop.h:225
#10 udp_rcv_loop (si=si@entry=0x7fb11d6b86c8) at net/net_udp.c:308
#11 0x000000000059ce78 in udp_start_processes (chd_rank=chd_rank@entry=0x845740
<chd_rank.11028>, startup_done=startup_done@entry=0x0)
at net/net_udp.c:372
#12 0x0000000000419f50 in main_loop () at main.c:671
#13 main (argc=<optimized out>, argv=<optimized out>) at main.c:1261
_______________________________________________
Users mailing list
[email protected]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
