Hi Bogdan,
Coming back to you after some holidays, and unfortunately,
new Opensips crashes...
Some weeks ago, we upgraded our servers to OpenSIPS 1.11,
but we faced a new crash, always with the "out of pkg
memory" error, last week.
Here is the exact version :
root@asbc2:/home/kemathy# opensips -V
version: opensips 1.11.2-notls (x86_64/linux)
flags: STATS: On, USE_IPV6, USE_TCP, DISABLE_NAGLE,
USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC,
FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144,
MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll_lt, epoll_et, sigio_rt,
select.
git revision: d41eb41
main.c compiled on 19:23:35 Jul 23 2014 with gcc 4.7
Here are an extract of logs we get at the crash-time (I
masked phone numbers and IPs for security purposes) :
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:core:parse_contacts: failed to parse contact
parameters
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:core:contact_parser: failed to parse contacts
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:core:parse_contact: failed to parse contact
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:core:pv_get_contact_body: failed to parse contact hdr
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
90tzz16g@pbx -- New REGISTER received from
188.94.XXX.XXX with Contact : -- IP 188.94.XXX.XXX --
PORT 5060
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
90tzz16g@pbx -- REGISTER Failed because of : No
Credentials -- From 188.94.XXX.XXX
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:core:build_res_buf_from_sip_req: out of pkg
memory; needs 526
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:sl:sl_send_reply_helper: response building failed
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:signaling:sig_send_reply_mod: failed to send reply
with sl module
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25622]:
ERROR:auth:challenge: failed to send the response
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25606]:
iy4l7y1r@pbx -- New REGISTER received from
188.94.XXX.XXX with Contact :
<sip:[email protected]:5060;transport=udp;line=6364d3f0>
<mailto:sip:[email protected]:5060;transport=udp;line=6364d3f0>
-- IP 188.94.XXX.XXX -- PORT 5060
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25606]:
iy4l7y1r@pbx -- REGISTER Failed because of : No
Credentials -- From 188.94.XXX.XXX
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
iy4l7y1r@pbx -- New REGISTER received from
188.94.XXX.XXX with Contact :
<sip:[email protected]:5060;transport=udp;line=6364d3f0>
<mailto:sip:[email protected]:5060;transport=udp;line=6364d3f0>
-- IP 188.94.XXX.XXX -- PORT 5060
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:core:db_allocate_rows: no memory left
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:db_mysql:db_mysql_convert_rows: no private memory left
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:db_mysql:db_mysql_convert_result: error while
converting rows
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:db_mysql:db_mysql_store_result: error while
converting result
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:core:db_do_query: error while storing result for
query [select
contact,expires,q,callid,cseq,flags,cflags,user_agent,received,path,socket,methods,last_modified,sip_instance,attr
from location where username='0326xxxxxx' order by q]
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:usrloc:db_load_urecord: db_query failed
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
CRITICAL:db_mysql:wrapper_single_mysql_stmt_execute:
driver error (1062): Duplicate entry
'0326xxxxxx--sip:[email protected]:5060;transport=udp;line
<mailto:0326xxxxxx--sip:[email protected]:5060;transport=udp;line>'
for key 'account_contact_idx'
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:usrloc:db_insert_ucontact: inserting contact in db
failed
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25614]:
ERROR:usrloc:insert_ucontact: failed to insert in database
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25620]:
ERROR:core:build_res_buf_from_sip_req: out of pkg
memory; needs 373
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25620]:
ERROR:sl:sl_send_reply_helper: response building failed
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25620]:
ERROR:signaling:sig_send_reply_mod: failed to send reply
with sl module
Aug 12 11:48:34 asbc2 /usr/local/sbin/opensips[25620]:
ERROR:options:opt_reply: failed to send 200 via send_reply
Unfortunately, we don't have the memory dump :-s ...
So, I don't know if there's something we can try to avoid
those errors to happen again; maybe we made something wrong
in our configuration file ?
We could provide you anything you want to help us find
where's the problem.
Thanks a lot for your help,
Kevin
*
Bien cordialement,
Best Regards,
**Kevin MATHY* |**Ingénieur VoIP
*
*
2014-07-08 8:43 GMT+02:00 Kevin Mathy <[email protected]
<mailto:[email protected]>>:
Hi Bogdan,
Sounds really good :-) ! I'm going to check if there's
no configuration change between 1.9's and 1.11's modules
version, and then will upgrade our version !
I hope this will correct our problem ;-)
Thanks for your help,
Kevin
*
Bien cordialement,
Best Regards,
**Kevin MATHY* |**Ingénieur VoIP
*
*
2014-07-07 18:40 GMT+02:00 Bogdan-Andrei Iancu
<[email protected] <mailto:[email protected]>>:
Hi Kevin,
OK, found the problem. As expected, this was fixed
in 1.11, but not ported to 1.9 as this version is
not maintained any more. Here is the link to the fix
for your crash:
https://github.com/OpenSIPS/opensips/commit/eef59c1d7b47ecc35438c01e7dcbdfeea903115a#diff-30710a8823b167e0aae5a14bb4878b75
Regards,
Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
http://www.opensips-solutions.com