(gdb) bt full #0 0x00000000004fd108 in free_contacts () No symbol table info available. #1 0x00000000004fe907 in free_contact () No symbol table info available. #2 0x00000000004d1a19 in clean_hdr_field () No symbol table info available. #3 0x00007f728e5226d2 in clean_msg_clone (msg=0x7f728f0ef490, max=0x7f728f0f11b8, min=0x7f728f0ef490) at sip_msg.h:116 hdr = 0x7f728f0f0f78 #4 run_trans_callbacks_locked (type=type@entry=128, trans=trans@entry=0x7f728fa39a98, req=<optimized out>, rpl=rpl@entry=0x7f729ee0c8a0, code=code@entry=487) at t_hooks.c:265 No locals. #5 0x00007f728e4edca1 in relay_reply (t=<optimized out>, p_msg=<optimized out>, branch=<optimized out>, msg_status=<optimized out>, cancel_bitmap=<optimized out>) at t_reply.c:1353 relay = 0 save_clone = 0 buf = 0x7f729ee10610 "SIP/2.0 487 Request Terminated\r\nVia:SIP/2.0/SCTP 10.93.137.170:5060;branch=z9hG4bK64779ifCh47j_BY6;yop=00.00.DFA3F6A2.0000.701E\r\nFrom:<sip:[email protected];user=phone>;tag=0WDhcAZ.Ua9"... res_len = 548 relayed_code = 487 relayed_msg = 0x7f729ee0c8a0 bm = {to_tag_val = {s = 0x78 <Address 0x78 out of bounds>, len = -1907418374}} totag_retr = 0 reply_status = RPS_COMPLETED uas_rb = <optimized out> cb_s = { s = 0x7f729ee10610 "SIP/2.0 487 Request Terminated\r\nVia:SIP/2.0/SCTP 10.93.137.170:5060;branch=z9hG4bK64779ifCh47j_BY6;yop=00.00.DFA3F6A2.0000.701E\r\nFrom:<sip:[email protected];user=phone>;tag=0WDhcAZ.Ua9"..., len = 548} text = {s = 0x634b623400000000 <Address 0x634b623400000000 out of bounds>, len = 775239475} __FUNCTION__ = "relay_reply" #6 0x00007f728e4f02bd in reply_received (p_msg=0x7f729ee0c8a0) at t_reply.c:1603 msg_status = 487 last_uac_status = 100 branch = 0 reply_status = <optimized out> timer = 8982449 cancel_bitmap = 0 uac = 0x7f728fa39c70 t = 0x7f728fa39a98 backup_list = <optimized out> has_reply_route = <optimized out> __FUNCTION__ = "reply_received" #7 0x000000000044fe7f in forward_reply () No symbol table info available. #8 0x0000000000437bfd in receive_msg () No symbol table info available. #9 0x0000000000536bb0 in udp_read_req () No symbol table info available. #10 0x00000000005218ca in udp_start_processes () No symbol table info available. #11 0x000000000041b8a5 in main () No symbol table info available. >Понедельник, 16 марта 2020, 1:41 +03:00 от [email protected]: > >Send Users mailing list submissions to >[email protected] > >To subscribe or unsubscribe via the World Wide Web, visit >http://lists.opensips.org/cgi-bin/mailman/listinfo/users >or, via email, send a message with subject or body 'help' to >[email protected] > >You can reach the person managing the list at >[email protected] > >When replying, please edit your Subject line so it is more specific >than "Re: Contents of Users digest..." > > >Today's Topics: > > 1. Re: segfault at the opensips 2.4.5 (Liviu Chircu) > (Johan De Clercq) > 2. Escape spaces in From and Contact (Calvin Ellison) > 3. db_mysql_convert_rows says no rows but there is one > (Calvin Ellison) > > >---------------------------------------------------------------------- > >Message: 1 >Date: Sun, 15 Mar 2020 17:05:24 +0000 >From: Johan De Clercq < [email protected] > >To: Oleg Podguyko < [email protected] >, OpenSIPS users mailling list >< [email protected] > >Subject: Re: [OpenSIPS-Users] segfault at the opensips 2.4.5 (Liviu >Chircu) >Message-ID: >< >am0pr06mb6226cf9a922d9a627fffc011a7...@am0pr06mb6226.eurprd06.prod.outlook.com >> > >Content-Type: text/plain; charset="cp1251" > >Do a backtrace and post the output please. > >Outlook voor iOS<https://aka.ms/o0ukef> downloaden >________________________________ >Van: Users < [email protected] > namens Oleg Podguyko via Users >< [email protected] > >Verzonden: Sunday, March 15, 2020 5:32:58 PM >Aan: [email protected] < [email protected] > >Onderwerp: Re: [OpenSIPS-Users] segfault at the opensips 2.4.5 (Liviu Chircu) > >Hi Liviu! > > I installed version 2.4.7 but continue to have problems with segfault… >These are the lines from opensips.log > >Mar 15 15:53:01 xx-spx-2 /usr/sbin/opensips[25271]: CRITICAL:core:sig_usr: >segfault in process pid: 25271, id: 11 >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[25258]: >NOTICE:event_jsonrpc:destroy: destroy module ... >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[30598]: NOTICE:core:main: version: >opensips 2.4.7 (x86_64/linux) >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[30598]: >WARNING:core:init_reactor_size: shrinking reactor size from 262144 >(autodetected via rlimit) to 52428 (limited by memory of 10% from 16Mb) >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[30598]: >WARNING:core:init_reactor_size: use 'open_files_limit' to enforce other limit >or increase pkg memory >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[30598]: NOTICE:signaling:mod_init: >initializing module ... >Mar 15 15:53:02 xx-spx-2 /usr/sbin/opensips[30598]: >NOTICE:event_jsonrpc:mod_init: initializing module ... > > > >These are the lines from /var/log/messages > >Mar 15 15:53:01 xx-spx-2 kernel: opensips[25271]: segfault at 3836312e58 ip >00000000004fd108 sp 00007fff71716b20 error 4 in opensips[400000+1ae000] >Mar 15 15:53:01 xx-spx-2 spx: 2020-03-15T15:53:01.962556+00:00 [warning] ><0.1372.0>@sf_osip_mi:handle_event/4:416 <0.20248.5575> connection down: >closed (killed: [], unprocessed: []) >Mar 15 15:53:01 xx-spx-2 spx: 2020-03-15T15:53:01.975763+00:00 [warning] ><0.1372.0>@sf_osip_mi:handle_event/4:426 connection failed, reason >{shutdown,econnrefused} >Mar 15 15:53:01 xx-spx-2 spx: 2020-03-15T15:53:01.978919+00:00 [warning] ><0.1372.0>@sf_osip_mi:handle_event/4:422 connection failed, reason >{shutdown,econnrefused} >Mar 15 15:53:02 xx-spx-2 systemd: opensips.service: main process exited, >code=exited, status=11/n/a >Mar 15 15:53:02 xx-spx-2 pkill: pkill: pidfile not valid >Mar 15 15:53:02 xx-spx-2 pkill: Try `pkill --help' for more information. >Mar 15 15:53:02 xx-spx-2 systemd: opensips.service: control process exited, >code=exited status=1 >Mar 15 15:53:02 xx-spx-2 systemd: Unit opensips.service entered failed state. >Mar 15 15:53:02 xx-spx-2 systemd: opensips.service failed. >Mar 15 15:53:02 xx-spx-2 spx: 2020-03-15T15:53:02.081992+00:00 [warning] ><0.1372.0>@sf_osip_mi:handle_event/4:422 connection failed, reason >{shutdown,econnrefused} >Mar 15 15:53:02 xx-spx-2 spx: 2020-03-15T15:53:02.184911+00:00 [warning] ><0.1372.0>@sf_osip_mi:handle_event/4:422 connection failed, reason >{shutdown,econnrefused} >Mar 15 15:53:02 xx-spx-2 systemd: opensips.service holdoff time over, >scheduling restart. >Mar 15 15:53:02 xx-spx-2 systemd: Stopped OpenSIPS is a very fast and flexible >SIP (RFC3261) server. >Mar 15 15:53:02 xx-spx-2 systemd: Starting OpenSIPS is a very fast and >flexible SIP (RFC3261) server... >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: Mar 15 15:53:02 [30587] >NOTICE:core:main: config file ok, exiting... >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: Listening on >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: udp: 192.168.9.38 [192.168.9.38]:5060 >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: sctp: 10.161.20.226 >[10.161.20.226]:5060 >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: hep_udp: 192.168.9.38 >[192.168.9.38]:6060 >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: Aliases: >Mar 15 15:53:02 xx-spx-2 opensips-m4cfg: sctp: XXX-XXXXX:5060 >Mar 15 15:53:02 xx-spx-2 opensips: Listening on >Mar 15 15:53:02 xx-spx-2 opensips: udp: 192.168.9.38 [192.168.9.38]:5060 >Mar 15 15:53:02 xx-spx-2 opensips: sctp: 10.161.20.226 [10.161.20.226]:5060 >Mar 15 15:53:02 xx-spx-2 opensips: hep_udp: 192.168.9.38 [192.168.9.38]:6060 >Mar 15 15:53:02 xx-spx-2 opensips: Aliases: >Mar 15 15:53:02 xx-spx-2 opensips: sctp: VMS-STAGE:5060 >Mar 15 15:53:02 xx-spx-2 systemd: Started OpenSIPS is a very fast and flexible >SIP (RFC3261) server. > > > >What’s wrong? >Четверг, 12 марта 2020, 20:00 +03:00 от [email protected]: > >Send Users mailing list submissions to >[email protected]< /[email protected] > > >To subscribe or unsubscribe via the World Wide Web, visit >http://lists.opensips.org/cgi-bin/mailman/listinfo/users >or, via email, send a message with subject or body 'help' to >[email protected]< >/compose?To=users%[email protected] > > >You can reach the person managing the list at >[email protected]< /compose?To=users%[email protected] > > >When replying, please edit your Subject line so it is more specific >than "Re: Contents of Users digest..." > > >Today's Topics: > > 1. Re: segfault at the opensips 2.4.5 (Liviu Chircu) > > >---------------------------------------------------------------------- > >Message: 1 >Date: Thu, 12 Mar 2020 18:43:42 +0200 >From: Liviu Chircu <[email protected]< /[email protected] >> >To: OpenSIPS users mailling list <[email protected]< >/[email protected] >> >Subject: Re: [OpenSIPS-Users] segfault at the opensips 2.4.5 >Message-ID: <[email protected]< >/compose?To=de7e2af8%2d687e%2d58da%2d1804%[email protected] >> >Content-Type: text/plain; charset=utf-8; format=flowed > >On 12.03.2020 18:32, Oleg Podguyko via Users wrote: >> >> How opensips handles segfault? And what needs to be done so that he >> does not die just like in the latter case? > >Hi Oleg, > >If one of the workers segfaults, OpenSIPS will perform a graceful >shutdown to the best of its ability, in the following order: > >* each remaining SIP worker gets sent a high-priority termination job. >Once they finish processing the current SIP message, they will run this >job and terminate >* once all workers are stopped: > * the dialog module will synchronize all in-memory dialogs to the >"dialog" table one last time > * the usrloc module will synchronize all in-memory contacts to the >"location" table, etc. > >Seeing that you are running 2.4.5, my advice would be to update to 2.4.7 >nightly [1] as soon as possible. You are missing roughly 1 year worth >of fixes, which is huge! > >Best regards, > >[1]: https://apt.opensips.org/packages.php?v=2.4 > >-- >Liviu Chircu >www.twitter.com/liviuchircu < http://www.twitter.com/liviuchircu > | >www.opensips-solutions.com < http://www.opensips-solutions.com > > >OpenSIPS Summit, Amsterdam, May 2020 > www.opensips.org/events < http://www.opensips.org/events > > > > > >------------------------------ > >Subject: Digest Footer > >_______________________________________________ >Users mailing list >[email protected]< /[email protected] > >http://lists.opensips.org/cgi-bin/mailman/listinfo/users > > >------------------------------ > >End of Users Digest, Vol 140, Issue 48 >************************************** > > >-- >Олег Подгуйко > >-------------- next part -------------- >An HTML attachment was scrubbed... >URL: < >http://lists.opensips.org/pipermail/users/attachments/20200315/bfceb182/attachment-0001.html > > > >------------------------------ > >Message: 2 >Date: Sun, 15 Mar 2020 15:29:13 -0700 >From: Calvin Ellison < [email protected] > >To: OpenSIPS users mailling list < [email protected] > >Subject: [OpenSIPS-Users] Escape spaces in From and Contact >Message-ID: >< CAL+QDG_c4HWdyWWpKZkzyoOWebX8bh2Fw+_T=8-ci3kxyhx...@mail.gmail.com > >Content-Type: text/plain; charset="utf-8" > >There is a broken client outside of my control sending From and Contact >with spaces in the URI userinfo part, e.g. > >From: <sip:18669060504 @... >or >Contact: <sip:SF Bay Ferry@... > >I have an error route to send back "400 bad header" but I'd rather process >them to return the intended 302 redirect. Can I fix these broken headers? > >I'm also going to ask Sansay why they aren't rejecting these at our edge. > >Regards, > >*Calvin Ellison* >Senior Voice Operations Engineer >[email protected] >+1 (213) 285-0555 > >----------------------------------------------- >*voxox.com < http://www.voxox.com/ > * >5825 Oberlin Drive, Suite 5 >San Diego, CA 92121 >[image: Voxox] >-------------- next part -------------- >An HTML attachment was scrubbed... >URL: < >http://lists.opensips.org/pipermail/users/attachments/20200315/359fc104/attachment-0001.html > > > >------------------------------ > >Message: 3 >Date: Sun, 15 Mar 2020 15:40:52 -0700 >From: Calvin Ellison < [email protected] > >To: OpenSIPS users mailling list < [email protected] > >Subject: [OpenSIPS-Users] db_mysql_convert_rows says no rows but there >is one >Message-ID: >< CAL+QDG_yR0sKus4AnZBBrK0E+56ap9cSTdoDLuS-HOW2+Lk9=w...@mail.gmail.com > >Content-Type: text/plain; charset="utf-8" > >This does not happen on every query response but will happen on every >response for the same query. CLI mysql and mariadb clients show the result >row correctly, and pcaps confirm that opensips is getting the row response >(attached). > >I recompiled opensips against libmariadbclient (Ubuntu >libmariadbclient-dev-compat) but that did not change the behavior. Debug >for a working and non-working query below. > >Pcap: >https://drive.google.com/file/d/1Un8dx8T3eFEhe8_jYIONrLVGhiQ6Xhj6/view?usp=sharing > >opensips -V >version: opensips 2.4.7 (x86_64/linux) >flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, F_MALLOC, >FAST_LOCK-ADAPTIVE_WAIT >ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, >MAX_URI_SIZE 1024, BUF_SIZE 65535 >poll method support: poll, epoll, sigio_rt, select. >git revision: 9e1fcc915 >main.c compiled on with gcc 7 > >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: >DBG:avpops:ops_async_dbquery: query [call >lrn.fulldataz('6198077359',curdate())] >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: DBG:core:db_init_async: >>> 1/220 transfers: (6 - 0x7fb7cc2f5ec8) >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:mysql_raise_event: MySQL status has not changed: connected >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: DBG:tm:t_handle_async: >placing async job into reactor >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: DBG:tm:io_watch_add: >[UDP_worker] io_watch_add op (6 on 12) (0x5605efdf65a0, 6, 16, >0x7fb78c103358,1), fd_no=4/104857 >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: >DBG:core:destroy_avp_list: destroying list (nil) >Mar 14 20:18:57 localhost /usr/sbin/opensips[2158]: DBG:core:receive_msg: >cleaning up >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: DBG:tm:t_resume_async: >resuming on fd 6, transaction 0x7fb78c1001a0 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_async_resume: mysql_read_query_result: 0, 00000 - "" >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: DBG:core:db_new_result: >allocate 48 bytes for result set at 0x7fb7cc2f4ac8 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: 15 columns returned from the query >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:core:db_allocate_columns: allocate 420 bytes for result columns at >0x7fb7cc2f6878 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f68f0)[0]=[number] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6900)[1]=[lrn] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6910)[2]=[port type] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_INT result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6920)[3]=[state] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6930)[4]=[network] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6940)[5]=[ocn] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6950)[6]=[ratecenter] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6960)[7]=[class] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6970)[8]=[lata] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6980)[9]=[country] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f6990)[10]=[reachable] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_BIGINT result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f69a0)[11]=[reason] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_STRING result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f69b0)[12]=[dnc] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_INT result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f69c0)[13]=[good] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_BIGINT result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: RES_NAMES(0x7fb7cc2f69d0)[14]=[delay] >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_get_columns: use DB_DOUBLE result type >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:db_mysql:db_mysql_convert_rows: no rows returned from the query >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:core:db_store_async_con: >> restore conn 0x7fb7cc2f5ec8 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:avpops:resume_async_dbquery: query returned no results >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:core:db_free_columns: freeing result columns at 0x7fb7cc2f6878 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: DBG:core:db_free_rows: >freeing 0 rows >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: >DBG:core:db_free_result: freeing result set at 0x7fb7cc2f4ac8 >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: DBG:tm:io_watch_del: >[UDP_worker] io_watch_del op on index -1 6 (0x5605efdf65a0, 6, -1, >0x10,0x1) fd_no=5 called >Mar 14 20:18:58 localhost /usr/sbin/opensips[2158]: DBG:core:cachedb_store: >from script [memcached] - with grp [lrn] >-------------- next part -------------- >An HTML attachment was scrubbed... >URL: < >http://lists.opensips.org/pipermail/users/attachments/20200315/6f81c8cd/attachment.html > > > >------------------------------ > >Subject: Digest Footer > >_______________________________________________ >Users mailing list >[email protected] >http://lists.opensips.org/cgi-bin/mailman/listinfo/users > > >------------------------------ > >End of Users Digest, Vol 140, Issue 55 >************************************** -- Олег Подгуйко
_______________________________________________ Users mailing list [email protected] http://lists.opensips.org/cgi-bin/mailman/listinfo/users
