Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-11-08 Thread Daniel-Constantin Mierla
I think this issue was exposed only on centos/redhad packages, which is harder to detect as we set the OS type to linux. If someone comes up with a solution, I am ok, otherwise I think it's fine to add some remarks in the docs. Cheers, Daniel On 07/11/16 10:44, Olle E. Johansson wrote: > I

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-11-08 Thread Daniel-Constantin Mierla
Hello, you don't have to generate the readme files anymore, they are generated automatically on the server after committing the xml files. For creating the pull requests, just search the web/github about how to do it for github -- there are some good manuals in place hosted by github.com, but I

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-11-07 Thread Olle E. Johansson
I think we need to update the Make system instead of the docs to avoid this version. Or implement some code like we have for OpenSSL that outputs warnings at runtime. /O > On 07 Nov 2016, at 10:42, Jurijs Ivolga wrote: > > Hi Daniel, > > I found modules what are

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-11-07 Thread Jurijs Ivolga
Hi Daniel, I found modules what are impacted by this leak: http_client utils xcap http_async_client auth_identity xcap_client I would like to update documentations, but this is first time when I'm updating documentation. I believe I need to update xml file for module. Should I then regenerate

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-21 Thread Daniel-Constantin Mierla
Hello, On 21/10/16 11:22, Jurijs Ivolga wrote: > Hi Daniel, > > After 8 days there is still small memory leak, 200MB of Ram wasn't > freed during this 8 days, please check diagram below. > > 1) Is this something usual? > 2) Memory leak seems very small, maybe I should never worry about > this?

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-21 Thread Jurijs Ivolga
Hi Daniel, After 8 days there is still small memory leak, 200MB of Ram wasn't freed during this 8 days, please check diagram below. 1) Is this something usual? 2) Memory leak seems very small, maybe I should never worry about this? What you think? [image: Inline image 2] Thank you! With kind

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-12 Thread Daniel-Constantin Mierla
Hello, thanks -- coming in my mind now, xcap_client should use also the curl library. Cheers, Daniel On 12/10/16 15:35, Jurijs Ivolga wrote: > Hi Daniel, > > I will test couple more days and later I will try to add some comments > to utils, http_client & HTTP_ASYNC_CLIENT(not sure if there any

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-12 Thread Jurijs Ivolga
Hi Daniel, I will test couple more days and later I will try to add some comments to utils, http_client & HTTP_ASYNC_CLIENT(not sure if there any other modules which use curl, but I will check) modules when I will be 200% sure that issue is gone. With kind regards, Jurijs On Wed, Oct 12, 2016

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-12 Thread Daniel-Constantin Mierla
Hello, ok, so that was... Maybe it would be good to add a note to the docs of the module about this issue so people become aware of it. I guess the other http_* modules are affected. Pull requests or other suggestions are welcome, of course! Cheers, Daniel On 12/10/16 15:04, Jurijs Ivolga

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-12 Thread Jurijs Ivolga
Hi Daniel, Thank you a lot, it looks that issue is solved, after updating libcurl. I was using following manual for updating libcurl, in case if somebody will have same issue. https://www.digitalocean.com/community/questions/how-to-upgrade-curl-in-centos6 With kind regards, Jurijs On Tue,

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-11 Thread Jurijs Ivolga
Hi Daniel, You are correct we are using heavily http_query. I found following bug report: https://bugs.centos.org/view.php?id=9391 I will try to update to libcurl 7.44 and check if this help. Thank you a lot Daniel! With kind regards, Jurijs On Tue, Oct 11, 2016 at 10:55 AM,

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-11 Thread Daniel-Constantin Mierla
Hello, from the logs, it seems to be related to curl library, I see many reports like: ==16459== 189,318 bytes in 167 blocks are possibly lost in loss record 681 of 683 ==16459==at 0x4C26FEF: calloc (vg_replace_malloc.c:711) ==16459==by 0x104BB699: ??? (in /usr/lib64/libnsspem.so)

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-07 Thread Daniel-Constantin Mierla
Hello, that's the way it was done for older versions of kamailio. In master and 4.4 the memory debugging is turned on and it is reflected by the presence of DBG_SR_MEMORY in the output of 'kamailio -v'. Anyhow, what you reported is not a leak inside kamailio memory manager, but a leak of using

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-07 Thread Jurijs Ivolga
Hi Daniel, I tried to compile with memory manager in debugging mode like this: MEMDBG=1 make cfg 'include_modules= textopsx db_mysql jansson json snmpstats tls utils uuid' make all /etc/init.d/kamailioa stop make install /etc/init.d/kamailioa start But still I'm getting nothing on: kamailio -I

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-07 Thread Daniel-Constantin Mierla
Hello, There are some results when searching for memory leak on openssl 1.0.1, but might not be valid for this case. Would you be able to run kamailio through valgrind? It may slow down a bit the processing, but may be the fastest way to catch the system memory leak. Maybe you have an instance

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-07 Thread Jurijs Ivolga
Hi Daniel, openssl.x86_64 1.0.1e-48.el6_8.1 CentOS release 6.8 With kind regards, Jurijs On Fri, Oct 7, 2016 at 10:20 AM, Daniel-Constantin Mierla wrote: > Hello, > > the tls module in kamailio is using shm memory, but can be something > internal for libssl. What

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-07 Thread Daniel-Constantin Mierla
Hello, the tls module in kamailio is using shm memory, but can be something internal for libssl. What operating system do you use and what is the libssl version? Cheers, Daniel On 06/10/16 17:43, Jurijs Ivolga wrote: > Hi Daniel, > > I do not use puke.top rpc command. Maybe this issue related

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Jurijs Ivolga
Hi Daniel, I do not use puke.top rpc command. Maybe this issue related to TLS? Servers what has this problem are utilizing TLS heavily, servers which do not has this problem use UDP. With kind regards, Jurijs On Thu, Oct 6, 2016 at 6:05 PM, Daniel-Constantin Mierla wrote:

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Daniel-Constantin Mierla
Hello, are you using pike.top rpc command? I noticed in the code that it uses system malloc, but I haven't investigated further yet, first to see if this would be a possibility ... Cheers, Daniel On 06/10/16 16:33, Jurijs Ivolga wrote: > Hi Daniel, > > We do not do any external operations. > >

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Jurijs Ivolga
Hi Daniel, We do not do any external operations. We are using janson 2.7 everywhere. I will try to update to latest janson version tomorrow. All json operation is pretty much same, we are using only jansson_get. In attachment you can see memory consumption. On the right 2 servers which are

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Daniel-Constantin Mierla
Hello, are you doing different external operations than on the other instances, like mi/rpc commands. >From the list of the modules you exposed, I think jansson has the higher probability to work with system memory. Are you doing different json operations in config that in the other instances of

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Jurijs Ivolga
Hi Daniel, This modules what we are using: loadmodule "mi_fifo.so" loadmodule "kex.so" loadmodule "corex.so" loadmodule "tm.so" loadmodule "tmx.so" loadmodule "sl.so" loadmodule "rr.so" loadmodule "pv.so" loadmodule "maxfwd.so" loadmodule "textops.so" loadmodule "siputils.so" loadmodule

Re: [SR-Users] Out of memory in UB 210: OOM killed process 12261 (kamailio) score 0 vm:1614768kB, rss:280200kB, swap:131408kB

2016-10-06 Thread Daniel-Constantin Mierla
Hello, it looks like a leak from the system memory, not from kamailio's pkg or shm memory. This can be due to an improper use of an external library (e.g., libxml2) by a kamailio module or because of a problem in the library. Can you list the modules used in your config (the loadmodule lines)? I