Re: [zones-discuss] Application leaking on local zone
I reproduced the problem on global zone. Thanks!! Jeff Victor wrote: It would be useful to know if the memory leak is in locked memory or not. What isthe output of the following command, in both cases (app in GZ, app in a zone): GZ# pmap -x --JeffV On Thu, Dec 17, 2009 at 5:09 AM, AdinaKalin wrote: Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! <>___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
It would be useful to know if the memory leak is in locked memory or not. What isthe output of the following command, in both cases (app in GZ, app in a zone): GZ# pmap -x --JeffV On Thu, Dec 17, 2009 at 5:09 AM, AdinaKalin wrote: > Hello, > > I'm struggling with the following problem and I have no idea how to > solve it. > I'm testing an application which is running fine on a global zone,but > memory leaking when installed on a local zone. > > The local zone has its whole root and a very simple, basic configuration: > bash-3.00# zonecfg -z mdmMDMzone > zonecfg:mdmMDMzone> info > zonename: mdmMDMzone > zonepath: /mdmMDMzone > brand: native > autoboot: true > bootargs: > pool: > limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory > scheduling-class: FSS > ip-type: shared > net: > address: 192.168.109.14 > physical: e1000g0 > defrouter not specified > > One of the application processes, when started on global zone, has an > rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of > the test. If I stop the application on global zone and I start it on > local zone, the same process starts with the normal size ( 5gb on prstat > -s rss ) but is growing during the test ( I saw it 25GB on a server > with 32 gb RAM ) until is failing. I don't understand why is this > behavior and if the application has a memory leak, why I don't see it on > the > global zone. > > Any help is more than welcome!!! > > ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
I noticed that you configured your zone with proc_lock_memory, so that could explain the large RSS, but that would be same for the global zone too. Before you start with libumem debugging, I would try ppriv(1) command with the -D option to see if your app is silently failing because of a privilege issue. Do you have a pmap(1) of the offending process? BTW, what does your application do in that you have to make it zone aware? AdinaKalin wrote: This is exactly what I want to understand. No, the application is not zones aware. My project is to certify the application on zones. Jordan Vaughan wrote: As Steve said, libumem will be your best tool for this job. Is the program zone-aware? The program might behave differently (i.e., its logic is different) while running in non-global zones and the alternative code paths might be leaking memory. Jordan On 12/17/09 11:23 AM, Steve Lawrence wrote: I recommend using libumem on the application. Some folks were nice enough to write about it. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem -Steve On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! ___ zones-discuss mailing list zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org -- --- __ Joseph Balenzano /_/\ ISV Engineering / \\ \ Sun Microsystems Inc. /_\ \\ / joseph.balenz...@sun.com /_/ \/ / /Phone/Fax 203.653.4186 /_/ / \//\ \_\//\ / / \_/ / /\ / \_/ \\ \ \_\ \\ \_\/ -- ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
This is exactly what I want to understand. No, the application is not zones aware. My project is to certify the application on zones. Jordan Vaughan wrote: As Steve said, libumem will be your best tool for this job. Is the program zone-aware? The program might behave differently (i.e., its logic is different) while running in non-global zones and the alternative code paths might be leaking memory. Jordan On 12/17/09 11:23 AM, Steve Lawrence wrote: I recommend using libumem on the application. Some folks were nice enough to write about it. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem -Steve On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! ___ zones-discuss mailing list zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org <>___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
If you can provide some ::findleak details about the particular memory leak, perhaps someone can help. Zones do not leak memory by design. -Steve On Thu, Dec 17, 2009 at 09:27:07PM +0200, AdinaKalin wrote: >Yes. I already read this sites. The question is why on global zone there >isn't a memory leak and on local zone there is ?! > >Steve Lawrence wrote: > > I recommend using libumem on the application. > > Some folks were nice enough to write about it. > > [1]http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris > [2]http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem > > -Steve > > On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: > > > Hello, > > I'm struggling with the following problem and I have no idea how to > solve it. > I'm testing an application which is running fine on a global zone,but > memory leaking when installed on a local zone. > > The local zone has its whole root and a very simple, basic configuration: > bash-3.00# zonecfg -z mdmMDMzone > zonecfg:mdmMDMzone> info > zonename: mdmMDMzone > zonepath: /mdmMDMzone > brand: native > autoboot: true > bootargs: > pool: > limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory > scheduling-class: FSS > ip-type: shared > net: > address: 192.168.109.14 > physical: e1000g0 > defrouter not specified > > One of the application processes, when started on global zone, has an > rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of > the test. If I stop the application on global zone and I start it on > local zone, the same process starts with the normal size ( 5gb on prstat > -s rss ) but is growing during the test ( I saw it 25GB on a server > with 32 gb RAM ) until is failing. I don't understand why is this > behavior and if the application has a memory leak, why I don't see it on > the > global zone. > > Any help is more than welcome!!! > > > > > > > > > > ___ > zones-discuss mailing list > [3]zones-disc...@opensolaris.org > > > > > References > >Visible links >1. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris >2. http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem >3. mailto:zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
As Steve said, libumem will be your best tool for this job. Is the program zone-aware? The program might behave differently (i.e., its logic is different) while running in non-global zones and the alternative code paths might be leaking memory. Jordan On 12/17/09 11:23 AM, Steve Lawrence wrote: I recommend using libumem on the application. Some folks were nice enough to write about it. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem -Steve On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! ___ zones-discuss mailing list zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
Yes. I already read this sites. The question is why on global zone there isn't a memory leak and on local zone there is ?! Steve Lawrence wrote: I recommend using libumem on the application. Some folks were nice enough to write about it. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem -Steve On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! ___ zones-discuss mailing list zones-discuss@opensolaris.org <>___ zones-discuss mailing list zones-discuss@opensolaris.org
Re: [zones-discuss] Application leaking on local zone
I recommend using libumem on the application. Some folks were nice enough to write about it. http://blogs.sun.com/pnayak/entry/finding_memory_leaks_within_solaris http://blogs.sun.com/dlutz/entry/memory_leak_detection_with_libumem -Steve On Thu, Dec 17, 2009 at 12:09:11PM +0200, AdinaKalin wrote: > Hello, > > I'm struggling with the following problem and I have no idea how to > solve it. > I'm testing an application which is running fine on a global zone,but > memory leaking when installed on a local zone. > > The local zone has its whole root and a very simple, basic configuration: > bash-3.00# zonecfg -z mdmMDMzone > zonecfg:mdmMDMzone> info > zonename: mdmMDMzone > zonepath: /mdmMDMzone > brand: native > autoboot: true > bootargs: > pool: > limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory > scheduling-class: FSS > ip-type: shared > net: > address: 192.168.109.14 > physical: e1000g0 > defrouter not specified > > One of the application processes, when started on global zone, has an > rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of > the test. If I stop the application on global zone and I start it on > local zone, the same process starts with the normal size ( 5gb on prstat > -s rss ) but is growing during the test ( I saw it 25GB on a server > with 32 gb RAM ) until is failing. I don't understand why is this > behavior and if the application has a memory leak, why I don't see it on > the > global zone. > > Any help is more than welcome!!! > > > > > ___ > zones-discuss mailing list > zones-discuss@opensolaris.org ___ zones-discuss mailing list zones-discuss@opensolaris.org
[zones-discuss] Application leaking on local zone
Hello, I'm struggling with the following problem and I have no idea how to solve it. I'm testing an application which is running fine on a global zone,but memory leaking when installed on a local zone. The local zone has its whole root and a very simple, basic configuration: bash-3.00# zonecfg -z mdmMDMzone zonecfg:mdmMDMzone> info zonename: mdmMDMzone zonepath: /mdmMDMzone brand: native autoboot: true bootargs: pool: limitpriv: default,dtrace_proc,dtrace_user,proc_priocntl,proc_lock_memory scheduling-class: FSS ip-type: shared net: address: 192.168.109.14 physical: e1000g0 defrouter not specified One of the application processes, when started on global zone, has an rss of about 5 GB ( prstat -s rss ) and it keeps this size to the end of the test. If I stop the application on global zone and I start it on local zone, the same process starts with the normal size ( 5gb on prstat -s rss ) but is growing during the test ( I saw it 25GB on a server with 32 gb RAM ) until is failing. I don't understand why is this behavior and if the application has a memory leak, why I don't see it on the global zone. Any help is more than welcome!!! <>___ zones-discuss mailing list zones-discuss@opensolaris.org