Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-09-30 Thread Rik van Riel
On Fri, 2016-09-30 at 11:49 +0200, Michal Hocko wrote: > [CC Mike and Mel as they have seen some accounting oddities >  when doing performance testing. They can share details but >  essentially the system time just gets too high] > > For your reference the email thread started >

Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-09-30 Thread Rik van Riel
On Fri, 2016-09-30 at 11:49 +0200, Michal Hocko wrote: > [CC Mike and Mel as they have seen some accounting oddities >  when doing performance testing. They can share details but >  essentially the system time just gets too high] > > For your reference the email thread started >

Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-09-30 Thread Michal Hocko
[CC Mike and Mel as they have seen some accounting oddities when doing performance testing. They can share details but essentially the system time just gets too high] For your reference the email thread started http://lkml.kernel.org/r/20160823143330.gl23...@dhcp22.suse.cz I suspect this is

Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-09-30 Thread Michal Hocko
[CC Mike and Mel as they have seen some accounting oddities when doing performance testing. They can share details but essentially the system time just gets too high] For your reference the email thread started http://lkml.kernel.org/r/20160823143330.gl23...@dhcp22.suse.cz I suspect this is

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-30 Thread Michal Hocko
On Wed 24-08-16 12:14:06, Marcin Jabrzyk wrote: [...] > Sorry to hijack the thread, but I've found it recently > and I guess it's the best place to present our point. > We are working at our custom OS based on Linux and we also suffered much > by /proc//smaps file. As in Chrome we tried to improve

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-30 Thread Michal Hocko
On Wed 24-08-16 12:14:06, Marcin Jabrzyk wrote: [...] > Sorry to hijack the thread, but I've found it recently > and I guess it's the best place to present our point. > We are working at our custom OS based on Linux and we also suffered much > by /proc//smaps file. As in Chrome we tried to improve

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-30 Thread Michal Hocko
On Mon 29-08-16 16:37:04, Michal Hocko wrote: > [Sorry for a late reply, I was busy with other stuff] > > On Mon 22-08-16 15:44:53, Sonny Rao wrote: > > On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: > [...] > > But what about the private_clean and private_dirty?

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-30 Thread Michal Hocko
On Mon 29-08-16 16:37:04, Michal Hocko wrote: > [Sorry for a late reply, I was busy with other stuff] > > On Mon 22-08-16 15:44:53, Sonny Rao wrote: > > On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: > [...] > > But what about the private_clean and private_dirty? Surely > > those are

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-29 Thread Michal Hocko
[Sorry for a late reply, I was busy with other stuff] On Mon 22-08-16 15:44:53, Sonny Rao wrote: > On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: [...] > But what about the private_clean and private_dirty? Surely > those are more generally useful for calculating a

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-29 Thread Michal Hocko
[Sorry for a late reply, I was busy with other stuff] On Mon 22-08-16 15:44:53, Sonny Rao wrote: > On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: [...] > But what about the private_clean and private_dirty? Surely > those are more generally useful for calculating a lower bound on >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-24 Thread Marcin Jabrzyk
On 23/08/16 00:44, Sonny Rao wrote: On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: On Fri 19-08-16 10:57:48, Sonny Rao wrote: On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: On Thu 18-08-16 23:43:39, Sonny Rao wrote: On Thu, Aug 18, 2016

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-24 Thread Marcin Jabrzyk
On 23/08/16 00:44, Sonny Rao wrote: On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: On Fri 19-08-16 10:57:48, Sonny Rao wrote: On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: On Thu 18-08-16 23:43:39, Sonny Rao wrote: On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: On

Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-08-23 Thread Rik van Riel
On Tue, 2016-08-23 at 16:33 +0200, Michal Hocko wrote: > On Tue 23-08-16 10:26:03, Michal Hocko wrote: > > On Mon 22-08-16 19:47:09, Michal Hocko wrote: > > > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > > > [...] > > > > > I have no idea

Re: utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-08-23 Thread Rik van Riel
On Tue, 2016-08-23 at 16:33 +0200, Michal Hocko wrote: > On Tue 23-08-16 10:26:03, Michal Hocko wrote: > > On Mon 22-08-16 19:47:09, Michal Hocko wrote: > > > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > > > [...] > > > > > I have no idea

utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-08-23 Thread Michal Hocko
On Tue 23-08-16 10:26:03, Michal Hocko wrote: > On Mon 22-08-16 19:47:09, Michal Hocko wrote: > > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > > [...] > > > > I have no idea why those numbers are so different on my laptop > > > > yet. It

utime accounting regression since 4.6 (was: Re: [PACTH v2 0/3] Implement /proc//totmaps)

2016-08-23 Thread Michal Hocko
On Tue 23-08-16 10:26:03, Michal Hocko wrote: > On Mon 22-08-16 19:47:09, Michal Hocko wrote: > > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > > [...] > > > > I have no idea why those numbers are so different on my laptop > > > > yet. It

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-23 Thread Michal Hocko
On Mon 22-08-16 19:47:09, Michal Hocko wrote: > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > [...] > > > I have no idea why those numbers are so different on my laptop > > > yet. It surely looks suspicious. I will try to debug this further > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-23 Thread Michal Hocko
On Mon 22-08-16 19:47:09, Michal Hocko wrote: > On Mon 22-08-16 19:29:36, Michal Hocko wrote: > > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > > [...] > > > I have no idea why those numbers are so different on my laptop > > > yet. It surely looks suspicious. I will try to debug this further > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Sonny Rao
On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: > On Fri 19-08-16 10:57:48, Sonny Rao wrote: >> On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: >> > On Thu 18-08-16 23:43:39, Sonny Rao wrote: >> >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Sonny Rao
On Mon, Aug 22, 2016 at 12:54 AM, Michal Hocko wrote: > On Fri 19-08-16 10:57:48, Sonny Rao wrote: >> On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: >> > On Thu 18-08-16 23:43:39, Sonny Rao wrote: >> >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: >> >> > On Thu 18-08-16

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 19:29:36, Michal Hocko wrote: > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > [...] > > I have no idea why those numbers are so different on my laptop > > yet. It surely looks suspicious. I will try to debug this further > > tomorrow. > > Hmm, so I've tried to use my version of

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 19:29:36, Michal Hocko wrote: > On Mon 22-08-16 18:45:54, Michal Hocko wrote: > [...] > > I have no idea why those numbers are so different on my laptop > > yet. It surely looks suspicious. I will try to debug this further > > tomorrow. > > Hmm, so I've tried to use my version of

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 18:45:54, Michal Hocko wrote: [...] > I have no idea why those numbers are so different on my laptop > yet. It surely looks suspicious. I will try to debug this further > tomorrow. Hmm, so I've tried to use my version of awk on other machine and vice versa and it didn't make any

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 18:45:54, Michal Hocko wrote: [...] > I have no idea why those numbers are so different on my laptop > yet. It surely looks suspicious. I will try to debug this further > tomorrow. Hmm, so I've tried to use my version of awk on other machine and vice versa and it didn't make any

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 23:12:41, Minchan Kim wrote: > On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: > > On Mon 22-08-16 09:07:45, Minchan Kim wrote: > > [...] > > > #!/bin/sh > > > ./smap_test & > > > pid=$! > > > > > > for i in $(seq 25) > > > do > > > awk '/^Rss/{rss+=$2}

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 23:12:41, Minchan Kim wrote: > On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: > > On Mon 22-08-16 09:07:45, Minchan Kim wrote: > > [...] > > > #!/bin/sh > > > ./smap_test & > > > pid=$! > > > > > > for i in $(seq 25) > > > do > > > awk '/^Rss/{rss+=$2}

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Robert Foss
On 2016-08-22 10:12 AM, Minchan Kim wrote: On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: On Mon 22-08-16 09:07:45, Minchan Kim wrote: [...] #!/bin/sh ./smap_test & pid=$! for i in $(seq 25) do awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ /proc/$pid/smaps

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Robert Foss
On 2016-08-22 10:12 AM, Minchan Kim wrote: On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: On Mon 22-08-16 09:07:45, Minchan Kim wrote: [...] #!/bin/sh ./smap_test & pid=$! for i in $(seq 25) do awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ /proc/$pid/smaps

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Minchan Kim
On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: > On Mon 22-08-16 09:07:45, Minchan Kim wrote: > [...] > > #!/bin/sh > > ./smap_test & > > pid=$! > > > > for i in $(seq 25) > > do > > awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ > > /proc/$pid/smaps > > done > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Minchan Kim
On Mon, Aug 22, 2016 at 09:40:52AM +0200, Michal Hocko wrote: > On Mon 22-08-16 09:07:45, Minchan Kim wrote: > [...] > > #!/bin/sh > > ./smap_test & > > pid=$! > > > > for i in $(seq 25) > > do > > awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ > > /proc/$pid/smaps > > done > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Fri 19-08-16 10:57:48, Sonny Rao wrote: > On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: > > On Thu 18-08-16 23:43:39, Sonny Rao wrote: > >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Fri 19-08-16 10:57:48, Sonny Rao wrote: > On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: > > On Thu 18-08-16 23:43:39, Sonny Rao wrote: > >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > >> >> On Thu, Aug 18, 2016 at 12:44 AM,

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 09:07:45, Minchan Kim wrote: [...] > #!/bin/sh > ./smap_test & > pid=$! > > for i in $(seq 25) > do > awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ > /proc/$pid/smaps > done > kill $pid > > root@bbox:/home/barrios/test/smap# time ./s.sh > pid:21973 > > real

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-22 Thread Michal Hocko
On Mon 22-08-16 09:07:45, Minchan Kim wrote: [...] > #!/bin/sh > ./smap_test & > pid=$! > > for i in $(seq 25) > do > awk '/^Rss/{rss+=$2} /^Pss/{pss+=$2} END {}' \ > /proc/$pid/smaps > done > kill $pid > > root@bbox:/home/barrios/test/smap# time ./s.sh > pid:21973 > > real

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-21 Thread Minchan Kim
On Fri, Aug 19, 2016 at 10:05:32AM +0200, Michal Hocko wrote: > On Fri 19-08-16 11:26:34, Minchan Kim wrote: > > Hi Michal, > > > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-21 Thread Minchan Kim
On Fri, Aug 19, 2016 at 10:05:32AM +0200, Michal Hocko wrote: > On Fri 19-08-16 11:26:34, Minchan Kim wrote: > > Hi Michal, > > > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Fri, Aug 19, 2016 at 1:05 AM, Michal Hocko wrote: > On Fri 19-08-16 11:26:34, Minchan Kim wrote: >> Hi Michal, >> >> On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> > > On Thu, Aug 18, 2016 at 12:44 AM, Michal

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Fri, Aug 19, 2016 at 1:05 AM, Michal Hocko wrote: > On Fri 19-08-16 11:26:34, Minchan Kim wrote: >> Hi Michal, >> >> On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: > On Thu 18-08-16 23:43:39, Sonny Rao wrote: >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Fri, Aug 19, 2016 at 12:59 AM, Michal Hocko wrote: > On Thu 18-08-16 23:43:39, Sonny Rao wrote: >> On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: >> > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> >> > On Wed 17-08-16

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Michal Hocko
On Fri 19-08-16 11:26:34, Minchan Kim wrote: > Hi Michal, > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > > > On Wed 17-08-16 11:57:56, Sonny Rao

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Michal Hocko
On Fri 19-08-16 11:26:34, Minchan Kim wrote: > Hi Michal, > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > > [...] > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Michal Hocko
On Thu 18-08-16 23:43:39, Sonny Rao wrote: > On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > >> > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Michal Hocko
On Thu 18-08-16 23:43:39, Sonny Rao wrote: > On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > >> > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > > [...] > >> >> 2) User space OOM

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 7:26 PM, Minchan Kim wrote: > Hi Michal, > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: >> On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> > > On Wed

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 7:26 PM, Minchan Kim wrote: > Hi Michal, > > On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: >> On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: >> [...]

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > [...] >> >> 2) User space OOM handling -- we'd

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 11:01 AM, Michal Hocko wrote: > On Thu 18-08-16 10:47:57, Sonny Rao wrote: >> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: >> > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > [...] >> >> 2) User space OOM handling -- we'd rather do a more graceful shutdown >> >>

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 2:05 PM, Robert Foss wrote: > > > On 2016-08-18 02:01 PM, Michal Hocko wrote: >> >> On Thu 18-08-16 10:47:57, Sonny Rao wrote: >>> >>> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: On Wed 17-08-16 11:57:56,

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-19 Thread Sonny Rao
On Thu, Aug 18, 2016 at 2:05 PM, Robert Foss wrote: > > > On 2016-08-18 02:01 PM, Michal Hocko wrote: >> >> On Thu 18-08-16 10:47:57, Sonny Rao wrote: >>> >>> On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: On Wed 17-08-16 11:57:56, Sonny Rao wrote: >> >> [...] > > 2)

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Sonny Rao
On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > On Wed 17-08-16 11:57:56, Sonny Rao wrote: >> On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: >> > On Wed 17-08-16 11:31:25, Jann Horn wrote: > [...] >> >> That's at least 30.43% + 9.12% + 7.66% =

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Sonny Rao
On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > On Wed 17-08-16 11:57:56, Sonny Rao wrote: >> On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: >> > On Wed 17-08-16 11:31:25, Jann Horn wrote: > [...] >> >> That's at least 30.43% + 9.12% + 7.66% = 47.21% of the task's kernel >> >> time

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Minchan Kim
Hi Michal, On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > [...] > > >> 2) User space OOM handling -- we'd

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Minchan Kim
Hi Michal, On Thu, Aug 18, 2016 at 08:01:04PM +0200, Michal Hocko wrote: > On Thu 18-08-16 10:47:57, Sonny Rao wrote: > > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: > [...] > > >> 2) User space OOM handling -- we'd rather do a more

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Robert Foss
On 2016-08-18 02:01 PM, Michal Hocko wrote: On Thu 18-08-16 10:47:57, Sonny Rao wrote: On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: On Wed 17-08-16 11:57:56, Sonny Rao wrote: [...] 2) User space OOM handling -- we'd rather do a more graceful shutdown than let

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Robert Foss
On 2016-08-18 02:01 PM, Michal Hocko wrote: On Thu 18-08-16 10:47:57, Sonny Rao wrote: On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: On Wed 17-08-16 11:57:56, Sonny Rao wrote: [...] 2) User space OOM handling -- we'd rather do a more graceful shutdown than let the kernel's OOM

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Michal Hocko
On Thu 18-08-16 10:47:57, Sonny Rao wrote: > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: [...] > >> 2) User space OOM handling -- we'd rather do a more graceful shutdown > >> than let the kernel's OOM killer activate and

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Michal Hocko
On Thu 18-08-16 10:47:57, Sonny Rao wrote: > On Thu, Aug 18, 2016 at 12:44 AM, Michal Hocko wrote: > > On Wed 17-08-16 11:57:56, Sonny Rao wrote: [...] > >> 2) User space OOM handling -- we'd rather do a more graceful shutdown > >> than let the kernel's OOM killer activate and need to gather this

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Michal Hocko
On Wed 17-08-16 11:57:56, Sonny Rao wrote: > On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: > > On Wed 17-08-16 11:31:25, Jann Horn wrote: [...] > >> That's at least 30.43% + 9.12% + 7.66% = 47.21% of the task's kernel > >> time spent on evaluating format strings. The new

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-18 Thread Michal Hocko
On Wed 17-08-16 11:57:56, Sonny Rao wrote: > On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: > > On Wed 17-08-16 11:31:25, Jann Horn wrote: [...] > >> That's at least 30.43% + 9.12% + 7.66% = 47.21% of the task's kernel > >> time spent on evaluating format strings. The new interface > >>

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Sonny Rao
On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: > On Wed 17-08-16 11:31:25, Jann Horn wrote: >> On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: >> > On Tue 16-08-16 12:46:51, Robert Foss wrote: >> > [...] >> > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Sonny Rao
On Wed, Aug 17, 2016 at 6:03 AM, Michal Hocko wrote: > On Wed 17-08-16 11:31:25, Jann Horn wrote: >> On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: >> > On Tue 16-08-16 12:46:51, Robert Foss wrote: >> > [...] >> > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} >>

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Robert Foss
On 2016-08-17 09:03 AM, Michal Hocko wrote: On Wed 17-08-16 11:31:25, Jann Horn wrote: On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: On Tue 16-08-16 12:46:51, Robert Foss wrote: [...] $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} /^Pss/{pss+=\$2} END

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Robert Foss
On 2016-08-17 09:03 AM, Michal Hocko wrote: On Wed 17-08-16 11:31:25, Jann Horn wrote: On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: On Tue 16-08-16 12:46:51, Robert Foss wrote: [...] $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} /^Pss/{pss+=\$2} END

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Michal Hocko
On Wed 17-08-16 11:31:25, Jann Horn wrote: > On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: > > On Tue 16-08-16 12:46:51, Robert Foss wrote: > > [...] > > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > > > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss,

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Michal Hocko
On Wed 17-08-16 11:31:25, Jann Horn wrote: > On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: > > On Tue 16-08-16 12:46:51, Robert Foss wrote: > > [...] > > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > > > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss,

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Jann Horn
On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: > On Tue 16-08-16 12:46:51, Robert Foss wrote: > [...] > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss, pss}\' > > /proc/5025/smaps }" > > [...] > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Jann Horn
On Wed, Aug 17, 2016 at 10:22:00AM +0200, Michal Hocko wrote: > On Tue 16-08-16 12:46:51, Robert Foss wrote: > [...] > > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss, pss}\' > > /proc/5025/smaps }" > > [...] > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Michal Hocko
On Tue 16-08-16 12:46:51, Robert Foss wrote: [...] > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss, pss}\' > /proc/5025/smaps }" > [...] > Command being timed: "zsh -c repeat 25 { awk '/^Rss/{rss+=$2} > /^Pss/{pss+=$2}

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-17 Thread Michal Hocko
On Tue 16-08-16 12:46:51, Robert Foss wrote: [...] > $ /usr/bin/time -v -p zsh -c "repeat 25 { awk '/^Rss/{rss+=\$2} > /^Pss/{pss+=\$2} END {printf \"rss:%d pss:%d\n\", rss, pss}\' > /proc/5025/smaps }" > [...] > Command being timed: "zsh -c repeat 25 { awk '/^Rss/{rss+=$2} > /^Pss/{pss+=$2}

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-16 Thread Robert Foss
On 2016-08-16 03:12 AM, Michal Hocko wrote: On Mon 15-08-16 12:25:10, Robert Foss wrote: On 2016-08-15 09:42 AM, Michal Hocko wrote: [...] The use case is to speed up monitoring of memory consumption in environments where RSS isn't precise. For example Chrome tends to many processes

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-16 Thread Robert Foss
On 2016-08-16 03:12 AM, Michal Hocko wrote: On Mon 15-08-16 12:25:10, Robert Foss wrote: On 2016-08-15 09:42 AM, Michal Hocko wrote: [...] The use case is to speed up monitoring of memory consumption in environments where RSS isn't precise. For example Chrome tends to many processes

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-16 Thread Michal Hocko
On Mon 15-08-16 12:25:10, Robert Foss wrote: > > > On 2016-08-15 09:42 AM, Michal Hocko wrote: [...] > > The use case is to speed up monitoring of > > memory consumption in environments where RSS isn't precise. > > > > For example Chrome tends to many processes which have hundreds of VMAs > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-16 Thread Michal Hocko
On Mon 15-08-16 12:25:10, Robert Foss wrote: > > > On 2016-08-15 09:42 AM, Michal Hocko wrote: [...] > > The use case is to speed up monitoring of > > memory consumption in environments where RSS isn't precise. > > > > For example Chrome tends to many processes which have hundreds of VMAs > >

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Robert Foss
On 2016-08-15 09:42 AM, Michal Hocko wrote: On Mon 15-08-16 09:00:04, Robert Foss wrote: On 2016-08-14 05:04 AM, Michal Hocko wrote: On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: From: Robert Foss This series implements /proc/PID/totmaps, a tool

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Robert Foss
On 2016-08-15 09:42 AM, Michal Hocko wrote: On Mon 15-08-16 09:00:04, Robert Foss wrote: On 2016-08-14 05:04 AM, Michal Hocko wrote: On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: From: Robert Foss This series implements /proc/PID/totmaps, a tool for retrieving summarized

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Michal Hocko
On Mon 15-08-16 09:00:04, Robert Foss wrote: > > > On 2016-08-14 05:04 AM, Michal Hocko wrote: > > On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: > > > From: Robert Foss > > > > > > This series implements /proc/PID/totmaps, a tool for retrieving

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Michal Hocko
On Mon 15-08-16 09:00:04, Robert Foss wrote: > > > On 2016-08-14 05:04 AM, Michal Hocko wrote: > > On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: > > > From: Robert Foss > > > > > > This series implements /proc/PID/totmaps, a tool for retrieving summarized > > > information about

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Robert Foss
On 2016-08-14 05:04 AM, Michal Hocko wrote: On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: From: Robert Foss This series implements /proc/PID/totmaps, a tool for retrieving summarized information about the mappings of a process. The changelog is

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-15 Thread Robert Foss
On 2016-08-14 05:04 AM, Michal Hocko wrote: On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: From: Robert Foss This series implements /proc/PID/totmaps, a tool for retrieving summarized information about the mappings of a process. The changelog is absolutely missing the usecase.

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-14 Thread Michal Hocko
On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: > From: Robert Foss > > This series implements /proc/PID/totmaps, a tool for retrieving summarized > information about the mappings of a process. The changelog is absolutely missing the usecase. Why do we need

Re: [PACTH v2 0/3] Implement /proc//totmaps

2016-08-14 Thread Michal Hocko
On Fri 12-08-16 18:04:19, robert.f...@collabora.com wrote: > From: Robert Foss > > This series implements /proc/PID/totmaps, a tool for retrieving summarized > information about the mappings of a process. The changelog is absolutely missing the usecase. Why do we need this? Why existing

[PACTH v2 0/3] Implement /proc//totmaps

2016-08-12 Thread robert . foss
From: Robert Foss This series implements /proc/PID/totmaps, a tool for retrieving summarized information about the mappings of a process. Changes since v1: - Removed IS_ERR check from get_task_mm() function - Changed comment format - Moved proc_totmaps_operations

[PACTH v2 0/3] Implement /proc//totmaps

2016-08-12 Thread robert . foss
From: Robert Foss This series implements /proc/PID/totmaps, a tool for retrieving summarized information about the mappings of a process. Changes since v1: - Removed IS_ERR check from get_task_mm() function - Changed comment format - Moved proc_totmaps_operations declaration inside internal.h -