Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/19/15 2:25 AM, Yuyang Du wrote: On Thu, Jun 18, 2015 at 07:48:00PM +0800, Wanpeng Li wrote: cfs_rq[7]:/autogroup-9617 .se->load.weight : 64 (dbench) .se->avg.load_avg : 50 How you figure out this one is dbench? dbench is on CPU7 and running there? Sorry,

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Yuyang Du
On Thu, Jun 18, 2015 at 07:48:00PM +0800, Wanpeng Li wrote: > >>>cfs_rq[7]:/autogroup-9617 > >>>.se->load.weight : 64 (dbench) > >>>.se->avg.load_avg : 50 > >>How you figure out this one is dbench? > >> > >dbench is on CPU7 and running there? > > Sorry, do you mean you

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/18/15 6:46 AM, Yuyang Du wrote: On Thu, Jun 18, 2015 at 02:31:00PM +0800, Wanpeng Li wrote: On 6/17/15 11:11 AM, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Yuyang Du
On Thu, Jun 18, 2015 at 02:31:00PM +0800, Wanpeng Li wrote: > > On 6/17/15 11:11 AM, Yuyang Du wrote: > >Hi, > > > >The sched_debug is informative, lets first give it some analysis. > > > >The workload is 12 CPU hogging tasks (always runnable) and 1 dbench > >task doing fs ops (70% runnable)

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/17/15 11:11 AM, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the same time. Actually, these 13 tasks are in a task group

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/18/15 6:46 AM, Yuyang Du wrote: On Thu, Jun 18, 2015 at 02:31:00PM +0800, Wanpeng Li wrote: On 6/17/15 11:11 AM, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Yuyang Du
On Thu, Jun 18, 2015 at 07:48:00PM +0800, Wanpeng Li wrote: cfs_rq[7]:/autogroup-9617 .se-load.weight : 64 (dbench) .se-avg.load_avg : 50 How you figure out this one is dbench? dbench is on CPU7 and running there? Sorry, do you mean you pin dbench to CPU7?

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/19/15 2:25 AM, Yuyang Du wrote: On Thu, Jun 18, 2015 at 07:48:00PM +0800, Wanpeng Li wrote: cfs_rq[7]:/autogroup-9617 .se-load.weight : 64 (dbench) .se-avg.load_avg : 50 How you figure out this one is dbench? dbench is on CPU7 and running there? Sorry, do

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Wanpeng Li
On 6/17/15 11:11 AM, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the same time. Actually, these 13 tasks are in a task group

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-18 Thread Yuyang Du
On Thu, Jun 18, 2015 at 02:31:00PM +0800, Wanpeng Li wrote: On 6/17/15 11:11 AM, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Yuyang Du
On Wed, Jun 17, 2015 at 09:06:17PM +0800, Boqun Feng wrote: > > > So the problem is: > > > > 1) The tasks in the workload have too small weight (only 79), because > >they share a task group. > > > > 2) Probably some "high" weight task even runnable a small time > >contribute "big" to

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Boqun Feng
Hi Yuyang, On Wed, Jun 17, 2015 at 11:11:01AM +0800, Yuyang Du wrote: > Hi, > > The sched_debug is informative, lets first give it some analysis. > > The workload is 12 CPU hogging tasks (always runnable) and 1 dbench > task doing fs ops (70% runnable) running at the same time. > > Actually,

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Yuyang Du
Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the same time. Actually, these 13 tasks are in a task group /autogroup-9617, which has weight 1024. So the 13

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Yuyang Du
On Wed, Jun 17, 2015 at 09:06:17PM +0800, Boqun Feng wrote: So the problem is: 1) The tasks in the workload have too small weight (only 79), because they share a task group. 2) Probably some high weight task even runnable a small time contribute big to cfs_rq's load_avg.

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Yuyang Du
Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the same time. Actually, these 13 tasks are in a task group /autogroup-9617, which has weight 1024. So the 13

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-17 Thread Boqun Feng
Hi Yuyang, On Wed, Jun 17, 2015 at 11:11:01AM +0800, Yuyang Du wrote: Hi, The sched_debug is informative, lets first give it some analysis. The workload is 12 CPU hogging tasks (always runnable) and 1 dbench task doing fs ops (70% runnable) running at the same time. Actually, these 13

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-16 Thread Boqun Feng
On Wed, Jun 17, 2015 at 11:06:50AM +0800, Boqun Feng wrote: > Hi Yuyang, > > I've run the test as follow on tip/master without and with your > patchset: > > On a 12-core system (Intel(R) Xeon(R) CPU X5690 @ 3.47GHz) > run stress --cpu 12 > run dbench 1 Sorry, I forget to say that `stress --cpu

Re: [Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-16 Thread Boqun Feng
On Wed, Jun 17, 2015 at 11:06:50AM +0800, Boqun Feng wrote: Hi Yuyang, I've run the test as follow on tip/master without and with your patchset: On a 12-core system (Intel(R) Xeon(R) CPU X5690 @ 3.47GHz) run stress --cpu 12 run dbench 1 Sorry, I forget to say that `stress --cpu 12` and

[Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Yuyang Du
Hi Peter and Ingo, Changes are made for the 8th version: 1) Rebase to the latest tip tree 2) scale_load_down the weight when doing the averages 3) change util_sum to u32 Thanks a lot for Ben's comments, which lead to this version. Thanks to Vincent for review. Regards, Yuyang v7 changes: The

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Yuyang Du
Hi Boqun, Thanks for the tests. Indeed I can't find the 8th versio myself in the archive. That is weird. Vincent sure received the patches, but maybe not the list, then that is interesting... Anyway, I will rebase the patches up-to-date, and resend it to the list shortly. Regarding test

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Boqun Feng
Hi Yuyang, We have tested your V7 patchset as follow: On Intel(R) Xeon(R) CPU X5690 (12 cores), run 12 stress and 6 dbench. Results show that usages of some CPUs are less than 50% sometimes. We would like to test your V8 patchset, but I can neither find it in a lkml archive, nor in my lkml

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Boqun Feng
Hi Yuyang, We have tested your V7 patchset as follow: On Intel(R) Xeon(R) CPU X5690 (12 cores), run 12 stress and 6 dbench. Results show that usages of some CPUs are less than 50% sometimes. We would like to test your V8 patchset, but I can neither find it in a lkml archive, nor in my lkml

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Yuyang Du
Hi Boqun, Thanks for the tests. Indeed I can't find the 8th versio myself in the archive. That is weird. Vincent sure received the patches, but maybe not the list, then that is interesting... Anyway, I will rebase the patches up-to-date, and resend it to the list shortly. Regarding test

[Resend PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-15 Thread Yuyang Du
Hi Peter and Ingo, Changes are made for the 8th version: 1) Rebase to the latest tip tree 2) scale_load_down the weight when doing the averages 3) change util_sum to u32 Thanks a lot for Ben's comments, which lead to this version. Thanks to Vincent for review. Regards, Yuyang v7 changes: The

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-09 Thread Yuyang Du
Ping ... Plus some data tested by LKP: To name a few host configurations: host: brickland3 model: Brickland Ivy Bridge-EX nr_cpu: 120 memory: 512G host: lkp-a03 model: Atom memory: 8G host: grantley model: Grantley Haswell-EP memory: 32G host: ivb43 model: Ivytown Ivy Bridge-EP nr_cpu: 48

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-09 Thread Yuyang Du
Ping ... Plus some data tested by LKP: To name a few host configurations: host: brickland3 model: Brickland Ivy Bridge-EX nr_cpu: 120 memory: 512G host: lkp-a03 model: Atom memory: 8G host: grantley model: Grantley Haswell-EP memory: 32G host: ivb43 model: Ivytown Ivy Bridge-EP nr_cpu: 48

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-02 Thread Yuyang Du
Ping once more... On Mon, May 25, 2015 at 09:49:43AM +0800, Yuyang Du wrote: > Hi Peter and Ingo, > > Changes are made for the 8th version: > > 1) Rebase to the latest tip tree > 2) scale_load_down the weight when doing the averages > 3) change util_sum to u32 > > Thanks a lot for Ben's

Re: [PATCH v8 0/4] sched: Rewrite runnable load and utilization average tracking

2015-06-02 Thread Yuyang Du
Ping once more... On Mon, May 25, 2015 at 09:49:43AM +0800, Yuyang Du wrote: Hi Peter and Ingo, Changes are made for the 8th version: 1) Rebase to the latest tip tree 2) scale_load_down the weight when doing the averages 3) change util_sum to u32 Thanks a lot for Ben's comments, which