Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-13 Thread Alex Shi
On 12/13/2012 07:35 PM, Borislav Petkov wrote: > On Thu, Dec 13, 2012 at 11:07:43AM +0800, Alex Shi wrote: now, on the other hand, if you have two threads of a process that share a bunch of data structures, and you'd spread these over 2 sockets, you end up bouncing data between the

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-13 Thread Borislav Petkov
On Thu, Dec 13, 2012 at 11:07:43AM +0800, Alex Shi wrote: > >> now, on the other hand, if you have two threads of a process that > >> share a bunch of data structures, and you'd spread these over 2 > >> sockets, you end up bouncing data between the two sockets a lot, > >> running inefficient -->

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-13 Thread Borislav Petkov
On Thu, Dec 13, 2012 at 11:07:43AM +0800, Alex Shi wrote: now, on the other hand, if you have two threads of a process that share a bunch of data structures, and you'd spread these over 2 sockets, you end up bouncing data between the two sockets a lot, running inefficient -- bad for power.

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-13 Thread Alex Shi
On 12/13/2012 07:35 PM, Borislav Petkov wrote: On Thu, Dec 13, 2012 at 11:07:43AM +0800, Alex Shi wrote: now, on the other hand, if you have two threads of a process that share a bunch of data structures, and you'd spread these over 2 sockets, you end up bouncing data between the two sockets a

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
>> now, on the other hand, if you have two threads of a process that >> share a bunch of data structures, and you'd spread these over 2 >> sockets, you end up bouncing data between the two sockets a lot, >> running inefficient --> bad for power. > > Yeah, that should be addressed by the NUMA

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
On 12/12/2012 10:21 PM, Vincent Guittot wrote: >>> >> If Linux is to continue to work efficiently on heterogeneous >>> >> multi-processing platforms, it needs to provide scheduling mechanisms >>> >> that can be exploited as per the demands of the HW architecture. >> > >> > Linus definitely

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:40:40AM -0800, Arjan van de Ven wrote: > >Let me try to understand what this means: so "performance" above with > >8 threads means that those threads are spread out across more than one > >socket, no? > > > >If so, this would mean that you have a smaller amount of tasks

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Vincent Guittot
On 12 December 2012 14:55, Alex Shi wrote: > > > well... it's not always beneficial to group or to spread out > it depends on cache behavior mostly which is best Let me try to understand what this means: so "performance" above with 8 threads means that those

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
well... it's not always beneficial to group or to spread out it depends on cache behavior mostly which is best >>> >>> >>> Let me try to understand what this means: so "performance" above with >>> 8 threads means that those threads are spread out across more than one >>>

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Amit Kucheria
On Tue, Dec 11, 2012 at 10:10 PM, Arjan van de Ven wrote: > On 12/11/2012 8:13 AM, Borislav Petkov wrote: >> >> On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: >>> >>> On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Amit Kucheria
On Tue, Dec 11, 2012 at 10:10 PM, Arjan van de Ven ar...@linux.intel.com wrote: On 12/11/2012 8:13 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
well... it's not always beneficial to group or to spread out it depends on cache behavior mostly which is best Let me try to understand what this means: so performance above with 8 threads means that those threads are spread out across more than one socket, no? If so, this would mean

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Vincent Guittot
On 12 December 2012 14:55, Alex Shi lkml.a...@gmail.com wrote: well... it's not always beneficial to group or to spread out it depends on cache behavior mostly which is best Let me try to understand what this means: so performance above with 8 threads means that those threads are spread

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:40:40AM -0800, Arjan van de Ven wrote: Let me try to understand what this means: so performance above with 8 threads means that those threads are spread out across more than one socket, no? If so, this would mean that you have a smaller amount of tasks on each

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
On 12/12/2012 10:21 PM, Vincent Guittot wrote: If Linux is to continue to work efficiently on heterogeneous multi-processing platforms, it needs to provide scheduling mechanisms that can be exploited as per the demands of the HW architecture. Linus definitely disagree such ideas. :) So,

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-12 Thread Alex Shi
now, on the other hand, if you have two threads of a process that share a bunch of data structures, and you'd spread these over 2 sockets, you end up bouncing data between the two sockets a lot, running inefficient -- bad for power. Yeah, that should be addressed by the NUMA patches people

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Alex Shi
On 12/12/2012 12:13 AM, Borislav Petkov wrote: > On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: >> On 12/11/2012 7:48 AM, Borislav Petkov wrote: >>> On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree.

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Arjan van de Ven
On 12/11/2012 8:13 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: > On 12/11/2012 7:48 AM, Borislav Petkov wrote: > >On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: > >>Another testing of parallel compress with pigz on Linus' git tree. > >>results show we get much better

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Arjan van de Ven
On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results show we get much better performance/power with powersaving and balance policy: testing command: #pigz -k -c -p$x

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: > Another testing of parallel compress with pigz on Linus' git tree. > results show we get much better performance/power with powersaving and > balance policy: > > testing command: > #pigz -k -c -p$x -r linux* &> /dev/null > > On a NHM

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Alex Shi
On 12/11/2012 08:51 AM, Alex Shi wrote: > On Mon, Dec 10, 2012 at 4:22 PM, Alex Shi wrote: >> This patchset base on tip/sched/core tree temporary, since it is more >> steady than tip/master. and it's easy to rebase on tip/master. >> >> It includes 3 parts changes. >> >> 1, simplified fork, patch

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Alex Shi
On 12/11/2012 08:51 AM, Alex Shi wrote: On Mon, Dec 10, 2012 at 4:22 PM, Alex Shi alex@intel.com wrote: This patchset base on tip/sched/core tree temporary, since it is more steady than tip/master. and it's easy to rebase on tip/master. It includes 3 parts changes. 1, simplified fork,

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results show we get much better performance/power with powersaving and balance policy: testing command: #pigz -k -c -p$x -r linux* /dev/null On a NHM EP box

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Arjan van de Ven
On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results show we get much better performance/power with powersaving and balance policy: testing command: #pigz -k -c -p$x

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Borislav Petkov
On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results show we get much better performance/power with

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Arjan van de Ven
On 12/11/2012 8:13 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-11 Thread Alex Shi
On 12/12/2012 12:13 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:03:01AM -0800, Arjan van de Ven wrote: On 12/11/2012 7:48 AM, Borislav Petkov wrote: On Tue, Dec 11, 2012 at 08:10:20PM +0800, Alex Shi wrote: Another testing of parallel compress with pigz on Linus' git tree. results

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-10 Thread Alex Shi
On Mon, Dec 10, 2012 at 4:22 PM, Alex Shi wrote: > This patchset base on tip/sched/core tree temporary, since it is more > steady than tip/master. and it's easy to rebase on tip/master. > > It includes 3 parts changes. > > 1, simplified fork, patch 1~4, that simplified the fork/exec/wake log in >

[PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-10 Thread Alex Shi
This patchset base on tip/sched/core tree temporary, since it is more steady than tip/master. and it's easy to rebase on tip/master. It includes 3 parts changes. 1, simplified fork, patch 1~4, that simplified the fork/exec/wake log in find_idlest_group and select_task_rq_fair. it can increase

[PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-10 Thread Alex Shi
This patchset base on tip/sched/core tree temporary, since it is more steady than tip/master. and it's easy to rebase on tip/master. It includes 3 parts changes. 1, simplified fork, patch 1~4, that simplified the fork/exec/wake log in find_idlest_group and select_task_rq_fair. it can increase

Re: [PATCH 0/18] sched: simplified fork, enable load average into LB and power awareness scheduling

2012-12-10 Thread Alex Shi
On Mon, Dec 10, 2012 at 4:22 PM, Alex Shi alex@intel.com wrote: This patchset base on tip/sched/core tree temporary, since it is more steady than tip/master. and it's easy to rebase on tip/master. It includes 3 parts changes. 1, simplified fork, patch 1~4, that simplified the