RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-09 Thread Song Bao Hua (Barry Song)
han Cameron > ; > > > Ingo Molnar ; Peter Zijlstra ; > > > Juri > > > Lelli ; Dietmar Eggemann > ; > > > Steven Rostedt ; Ben Segall ; Mel > > > Gorman ; Mark Rutland ; LAK > > > ; linux-kernel > > > ; ACPI Devel Ma

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-07 Thread Vincent Guittot
> Gorman ; Mark Rutland ; LAK > > ; linux-kernel > > ; ACPI Devel Maling List > > ; Linuxarm ; xuwei (O) > > ; Zengtao (B) > > Subject: Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters > > > > On Thu, 3 Dec 2020 at 10:11, Song Bao Hua (Barr

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-07 Thread Song Bao Hua (Barry Song)
han Cameron > ; > > > Ingo Molnar ; Peter Zijlstra ; > > > Juri > > > Lelli ; Dietmar Eggemann > ; > > > Steven Rostedt ; Ben Segall ; Mel > > > Gorman ; Mark Rutland ; LAK > > > ; linux-kernel > > > ; ACPI Devel Ma

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Peter Zijlstra
On Thu, Dec 03, 2020 at 09:57:09AM +, Song Bao Hua (Barry Song) wrote: > Would you point out the link of your previous patches? https://lkml.kernel.org/r/20180530142236.667774...@infradead.org

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Song Bao Hua (Barry Song)
l.org; linux-a...@vger.kernel.org; Linuxarm > ; xuwei (O) ; Zengtao (B) > > Subject: Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters > > On Tue, Dec 01, 2020 at 04:04:04PM +, Valentin Schneider wrote: > > > > Gating this behind this new config on

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Vincent Guittot
gt; > > ; > > > Ingo Molnar ; Peter Zijlstra ; > > > Juri > > > Lelli ; Dietmar Eggemann > > > ; > > > Steven Rostedt ; Ben Segall ; Mel > > > Gorman ; Mark Rutland ; LAK > > > ; linux-kernel > > > ; ACPI Devel Maling List

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Mel Gorman
On Thu, Dec 03, 2020 at 10:28:31AM +0100, Peter Zijlstra wrote: > On Tue, Dec 01, 2020 at 04:04:04PM +, Valentin Schneider wrote: > > > > Gating this behind this new config only leveraged by arm64 doesn't make it > > very generic. Note that powerpc also has this newish "CACHE" level which > >

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Vincent Guittot
> Gorman ; Mark Rutland ; LAK > > ; linux-kernel > > ; ACPI Devel Maling List > > ; Linuxarm ; xuwei (O) > > ; Zengtao (B) > > Subject: Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters > > > > On Wed, 2 Dec 2020 at 21:58, Song Bao Hua (Barry

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Peter Zijlstra
On Tue, Dec 01, 2020 at 04:04:04PM +, Valentin Schneider wrote: > > Gating this behind this new config only leveraged by arm64 doesn't make it > very generic. Note that powerpc also has this newish "CACHE" level which > seems to overlap in function with your "CLUSTER" one (both are arch >

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Song Bao Hua (Barry Song)
e...@linuxfoundation.org; Jonathan Cameron ; > Ingo Molnar ; Peter Zijlstra ; Juri > Lelli ; Dietmar Eggemann ; > Steven Rostedt ; Ben Segall ; Mel > Gorman ; Mark Rutland ; LAK > ; linux-kernel > ; ACPI Devel Maling List > ; Linuxarm ; xuwei (O) > ; Zengtao (B) > Subje

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-03 Thread Vincent Guittot
On Wed, 2 Dec 2020 at 21:58, Song Bao Hua (Barry Song) wrote: > > > > > Sorry. Please ignore this. I added some printk here while testing > > one numa. Will update you the data in another email. > > Re-tested in one NUMA node(cpu0-cpu23): > > g=1 > Running in threaded mode with 1 groups using 40

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Song Bao Hua (Barry Song)
> > Sorry. Please ignore this. I added some printk here while testing > one numa. Will update you the data in another email. Re-tested in one NUMA node(cpu0-cpu23): g=1 Running in threaded mode with 1 groups using 40 file descriptors Each sender will pass 10 messages of 100 bytes w/o: 7.689

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Song Bao Hua (Barry Song)
Cameron ; > Ingo Molnar ; Peter Zijlstra ; Juri > Lelli ; Dietmar Eggemann ; > Steven Rostedt ; Ben Segall ; Mel > Gorman ; Mark Rutland ; LAK > ; linux-kernel > ; ACPI Devel Maling List > ; Linuxarm ; xuwei (O) > ; Zengtao (B) > Subject: RE: [RFC PATCH

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Song Bao Hua (Barry Song)
han Cameron > ; > > > Ingo Molnar ; Peter Zijlstra ; > > > Juri > > > Lelli ; Dietmar Eggemann > ; > > > Steven Rostedt ; Ben Segall ; Mel > > > Gorman ; Mark Rutland ; LAK > > > ; linux-kernel > > > ; ACPI Devel Maling List > &

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Vincent Guittot
> Gorman ; Mark Rutland ; LAK > > ; linux-kernel > > ; ACPI Devel Maling List > > ; Linuxarm ; xuwei (O) > > ; Zengtao (B) > > Subject: Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters > > > > On Tue, 1 Dec 2020 at 04:04, Barry Song wrote:

RE: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Song Bao Hua (Barry Song)
e...@linuxfoundation.org; Jonathan Cameron ; > Ingo Molnar ; Peter Zijlstra ; Juri > Lelli ; Dietmar Eggemann ; > Steven Rostedt ; Ben Segall ; Mel > Gorman ; Mark Rutland ; LAK > ; linux-kernel > ; ACPI Devel Maling List > ; Linuxarm ; xuwei (O) > ; Zengtao (B) > Subje

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-02 Thread Vincent Guittot
On Tue, 1 Dec 2020 at 04:04, Barry Song wrote: > > ARM64 server chip Kunpeng 920 has 6 clusters in each NUMA node, and each > cluster has 4 cpus. All clusters share L3 cache data, but each cluster > has local L3 tag. On the other hand, each clusters will share some > internal system bus. This

Re: [RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-12-01 Thread Valentin Schneider
On 01/12/20 02:59, Barry Song wrote: > diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c > index 1a68a05..ae8ec910 100644 > --- a/kernel/sched/fair.c > +++ b/kernel/sched/fair.c > @@ -6106,6 +6106,37 @@ static inline int select_idle_smt(struct task_struct > *p, int target) > > #endif /*

[RFC PATCH v2 2/2] scheduler: add scheduler level for clusters

2020-11-30 Thread Barry Song
ARM64 server chip Kunpeng 920 has 6 clusters in each NUMA node, and each cluster has 4 cpus. All clusters share L3 cache data, but each cluster has local L3 tag. On the other hand, each clusters will share some internal system bus. This means cache coherence overhead inside one cluster is much