Re: [PATCH 00/31] numa/core patches

2012-11-12 Thread Mel Gorman
On Sat, Nov 10, 2012 at 10:47:41AM +0800, Alex Shi wrote: > On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman wrote: > > On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: > >> > > >> > In reality, this report is larger but I chopped it down a bit for > >> > brevity. autonuma beats schednuma

Re: [PATCH 00/31] numa/core patches

2012-11-12 Thread Mel Gorman
On Sat, Nov 10, 2012 at 10:47:41AM +0800, Alex Shi wrote: On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman mgor...@suse.de wrote: On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: In reality, this report is larger but I chopped it down a bit for brevity. autonuma beats schednuma

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Alex Shi
On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman wrote: > On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: >> > >> > In reality, this report is larger but I chopped it down a bit for >> > brevity. autonuma beats schednuma *heavily* on this benchmark both in >> > terms of average operations per

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Rik van Riel
On 10/30/2012 08:20 AM, Mel Gorman wrote: On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: Hi all, Here's a re-post of the NUMA scheduling and migration improvement patches that we are working on. These include techniques from AutoNUMA and the sched/numa tree and form a unified

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Rik van Riel
On 10/30/2012 08:20 AM, Mel Gorman wrote: On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: Hi all, Here's a re-post of the NUMA scheduling and migration improvement patches that we are working on. These include techniques from AutoNUMA and the sched/numa tree and form a unified

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Alex Shi
On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman mgor...@suse.de wrote: On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: In reality, this report is larger but I chopped it down a bit for brevity. autonuma beats schednuma *heavily* on this benchmark both in terms of average operations

Re: [PATCH 00/31] numa/core patches

2012-11-05 Thread Srikar Dronamraju
Hey Peter, Here are results on 2node and 8node machine while running the autonuma benchmark. On 2 node, 12 core 24GB KernelVersion:

Re: [PATCH 00/31] numa/core patches

2012-11-05 Thread Srikar Dronamraju
Hey Peter, Here are results on 2node and 8node machine while running the autonuma benchmark. On 2 node, 12 core 24GB KernelVersion:

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Mel Gorman
On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: > > > > In reality, this report is larger but I chopped it down a bit for > > brevity. autonuma beats schednuma *heavily* on this benchmark both in > > terms of average operations per numa node and overall throughput. > > > > SPECJBB PEAKS

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Alex Shi
> > In reality, this report is larger but I chopped it down a bit for > brevity. autonuma beats schednuma *heavily* on this benchmark both in > terms of average operations per numa node and overall throughput. > > SPECJBB PEAKS >3.7.0

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Alex Shi
In reality, this report is larger but I chopped it down a bit for brevity. autonuma beats schednuma *heavily* on this benchmark both in terms of average operations per numa node and overall throughput. SPECJBB PEAKS 3.7.0 3.7.0

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Mel Gorman
On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: In reality, this report is larger but I chopped it down a bit for brevity. autonuma beats schednuma *heavily* on this benchmark both in terms of average operations per numa node and overall throughput. SPECJBB PEAKS

Re: [PATCH 00/31] numa/core patches

2012-11-02 Thread Hugh Dickins
On Fri, 2 Nov 2012, Zhouping Liu wrote: > On 11/01/2012 09:41 PM, Hugh Dickins wrote: > > > > Here's a patch fixing and tidying up that and a few other things there. > > But I'm not signing it off yet, partly because I've barely tested it > > (quite probably I didn't even have any numa pmd

Re: [PATCH 00/31] numa/core patches

2012-11-02 Thread Hugh Dickins
On Fri, 2 Nov 2012, Zhouping Liu wrote: On 11/01/2012 09:41 PM, Hugh Dickins wrote: Here's a patch fixing and tidying up that and a few other things there. But I'm not signing it off yet, partly because I've barely tested it (quite probably I didn't even have any numa pmd migration

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Zhouping Liu
On 11/01/2012 09:41 PM, Hugh Dickins wrote: On Wed, 31 Oct 2012, Hugh Dickins wrote: On Wed, 31 Oct 2012, Zhouping Liu wrote: On 10/31/2012 03:26 PM, Hugh Dickins wrote: There's quite a few put_page()s in do_huge_pmd_numa_page(), and it would help if we could focus on the one which is giving

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Hugh Dickins
On Wed, 31 Oct 2012, Hugh Dickins wrote: > On Wed, 31 Oct 2012, Zhouping Liu wrote: > > On 10/31/2012 03:26 PM, Hugh Dickins wrote: > > > > > > There's quite a few put_page()s in do_huge_pmd_numa_page(), and it > > > would help if we could focus on the one which is giving the trouble, > > > but I

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Hugh Dickins
On Wed, 31 Oct 2012, Hugh Dickins wrote: On Wed, 31 Oct 2012, Zhouping Liu wrote: On 10/31/2012 03:26 PM, Hugh Dickins wrote: There's quite a few put_page()s in do_huge_pmd_numa_page(), and it would help if we could focus on the one which is giving the trouble, but I don't know

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Zhouping Liu
On 11/01/2012 09:41 PM, Hugh Dickins wrote: On Wed, 31 Oct 2012, Hugh Dickins wrote: On Wed, 31 Oct 2012, Zhouping Liu wrote: On 10/31/2012 03:26 PM, Hugh Dickins wrote: There's quite a few put_page()s in do_huge_pmd_numa_page(), and it would help if we could focus on the one which is giving

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Wed, 31 Oct 2012, Zhouping Liu wrote: > On 10/31/2012 03:26 PM, Hugh Dickins wrote: > > > > There's quite a few put_page()s in do_huge_pmd_numa_page(), and it > > would help if we could focus on the one which is giving the trouble, > > but I don't know which that is. Zhouping, if you can,

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Zhouping Liu
On 10/31/2012 03:26 PM, Hugh Dickins wrote: On Tue, 30 Oct 2012, Johannes Weiner wrote: [88099.923724] [ cut here ] [88099.924036] kernel BUG at mm/memcontrol.c:1134! [88099.924036] invalid opcode: [#1] SMP [88099.924036] Modules linked in: lockd sunrpc kvm_amd kvm

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Tue, 30 Oct 2012, Johannes Weiner wrote: > On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: > > On 10/29/2012 01:56 AM, Johannes Weiner wrote: > > >On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > >>>[

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Tue, 30 Oct 2012, Johannes Weiner wrote: On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591]

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Zhouping Liu
On 10/31/2012 03:26 PM, Hugh Dickins wrote: On Tue, 30 Oct 2012, Johannes Weiner wrote: [88099.923724] [ cut here ] [88099.924036] kernel BUG at mm/memcontrol.c:1134! [88099.924036] invalid opcode: [#1] SMP [88099.924036] Modules linked in: lockd sunrpc kvm_amd kvm

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Wed, 31 Oct 2012, Zhouping Liu wrote: On 10/31/2012 03:26 PM, Hugh Dickins wrote: There's quite a few put_page()s in do_huge_pmd_numa_page(), and it would help if we could focus on the one which is giving the trouble, but I don't know which that is. Zhouping, if you can, please would

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Johannes Weiner
On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: > On 10/29/2012 01:56 AM, Johannes Weiner wrote: > >On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > >>>[ 180.918591] RIP: 0010:[] [] >

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Tue, Oct 30, 2012 at 08:28:10AM -0700, Andrew Morton wrote: > > On Tue, 30 Oct 2012 12:20:32 + Mel Gorman wrote: > > > ... > > Useful testing - thanks. Did I miss the description of what > autonumabench actually does? How representitive is it of real-world > things? > It's not

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Andrew Morton
On Tue, 30 Oct 2012 12:20:32 + Mel Gorman wrote: > ... Useful testing - thanks. Did I miss the description of what autonumabench actually does? How representitive is it of real-world things? > I also expect autonuma is continually scanning where as schednuma is > reacting to some other

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: > Hi all, > > Here's a re-post of the NUMA scheduling and migration improvement > patches that we are working on. These include techniques from > AutoNUMA and the sched/numa tree and form a unified basis - it > has got all the bits

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450]

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: Hi all, Here's a re-post of the NUMA scheduling and migration improvement patches that we are working on. These include techniques from AutoNUMA and the sched/numa tree and form a unified basis - it has got all the bits that

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Andrew Morton
On Tue, 30 Oct 2012 12:20:32 + Mel Gorman mgor...@suse.de wrote: ... Useful testing - thanks. Did I miss the description of what autonumabench actually does? How representitive is it of real-world things? I also expect autonuma is continually scanning where as schednuma is reacting to

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Tue, Oct 30, 2012 at 08:28:10AM -0700, Andrew Morton wrote: On Tue, 30 Oct 2012 12:20:32 + Mel Gorman mgor...@suse.de wrote: ... Useful testing - thanks. Did I miss the description of what autonumabench actually does? How representitive is it of real-world things? It's not

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Johannes Weiner
On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a]

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Johannes Weiner
On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > [ 180.918591] RIP: 0010:[] [] > > mem_cgroup_prepare_migration+0xba/0xd0 > > > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > > [ 182.775090] []

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Johannes Weiner
On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [81183b60]

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450]

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Zhouping Liu wrote: > On 10/26/2012 05:20 PM, Ingo Molnar wrote: > >* Peter Zijlstra wrote: > > > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > >>>[ 180.918591] RIP: 0010:[] [] > >>>mem_cgroup_prepare_migration+0xba/0xd0 > >>>[ 182.681450] []

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 182.775090] []

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 182.775090] []

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Peter Zijlstra wrote: > On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > [ 180.918591] RIP: 0010:[] [] > > mem_cgroup_prepare_migration+0xba/0xd0 > > > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > > [ 182.775090] [] handle_mm_fault+0x1e9/0x360 > > [ 182.863038] []

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Peter Zijlstra
On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > [ 180.918591] RIP: 0010:[] [] > mem_cgroup_prepare_migration+0xba/0xd0 > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > [ 182.775090] [] handle_mm_fault+0x1e9/0x360 > [ 182.863038] [] __do_page_fault+0x172/0x4e0 > [

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Peter Zijlstra
On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [81183b60] do_huge_pmd_numa_page+0x180/0x500 [ 182.775090] [811585c9] handle_mm_fault+0x1e9/0x360 [

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Peter Zijlstra a.p.zijls...@chello.nl wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [81183b60] do_huge_pmd_numa_page+0x180/0x500 [

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra a.p.zijls...@chello.nl wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [81183b60]

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra a.p.zijls...@chello.nl wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [81183b60]

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Zhouping Liu z...@redhat.com wrote: On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra a.p.zijls...@chello.nl wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[8118c39a] [8118c39a] mem_cgroup_prepare_migration+0xba/0xd0 [