Re: Handling NUMA page migration

2013-06-06 Thread Frank Mehnert
On Wednesday 05 June 2013 14:34:00 Mel Gorman wrote: > On Wed, Jun 05, 2013 at 12:35:35PM +0200, Frank Mehnert wrote: > > On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: > > > On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: > > > > > B) 1. allocate memory with alloc_pages() > > >

Re: Handling NUMA page migration

2013-06-06 Thread Frank Mehnert
On Wednesday 05 June 2013 14:34:00 Mel Gorman wrote: On Wed, Jun 05, 2013 at 12:35:35PM +0200, Frank Mehnert wrote: On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: B) 1. allocate memory with alloc_pages() 2.

Re: Handling NUMA page migration

2013-06-05 Thread Mel Gorman
On Wed, Jun 05, 2013 at 12:35:35PM +0200, Frank Mehnert wrote: > On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: > > On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: > > > > B) 1. allocate memory with alloc_pages() > > > > > > > >2. SetPageReserved() > > > >3. vm_mmap() to

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 03:22:32, Frank Mehnert wrote: > On Wednesday 05 June 2013 11:56:30 Michal Hocko wrote: > > On Wed 05-06-13 11:32:15, Frank Mehnert wrote: > > [...] > > > > > Thank you very much for your help. As I said, this problem happens _only_ > > > with NUMA_BALANCING enabled. I understand

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: > On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: > > > B) 1. allocate memory with alloc_pages() > > > > > >2. SetPageReserved() > > >3. vm_mmap() to allocate a userspace mapping > > >4. vm_insert_page() > > >5.

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 11:56:30 Michal Hocko wrote: > On Wed 05-06-13 11:32:15, Frank Mehnert wrote: > [...] > > > Thank you very much for your help. As I said, this problem happens _only_ > > with NUMA_BALANCING enabled. I understand that you treat the VirtualBox > > code as untrusted but the

Re: Handling NUMA page migration

2013-06-05 Thread Mel Gorman
On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: > > B) 1. allocate memory with alloc_pages() > >2. SetPageReserved() > >3. vm_mmap() to allocate a userspace mapping > >4. vm_insert_page() > >5. vm_flags |= (VM_DONTEXPAND | VM_DONTDUMP) > > (resulting flags are

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 11:32:15, Frank Mehnert wrote: [...] > Thank you very much for your help. As I said, this problem happens _only_ > with NUMA_BALANCING enabled. I understand that you treat the VirtualBox > code as untrusted but the reason for the problem is that some assumption > is obviously not

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 11:10:48 Michal Hocko wrote: > On Wed 05-06-13 10:34:13, Frank Mehnert wrote: > > On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: > > > On Tue 04-06-13 23:54:45, Frank Mehnert wrote: > > > > On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > > > > > On Tuesday

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 10:34:13, Frank Mehnert wrote: > On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: > > On Tue 04-06-13 23:54:45, Frank Mehnert wrote: > > > On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > > > > On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > > > > > On Tue

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 10:34:13 Frank Mehnert wrote: > On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: > > On Tue 04-06-13 23:54:45, Frank Mehnert wrote: > > > On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > > > > On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > > > > > On

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: > On Tue 04-06-13 23:54:45, Frank Mehnert wrote: > > On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > > > On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > > > > On Tue 04-06-13 14:14:45, Frank Mehnert wrote: > > > > > On Tuesday

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Tue 04-06-13 23:54:45, Frank Mehnert wrote: > On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > > On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > > > On Tue 04-06-13 14:14:45, Frank Mehnert wrote: > > > > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > > > > This is probably

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Tue 04-06-13 23:54:45, Frank Mehnert wrote: On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13 14:14:45, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: On Tue 04-06-13 23:54:45, Frank Mehnert wrote: On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13 14:14:45, Frank Mehnert wrote: On Tuesday 04 June 2013

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 10:34:13 Frank Mehnert wrote: On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: On Tue 04-06-13 23:54:45, Frank Mehnert wrote: On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 10:34:13, Frank Mehnert wrote: On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: On Tue 04-06-13 23:54:45, Frank Mehnert wrote: On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13 14:14:45,

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 11:10:48 Michal Hocko wrote: On Wed 05-06-13 10:34:13, Frank Mehnert wrote: On Wednesday 05 June 2013 09:54:54 Michal Hocko wrote: On Tue 04-06-13 23:54:45, Frank Mehnert wrote: On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 11:32:15, Frank Mehnert wrote: [...] Thank you very much for your help. As I said, this problem happens _only_ with NUMA_BALANCING enabled. I understand that you treat the VirtualBox code as untrusted but the reason for the problem is that some assumption is obviously not met:

Re: Handling NUMA page migration

2013-06-05 Thread Mel Gorman
On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: B) 1. allocate memory with alloc_pages() 2. SetPageReserved() 3. vm_mmap() to allocate a userspace mapping 4. vm_insert_page() 5. vm_flags |= (VM_DONTEXPAND | VM_DONTDUMP) (resulting flags are VM_MIXEDMAP |

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 11:56:30 Michal Hocko wrote: On Wed 05-06-13 11:32:15, Frank Mehnert wrote: [...] Thank you very much for your help. As I said, this problem happens _only_ with NUMA_BALANCING enabled. I understand that you treat the VirtualBox code as untrusted but the reason

Re: Handling NUMA page migration

2013-06-05 Thread Frank Mehnert
On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: B) 1. allocate memory with alloc_pages() 2. SetPageReserved() 3. vm_mmap() to allocate a userspace mapping 4. vm_insert_page() 5. vm_flags |=

Re: Handling NUMA page migration

2013-06-05 Thread Michal Hocko
On Wed 05-06-13 03:22:32, Frank Mehnert wrote: On Wednesday 05 June 2013 11:56:30 Michal Hocko wrote: On Wed 05-06-13 11:32:15, Frank Mehnert wrote: [...] Thank you very much for your help. As I said, this problem happens _only_ with NUMA_BALANCING enabled. I understand that you

Re: Handling NUMA page migration

2013-06-05 Thread Mel Gorman
On Wed, Jun 05, 2013 at 12:35:35PM +0200, Frank Mehnert wrote: On Wednesday 05 June 2013 12:10:19 Mel Gorman wrote: On Tue, Jun 04, 2013 at 06:58:07AM -0500, Robin Holt wrote: B) 1. allocate memory with alloc_pages() 2. SetPageReserved() 3. vm_mmap() to allocate a

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: > On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > > On Tue 04-06-13 14:14:45, Frank Mehnert wrote: > > > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > > > This is probably more appropriate to be directed at the linux-mm > > > >

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: > On Tue 04-06-13 14:14:45, Frank Mehnert wrote: > > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > > This is probably more appropriate to be directed at the linux-mm > > > mailing list. > > > > > > On Tue, Jun 04, 2013 at 09:22:10AM

Re: Handling NUMA page migration

2013-06-04 Thread Jerome Glisse
On Tue, Jun 4, 2013 at 11:45 AM, Jerome Glisse wrote: > On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: >> On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: >> > This is probably more appropriate to be directed at the linux-mm >> > mailing list. >> > >> > On Tue, Jun 04, 2013 at

Re: Handling NUMA page migration

2013-06-04 Thread Jerome Glisse
On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > This is probably more appropriate to be directed at the linux-mm > > mailing list. > > > > On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: > > > Hi, > > > > > >

Re: Handling NUMA page migration

2013-06-04 Thread Michal Hocko
On Tue 04-06-13 14:14:45, Frank Mehnert wrote: > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > This is probably more appropriate to be directed at the linux-mm > > mailing list. > > > > On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: > > > Hi, > > > > > > our memory

Re: Handling NUMA page migration

2013-06-04 Thread Robin Holt
On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: > On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > > This is probably more appropriate to be directed at the linux-mm > > mailing list. > > > > On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: > > > Hi, > > > > > >

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: > This is probably more appropriate to be directed at the linux-mm > mailing list. > > On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: > > Hi, > > > > our memory management on Linux hosts conflicts with NUMA page migration. > > I

Re: Handling NUMA page migration

2013-06-04 Thread Robin Holt
This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: > Hi, > > our memory management on Linux hosts conflicts with NUMA page migration. > I assume this problem existed for a longer time but Linux 3.8

Re: Handling NUMA page migration

2013-06-04 Thread Robin Holt
This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: Hi, our memory management on Linux hosts conflicts with NUMA page migration. I assume this problem existed for a longer time but Linux 3.8 introduced

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: Hi, our memory management on Linux hosts conflicts with NUMA page migration. I assume this

Re: Handling NUMA page migration

2013-06-04 Thread Robin Holt
On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: Hi, our memory

Re: Handling NUMA page migration

2013-06-04 Thread Michal Hocko
On Tue 04-06-13 14:14:45, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: Hi, our memory management on Linux

Re: Handling NUMA page migration

2013-06-04 Thread Jerome Glisse
On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank Mehnert wrote: Hi, our memory

Re: Handling NUMA page migration

2013-06-04 Thread Jerome Glisse
On Tue, Jun 4, 2013 at 11:45 AM, Jerome Glisse j.gli...@gmail.com wrote: On Tue, Jun 04, 2013 at 02:14:45PM +0200, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13 14:14:45, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list. On Tue, Jun 04, 2013 at 09:22:10AM +0200, Frank

Re: Handling NUMA page migration

2013-06-04 Thread Frank Mehnert
On Tuesday 04 June 2013 20:17:02 Frank Mehnert wrote: On Tuesday 04 June 2013 16:02:30 Michal Hocko wrote: On Tue 04-06-13 14:14:45, Frank Mehnert wrote: On Tuesday 04 June 2013 13:58:07 Robin Holt wrote: This is probably more appropriate to be directed at the linux-mm mailing list.