Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Johannes Weiner
On Thu, Jan 26, 2017 at 10:19:16AM +, Mel Gorman wrote: > On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > > We noticed a performance regression when moving hadoop workloads from > > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > > activity initiated

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Johannes Weiner
On Thu, Jan 26, 2017 at 10:19:16AM +, Mel Gorman wrote: > On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > > We noticed a performance regression when moving hadoop workloads from > > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > > activity initiated

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Mel Gorman
On Thu, Jan 26, 2017 at 03:07:45PM -0500, Johannes Weiner wrote: > On Thu, Jan 26, 2017 at 10:19:16AM +, Mel Gorman wrote: > > On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > > > We noticed a performance regression when moving hadoop workloads from > > > 3.10 kernels to 4.0

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Mel Gorman
On Thu, Jan 26, 2017 at 03:07:45PM -0500, Johannes Weiner wrote: > On Thu, Jan 26, 2017 at 10:19:16AM +, Mel Gorman wrote: > > On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > > > We noticed a performance regression when moving hadoop workloads from > > > 3.10 kernels to 4.0

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Michal Hocko
On Mon 23-01-17 13:16:41, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and direct reclaim

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Michal Hocko
On Mon 23-01-17 13:16:41, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and direct reclaim

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Mel Gorman
On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-26 Thread Mel Gorman
On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-25 Thread Minchan Kim
On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and

Re: [PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-25 Thread Minchan Kim
On Mon, Jan 23, 2017 at 01:16:41PM -0500, Johannes Weiner wrote: > We noticed a performance regression when moving hadoop workloads from > 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout > activity initiated by kswapd as well as frequent bursts of allocation > stalls and

[PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-23 Thread Johannes Weiner
We noticed a performance regression when moving hadoop workloads from 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout activity initiated by kswapd as well as frequent bursts of allocation stalls and direct reclaim scans. Even lowering the dirty ratios to the equivalent of

[PATCH 5/5] mm: vmscan: move dirty pages out of the way until they're flushed

2017-01-23 Thread Johannes Weiner
We noticed a performance regression when moving hadoop workloads from 3.10 kernels to 4.0 and 4.6. This is accompanied by increased pageout activity initiated by kswapd as well as frequent bursts of allocation stalls and direct reclaim scans. Even lowering the dirty ratios to the equivalent of