Re: [Problem] Cache line starvation

2018-10-03 Thread Thomas Gleixner
On Wed, 3 Oct 2018, Peter Zijlstra wrote: > On Wed, Oct 03, 2018 at 10:07:05AM +0200, Thomas Gleixner wrote: > > On Wed, 3 Oct 2018, Catalin Marinas wrote: > > > > > On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > > > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior >

Re: [Problem] Cache line starvation

2018-10-03 Thread Peter Zijlstra
On Wed, Oct 03, 2018 at 10:07:05AM +0200, Thomas Gleixner wrote: > On Wed, 3 Oct 2018, Catalin Marinas wrote: > > > On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > > > We reproducibly observe cache line starv

Re: [Problem] Cache line starvation

2018-10-03 Thread Peter Zijlstra
On Wed, Oct 03, 2018 at 08:51:50AM +0100, Catalin Marinas wrote: > On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > > cores), a i5-6400 S

Re: [Problem] Cache line starvation

2018-10-03 Thread Thomas Gleixner
On Wed, 3 Oct 2018, Catalin Marinas wrote: > On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > > cores), a i5-6400 SKL (4 cores) and on a

Re: [Problem] Cache line starvation

2018-10-03 Thread Catalin Marinas
On Fri, 21 Sep 2018 at 13:22, Peter Zijlstra wrote: > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > > cores). > > > > T

Re: [Problem] Cache line starvation

2018-10-01 Thread Daniel Wagner
On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > This matches Daniel Wagner's observations which he described in [0] on > v4.4-RT. Peter Z recommended to drop to ticket spinlocks instead trying to port back all the qspinlock changes to v4.4-rt. With ticket spinlocks, '

Re: [Problem] Cache line starvation

2018-09-28 Thread Thomas Gleixner
On Fri, 28 Sep 2018, Sebastian Andrzej Siewior wrote: > On 2018-09-27 16:47:47 [+0200], Thomas Gleixner wrote: > > I wonder if it's just the store on the stack which makes it work. I've seen > > that when instrumenting x86. When the careful instrumentation just stayed > > in registers it failed. O

Re: [Problem] Cache line starvation

2018-09-28 Thread Sebastian Andrzej Siewior
On 2018-09-27 16:47:47 [+0200], Thomas Gleixner wrote: > I wonder if it's just the store on the stack which makes it work. I've seen > that when instrumenting x86. When the careful instrumentation just stayed > in registers it failed. Once it was too much and stack got involved it > vanished away.

Re: [Problem] Cache line starvation

2018-09-28 Thread Kurt Kanzenbach
On Fri, Sep 28, 2018 at 11:05:21AM +0200, Kurt Kanzenbach wrote: > Hi Thomas, > > On Thu, Sep 27, 2018 at 04:47:47PM +0200, Thomas Gleixner wrote: > > On Thu, 27 Sep 2018, Kurt Kanzenbach wrote: > > > On Thu, Sep 27, 2018 at 04:25:47PM +0200, Kurt Kanzenbach wrote: > > > > However, the issue still

Re: [Problem] Cache line starvation

2018-09-28 Thread Kurt Kanzenbach
Hi Thomas, On Thu, Sep 27, 2018 at 04:47:47PM +0200, Thomas Gleixner wrote: > On Thu, 27 Sep 2018, Kurt Kanzenbach wrote: > > On Thu, Sep 27, 2018 at 04:25:47PM +0200, Kurt Kanzenbach wrote: > > > However, the issue still triggers fine. With stress-ng we're able to > > > generate latency in millis

Re: [Problem] Cache line starvation

2018-09-27 Thread Thomas Gleixner
On Thu, 27 Sep 2018, Kurt Kanzenbach wrote: > On Thu, Sep 27, 2018 at 04:25:47PM +0200, Kurt Kanzenbach wrote: > > However, the issue still triggers fine. With stress-ng we're able to > > generate latency in millisecond range. The only workaround we've found > > so far is to add a "delay" in cpu_re

Re: [Problem] Cache line starvation

2018-09-27 Thread Kurt Kanzenbach
Hi Will, On Thu, Sep 27, 2018 at 04:25:47PM +0200, Kurt Kanzenbach wrote: > Hi Will, > > On Wed, Sep 26, 2018 at 01:53:02PM +0100, Will Deacon wrote: > > Hi all, > > > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > > We reproducibly observe cache line starvation o

Re: [Problem] Cache line starvation

2018-09-27 Thread Kurt Kanzenbach
Hi Will, On Wed, Sep 26, 2018 at 01:53:02PM +0100, Will Deacon wrote: > Hi all, > > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Corte

Re: [Problem] Cache line starvation

2018-09-26 Thread Will Deacon
Hi all, On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > cores). > > Instrumentation show always the picture: > > CPU0

Re: [Problem] Cache line starvation

2018-09-26 Thread Thomas Gleixner
On Wed, 26 Sep 2018, Peter Zijlstra wrote: > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > Instrumentation show always the picture: > > > > CPU0 CPU1 > > => do_syscall_64 => do_syscall_64 > > => S

Re: [Problem] Cache line starvation

2018-09-26 Thread Peter Zijlstra
On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > Instrumentation show always the picture: > > CPU0 CPU1 > => do_syscall_64 => do_syscall_64 > => SyS_ptrace => syscall_

Re: [Problem] Cache line starvation

2018-09-21 Thread Thomas Gleixner
On Fri, 21 Sep 2018, Peter Zijlstra wrote: > On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > > cores). > > > > The proble

Re: [Problem] Cache line starvation

2018-09-21 Thread Sebastian Andrzej Siewior
On 2018-09-21 14:13:19 [+0200], Thomas Gleixner wrote: > On Fri, 21 Sep 2018, Sebastian Andrzej Siewior wrote: > > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > > cores). > > We tried to reproduce o

Re: [Problem] Cache line starvation

2018-09-21 Thread Peter Zijlstra
On Fri, Sep 21, 2018 at 02:02:26PM +0200, Sebastian Andrzej Siewior wrote: > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > cores). > > The problem can be triggered with a v4.9-RT kernel by starting >

Re: [Problem] Cache line starvation

2018-09-21 Thread Thomas Gleixner
On Fri, 21 Sep 2018, Sebastian Andrzej Siewior wrote: > We reproducibly observe cache line starvation on a Core2Duo E6850 (2 > cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 > cores). We tried to reproduce on AMD, but so far no failure. Thanks, tglx

[Problem] Cache line starvation

2018-09-21 Thread Sebastian Andrzej Siewior
We reproducibly observe cache line starvation on a Core2Duo E6850 (2 cores), a i5-6400 SKL (4 cores) and on a NXP LS2044A ARM Cortex-A72 (4 cores). The problem can be triggered with a v4.9-RT kernel by starting cyclictest -S -p98 -m -i2000 -b 200 and as "load" stress-ng --ptrace 4 The