Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-27 Thread Kinsey Moore
On 8/27/2021 19:01, Chris Johns wrote: On 27/8/21 9:36 am, Kinsey Moore wrote: Since I'm working on SMP and I've had some of those tests failing sporadically as well, I took a dive into smpschededf01.exe on AArch64 and the issue that particular test seems to be encountering is a mismatch betwee

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-27 Thread Chris Johns
On 27/8/21 9:36 am, Kinsey Moore wrote: > On 8/20/2021 22:06, Chris Johns wrote: >> On 21/8/21 2:38 am, Kinsey Moore wrote: >>> On 8/19/2021 18:03, Chris Johns wrote: >>> My comment in that regard was that other system >>> loading (or multiple simultaneous test runs) can also cause the same problem

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-26 Thread Kinsey Moore
On 8/20/2021 22:06, Chris Johns wrote: On 21/8/21 2:38 am, Kinsey Moore wrote: On 8/19/2021 18:03, Chris Johns wrote: On 20/8/21 4:55 am, Kinsey Moore wrote: On 8/19/2021 13:32, Gedare Bloom wrote: On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore wrote: I've seen these failures on my local sys

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-20 Thread Chris Johns
On 21/8/21 2:38 am, Kinsey Moore wrote: > On 8/19/2021 18:03, Chris Johns wrote: >> On 20/8/21 4:55 am, Kinsey Moore wrote: >>> On 8/19/2021 13:32, Gedare Bloom wrote: On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore wrote: > I've seen these failures on my local system, in our CI, and

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-20 Thread Kinsey Moore
On 8/19/2021 18:03, Chris Johns wrote: On 20/8/21 4:55 am, Kinsey Moore wrote: On 8/19/2021 13:32, Gedare Bloom wrote: On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore wrote: I've seen these failures on my local system, in our CI, and on a build server that I sometimes use for development/testi

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Chris Johns
On 20/8/21 4:55 am, Kinsey Moore wrote: > On 8/19/2021 13:32, Gedare Bloom wrote: >> On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore >> wrote: >>> I've seen these failures on my local system, in our CI, and on a build >>> server that I sometimes >>> use for development/testing so if it's a configur

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Chris Johns
On 20/8/21 2:58 am, Gedare Bloom wrote: > I know I OK'd looking at the versal, but on second thought, I'd rather > leave the xilinx-versal/tstqemu.yml alone until the BSP is finished, > so revert that part of your patch. Sorry about that. Agreed, please leave the Versal as is. Chris _

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Kinsey Moore
On 8/19/2021 13:32, Gedare Bloom wrote: On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore wrote: I've seen these failures on my local system, in our CI, and on a build server that I sometimes use for development/testing so if it's a configuration issue we're being pretty consistent about misconfigu

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Gedare Bloom
On Thu, Aug 19, 2021 at 11:43 AM Kinsey Moore wrote: > > I've seen these failures on my local system, in our CI, and on a build > server that I sometimes > use for development/testing so if it's a configuration issue we're being > pretty consistent about > misconfiguration across some pretty diffe

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Kinsey Moore
I've seen these failures on my local system, in our CI, and on a build server that I sometimes use for development/testing so if it's a configuration issue we're being pretty consistent about misconfiguration across some pretty different environments (docker, bare-metal, VM, different OSs, diffe

Re: [PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Gedare Bloom
Can you explain the process for generating the lists of indeterminate test results? I hate to circle this subject so many times, but is labeling sporadic simulator failures as indeterminate results really the right thing to do? Are these indeterminate tests reproducible on different systems/qemus/

[PATCH] aarch64: Add tests that are failing intermittently

2021-08-19 Thread Ryan Long
- Change status of all spintrcritical tests to indeterminate, expanded upon comments. - Add indeterminate tests to xilinx-versal --- spec/build/bsps/aarch64/a53/tsta53.yml| 40 ++--- spec/build/bsps/aarch64/xilinx-versal/tstqemu.yml | 54 ++- spec/buil