On 3/9/23 17:26, Ilya Maximets wrote: > On 3/9/23 17:22, Eelco Chaudron wrote: >> >> >> On 9 Mar 2023, at 15:42, Simon Horman wrote: >> >>> On Wed, Mar 08, 2023 at 04:18:47PM +0100, Eelco Chaudron wrote: >>>> Run "make check-offloads" as part of the GitHub actions tests. >>>> >>>> This test was run 25 times using GitHub actions, and the >>>> failing rerun test cases where excluded. There are quite some >>>> first-run failures, but unfortunately, there is no other >>>> more stable kernel available as a GitHub-hosted runner. >>>> >>>> Did not yet include sanitizers in the run, as it's causing >>>> the test to run too long >30min and there seems to be (timing) >>>> issues with some of the tests. >>>> >>>> Signed-off-by: Eelco Chaudron <[email protected]> >>> >>> Hi Eelco, >>> >>> I like this patch a lot. >>> But I am observing reliability problems when executing the new job. >>> >>> For 5 runs, on each occasion some tests failed the first time. >>> And on 3 of those runs at least one test failed on the recheck, >>> so the job failed. >> >> Damn :) I did 25 runs (I did not check for re-runs), and they were fine. I >> also cleaned up my jobs recently, so I no longer have them. >> >> I can do this again and figure out wich tests are failing. Then analyze the >> failures to see if we need to exclude them or can fine-tune them. >> >> Ilya any other approach you can think off? > > Not really. :/ > GHA is kind of hard to debug. Cirrus has a way to give you a console > access to the running job, but GHA doesn't have that. > > BTW, didn't we fic the force commit test recently? I see it disabled
* fix > in the patch. > >> >> >>> The job is here: >>> https://github.com/horms/ovs/actions/runs/4365805718/jobs/7654575559 >>> >>> And a summary of the checks run for recheck for each job run is as follows. >>> >>> Attempt #1 >>> 85: failed >>> 166: ok >>> >>> Attempt #2 >>> 50: ok >>> 64: failed >>> 86: ok >>> 135: failed >>> >>> Attempt #3 >>> 50: ok >>> >>> Attempt #4 >>> 50: failed >>> >>> Attempt #5 >>> 50: ok >>> 163: ok >>> 169: ok >> > _______________________________________________ dev mailing list [email protected] https://mail.openvswitch.org/mailman/listinfo/ovs-dev
