On Mon, Jul 17, 2023 at 11:14 PM Richard Purdie <[email protected]> wrote: > > [Anuj/Steve/Ross - questions below!] > > I thought I'd share a summary of the recent toolchain test > changes/work. We can see the "baseline" from the 4.2 test report: > > https://downloads.yoctoproject.org/releases/yocto/milestones/yocto-4.2_M3/testresults/testresult-report.txt > > showing that we run 2.9 million tests (2946881) with 174470 failures. > > Once we noticed qemuarm64 toolchain test results were showing ~125,000 > failures and had done since the 3.4 release, Ross was able to find and > fix it: > > https://git.yoctoproject.org/poky/commit/?id=b0f1ab9810d87960d2753b0fe78039b874fd15fd > https://git.yoctoproject.org/poky/commit/?id=af39b83e58ec159a9a13d85067c2595535442566 > > Thanks Ross (even if you did break it too! :) > > I've also merged: > > https://git.yoctoproject.org/poky/commit/?id=c94fd2737e7e341188c8c41d911f1c60240088a2 > > which takes care of many of the qemuppc failures. > > This brings the report down to: > > https://autobuilder.yocto.io/pub/non-release/20230717-18/testresults/testresult-report.txt > > so 3229355 tests and 15496 failures. > > qemuarm has ~350 failures > qemuarm64 has ~350 failures > qemux86-64 has ~4000 (3900 in glibc) > qemux86 has ~4000 (3500 in glibc) > qemuppc has ~600 failures > qemumips64 has ~5000 failures (all over) > qemumips has ~1600 failures > > We could also do with understanding the qemuarm64 ltp syscall failures. > The other ltp failures look the same for x86 and arm. > > Anuj: Can Intel look into the glibc test failures on x86? > Steve: Can we backport those patches to kirkstone/mickledore?
Yes, I've got them in my test queue for both kirkstone/mickledore. Steve > Ross: Can ARM look into the ltp syscall issue? > > Is anyone else interested/able to help in cleaning up these results a > bit further? Once have a good baseline, it will make it much easier to > look for and spot regressions. > > Cheers, > > Richard > > > > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#184535): https://lists.openembedded.org/g/openembedded-core/message/184535 Mute This Topic: https://lists.openembedded.org/mt/100212267/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
