Hi Mathieu, It's quite interesting we are catching these flaky tests now rather than more re-work later. Tests are expected to fail to some extent for riscv64 ARCH due to slower TCG emulation (growing area). Let's keep testing more on the autobuilder. I have sent a v4 correcting the failures from v3.
Best Regards, Pratik ________________________________________ From: Mathieu Dubois-Briand <[email protected]> Sent: Tuesday, October 20, 2026 9:36 AM To: Pratik Farkase; [email protected] Cc: [email protected] Subject: Re: [OE-core][PATCH v3] libsoup: add ptest support On Fri Oct 16, 2026 at 10:05 AM CEST, Mathieu Dubois-Briand via lists.openembedded.org wrote: > On Wed Oct 14, 2026 at 2:07 PM CEST, Pratik Farkase wrote: >> Build the installed-tests via the meson tests/installed_tests options >> (enabled through a new 'tests' PACKAGECONFIG when ptest is in >> DISTRO_FEATURES) and run them under ptest with >> gnome-desktop-testing-runner. >> >> Tested on qemux86-64 with ptest-runner. >> >> Signed-off-by: Pratik Farkase <[email protected]> >> --- > > Hi Pratik, > > Thanks, it's much better now. Still, I do note some intermittent > failures. > > Failed ptests: > {'libsoup': ['libsoup-3.0/multithread-test.test']} > https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/4725 > > Failed ptests: > {'libsoup': ['libsoup-3.0/http2-test.test']} > https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/26031 > > I believe we can keep it in testing for a bit of time and see which test > fails and how often, then decide if it gets merged or not. But we will > probably need a bit more work in there. > > Thanks, > Mathieu Hi Pratik, So after a few days, here is the situation: {'libsoup': ['libsoup-3.0/multithread-test.test']} 2 occurrences, 1 qemuarm64-musl-ptest, 1 qemuarm64-ptest https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1400 https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/4725 {'libsoup': ['libsoup-3.0/http2-test.test']} 8 occurences, all on qemuriscv64-ptest https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2603 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2614 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2615 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2616 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2618 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2621 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2625 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2626 So I believe this will need a bit more work to make these tests a bit more stable, I'm sorry. Thanks, Mathieu -- Mathieu Dubois-Briand, Bootlin Embedded Linux and Kernel engineering https://bootlin.com
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#248278): https://lists.openembedded.org/g/openembedded-core/message/248278 Mute This Topic: https://lists.openembedded.org/mt/121749206/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
