On Wed Mar 4, 2026 at 7:28 PM CET, Mathieu Dubois-Briand wrote: > On Mon Mar 2, 2026 at 11:43 AM CET, Deepesh via lists.openembedded.org > Varatharajan wrote: >> From: Deepesh Varatharajan <[email protected]> >> >> This patch series introduces a test framework to run selftests for >> target builds of Clang, LLVM, and LLD. >> >> v3 changes: >> - llvm_sysroot_preprocess_testsuite function needs be added to >> llvm:class-target not llvm:class-nativesdk. >> >> v2 changes: >> - Enable required CMake flags only when running the testsuite. >> - Ensure default build time and package sizes remain unaffected. >> >> Summary of changes: >> -Patch 1: Disable clang-tools-extra tests, as Clang's CMake cannot >> detect the llvm-bcanalyzer target. >> -Patch 2: Enabled the necessary CMake flags for clang, llvm & lld tests >> when CLANG_ENABLE_TESTSUITE is set to "1". >> -Patch 3: Selftest script for Clang, LLVM, and LLD including exclude list >> -Patch 4: Fix rust build failure by replacing target llvm-config with native >> > > Hi Deepesh, > > Thanks for the new version. > > While it runs correctly on the autobuilder, I'm noting it takes quite a > bit of time to run the tests. I'm not really against merging them, I > just want: > - to make everybody aware of that. > - to confirm with you these are some expected timings. > > Taking some random build in my branch: > > 2026-03-03 21:20:21,805 - oe-selftest - INFO - > clang.LLDSelfTestSystemEmulated.test_lld (subunit.RemotedTestCase) > 2026-03-03 21:20:21,805 - oe-selftest - INFO - ... ok > 2026-03-03 21:20:21,805 - oe-selftest - INFO - 2: 1/1 18/21 (7205.57s) (0 > failed) (clang.LLDSelfTestSystemEmulated.test_lld) > ... > 2026-03-04 00:56:44,671 - oe-selftest - INFO - > clang.ClangSelfTestSystemEmulated.test_clang (subunit.RemotedTestCase) > 2026-03-04 00:56:44,671 - oe-selftest - INFO - ... ok > 2026-03-04 00:56:44,671 - oe-selftest - INFO - 1: 1/1 20/21 (20188.43s) (0 > failed) (clang.ClangSelfTestSystemEmulated.test_clang) > 2026-03-04 01:37:34,036 - oe-selftest - INFO - > clang.LLVMSelfTestSystemEmulated.test_llvm (subunit.RemotedTestCase) > 2026-03-04 01:37:34,036 - oe-selftest - INFO - ... ok > 2026-03-04 01:37:34,036 - oe-selftest - INFO - 3: 1/1 21/21 (22637.80s) (0 > failed) (clang.LLVMSelfTestSystemEmulated.test_llvm) > > https://autobuilder.yoctoproject.org/valkyrie/#/builders/5/builds/3230 > > So first, we only had a few builds so far, maybe we just were a bit > unlucky (looking at the test, I believe sstate will not have any impact > in later builds). Also we already had some quite long tests in there, > but in some builds the test_clang / test_llvm really seems to take a > longer time. > > Thanks, > Mathieu
I'm only realizing now, this series is also linked with this intermitent issue: https://bugzilla.yoctoproject.org/show_bug.cgi?id=16188. We should probably keep it aside for a few days, until we get something better. Thanks, Mathieu -- Mathieu Dubois-Briand, Bootlin Embedded Linux and Kernel engineering https://bootlin.com
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#232447): https://lists.openembedded.org/g/openembedded-core/message/232447 Mute This Topic: https://lists.openembedded.org/mt/118091332/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
