From: Alexis Lothoré <[email protected]> This series is a proposal to bring in an "artifact retriever" to ease debugging when some runtime tests fails. This is a follow-up to the v2 ([1]) and its corresponding RFC ([2]), which in turn is a proposal to address general debugging issues like [3]
The main change is based on Alexander's suggestion to defer ptests artifacts list in core-image-ptest.bb, which as a consequence will automatically filter out succeeding ptests artifacts. For this new revision which now relies on multiconfig, I stumbled upon issues because of PTEST_EXPECT_FAILURE = "1" in core-image-ptest.bb. From my understanding, this is used with unittest.expectFailure to prevent tests suffering from intermittent failures from making general test session fail systematically. To keep this behaviour, a new helper is needed to know about those failing tests which are not accounted. Changes since v2: - add helper to know about any tolerated ptest failure - allow to retrieve ptests artifacts only for failing ptests, by benefiting from the multiconfig feature in ptest images Changes since v1: - remove legacy scp option - put back target stop in 'finally' clause - retrieve artifacts only in nominal target run (ie no exception from ssh/qemu target run) - list artifacts directly in variable instead of using intermediate file - use standard variables in artifacts paths - allow glob patterns in artifacts paths - expand artifacts path on target before tryiong to retrieve them [1] https://lore.kernel.org/openembedded-core/[email protected]/ [2] https://lore.kernel.org/openembedded-core/[email protected]/T/#t [3] https://bugzilla.yoctoproject.org/show_bug.cgi?id=14901 Alexis Lothoré (4): oeqa/core/runner: add helper to know about expected failures oeqa/target/ssh: update options for SCP testimage: implement test artifacts retriever for failing tests core-image-ptest: append ptest directory to artifacts list meta/classes-recipe/testimage.bbclass | 48 ++++++++++++++++++++ meta/lib/oeqa/core/runner.py | 4 ++ meta/lib/oeqa/core/target/ssh.py | 5 +- meta/recipes-core/images/core-image-ptest.bb | 1 + 4 files changed, 57 insertions(+), 1 deletion(-) -- 2.40.1
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#182533): https://lists.openembedded.org/g/openembedded-core/message/182533 Mute This Topic: https://lists.openembedded.org/mt/99423378/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
