Hi Richard,

The AB is actually running 'all' tests.

The '--skip-tests (-R)' option means 'Run all (unhidden) tests except the ones 
specified.', according to its help message. This is also its actual effect for 
now. You can see there's an implicit 'run all tests' meaning in this option.
The '-T (--exclude-tag)' options means 'Exclude all (unhidden) tests that match 
any of the specified tag(s)', according to its help message.

So the AB's oe-selftest command means: execute all tests except the ones tagged 
with 'machine' and 'toolchain-user', and also skip  
'distrodata.Distrodata.test_checkpkg 
buildoptions.SourceMirroring.test_yocto_source_mirror reproducible'.

Regards,
Qi

-----Original Message-----
From: Richard Purdie <[email protected]> 
Sent: Thursday, November 24, 2022 9:47 PM
To: [email protected]; Chen, Qi <[email protected]>
Cc: [email protected]
Subject: Re: [OE-core][PATCH] selftest: allow '-R' and '-r' be used together

On Thu, 2022-11-24 at 14:35 +0100, Alexandre Belloni via lists.openembedded.org 
wrote:
> On 24/11/2022 13:10:51+0000, Chen Qi wrote:
> > Hi Alexandre,
> > 
> > The command line is: oe-selftest --skip-tests 
> > distrodata.Distrodata.test_checkpkg 
> > buildoptions.SourceMirroring.test_yocto_source_mirror reproducible 
> > -T machine -T toolchain-user -T toolchain-system -j 15
> > 
> > The '--skip-tests' option is the long format of '-R'.
> > 
> 
> Right, sorry about that :) I actually checked we didn't have any -R 
> before sending the patch to the AB... I'll discuss that with RP.

The autobuilder is not running "all" tests though, it is running two groups of 
tests, -T machine and -T toolchain-user. Adding -a here doesn't really make 
sense.

Cheers,

Richard
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#173760): 
https://lists.openembedded.org/g/openembedded-core/message/173760
Mute This Topic: https://lists.openembedded.org/mt/95231396/21656
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to