On Tue, 15 Aug 2023 at 15:59, Kevin Wolf <[email protected]> wrote: > In general I think it makes sense that FAIL means that the test could > run as expected, but we got an unexpected result (i.e. this is likely a > QEMU bug), and SKIP means that the test couldn't meaningfully be > performed on the host system. > > Making more things hard dependencies for the test would mean that it's > harder to miss an instance like this, but it would also make it harder > to run the test suite on a system that doesn't have the dependencies > available (and you might not even have root privileges to install them). > > I think I'd leave things as they are now, but recommend that you > occasionally check the tests reported as "not run" to see if you could > easily provide the thing they would need.
In a utopian world we might have a "make query-test-dependencies" or something that would list all the tools/dependencies/etc that are missing and which tests this will cause to be skipped... -- PMM
