On 8/7/2024 9:10 PM, yfliu2008 wrote:
... if we had "ostest" based smoke testing coverage in our CI, those fake k230 issues can be prevented earlier.
ostest would probably need some work to be useful in this case: ostest would need some kind of standard reporting in each test so that we would know when a test case passed or failed.
Right now, many tests do not report any test results. That is because they run relatively complex, multi-threaded scenarios that are not easy to assess. You have to understand what the test is doing in order to interpret the test output. Such tests would need to report failures in a way that can be captured as a simple PASS or FAIL.