Hi Stephen, Those idle test cases are actually belongs to the outdated testcases inside Testopia, GDC had opened a Bugzilla ticket to remove and replace outdated and duplicated test cases. We are in progress of removing ducplicated test cases, next step is to remove outdated test cases using automated script that utilize testopia python api.
https://bugzilla.yoctoproject.org/show_bug.cgi?id=12435 For testrun# 9206-9212, testopia testcases not 100% completed as there are some outdated testcases that were no longer available in oeqa/selftest testsuite, pending testopia data cleanup. Please let me know if any more question. Thanks, Ee Peng -----Original Message----- From: Jolley, Stephen K Sent: Friday, March 9, 2018 12:48 AM To: Yeoh, Ee Peng <[email protected]>; '[email protected]' <[email protected]>; Purdie, Richard <[email protected]>; Jordan, Robin L <[email protected]>; Zhang, Jessica <[email protected]>; Lock, Joshua G <[email protected]>; Eggleton, Paul <[email protected]> Cc: Sangal, Apoorv <[email protected]> Subject: RE: Resend QA cycle report for 2.4.2 RC2 Why are we showing 62 (2%) of the test cases as Idle. (Not Run). Were they blocked? What happened to them? Thanks, Stephen -----Original Message----- From: Yeoh, Ee Peng Sent: Thursday, March 08, 2018 1:41 AM To: '[email protected]' <[email protected]>; Purdie, Richard <[email protected]>; Jolley, Stephen K <[email protected]>; Jordan, Robin L <[email protected]>; Zhang, Jessica <[email protected]>; Lock, Joshua G <[email protected]>; Eggleton, Paul <[email protected]> Cc: Sangal, Apoorv <[email protected]> Subject: Resend QA cycle report for 2.4.2 RC2 Hello All, Resend the full report for 2.4.2 RC2 with updated information: https://wiki.yoctoproject.org/wiki/WW10_-_2018-03-05-_Full_Test_Cycle_-_2.4.2_rc2 ======= Summary ======== The QA cycle for release 2.4.2 RC2 was completed including the performance test. Team had discovered 3 new bugs (oeselftest.sstatetests.test_sstate_sametune_samesigs failed, x11perf failed on minnowmax and nuc, toaster run again button does not behaved as expected). For testrun# 9206-9212, testopia testcases not 100% completed as there are some outdated testcases that were no longer available in oeqa/selftest testsuite, pending testopia data cleanup. Performance tests were executed for both 2.4.2 RC2 and 2.4.1 RC1 (as regression and benchmark) on these new machines in linux foundation. ======= QA-Hints======== QA shows no major bug. ======= Bugs ======== New Bugs [1] 12587 - [2.4.2 rc2] test_sstate_sametune_samesigs (sstatetests.SStateTests) [2] 12590 - [2.4.2 rc2] No. of Chars/sec For Yocto Image is very Low To that of Ubuntu [3] 12591 - [2.4.2 rc2] Run again button from all builds page must run the specified task ======== Links ========= 1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12587 2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12590 3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12591 Regards Ee Peng -- _______________________________________________ yocto mailing list [email protected] https://lists.yoctoproject.org/listinfo/yocto
