On Wed, 2023-06-14 at 10:56 +0200, Alexis Lothoré via lists.yoctoproject.org wrote: > From: Alexis Lothoré <[email protected]> > > This series is a follow-up for the 4.3_M1.rc1 regression report issue. > > It has been observed that the report is empty. This issue is linked to > configuration description in yocto-autobuilder-helper, and has been > identified through the following steps: > - empty report is supposed to be a comparison between yocto-4.2 (4.2.rc3) > and 4.3_M1.rc1 > - yocto-4.2 results are almost empty: we only find test results from Intel > QA (pushed _after_ the AB build) and not the AB test results > - tests results are managed by send-qa-email.send-qa-email uses resulttool > to systematically gather and store test results in local git directory > - however, it looks for basebranch/comparebranch to know if those results > can be pushed onto git server, and those variables depend on config.json > content > - yocto-4.2 (4.2.rc3) has been built on release branch mickledore > (https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/5212) > - since mickledore is not yet described in config.json, send-qa-email > considers it as a "work" branch (contrary to a "release" branch) and does > not push test results > > As a consequence: > - first commit brings in python logger > - second commit adds a warning when such case happen, since we are able to > detect it > - third fix actually adds mickledore as a release branch to properly store > again test results > > There must be a more robust rework to do (because the issue will likely > happen on each major delivery), but I aimed for the quick and small fix to > quickly bring back tests results storage without breaking other things in > the process
Thanks, I've merged this as it is a good first set of steps. As I mentioned, I think we should hardcode poky + "not ending with - next" as the test, then we shouldn't run into this issue again. I'd also like to retroactively push the test results for 4.2 since we have them and should be able to merge them onto the branch. I'd then like to see what the revised 4.3 M1 report looks like. Cheers, Richard
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#60309): https://lists.yoctoproject.org/g/yocto/message/60309 Mute This Topic: https://lists.yoctoproject.org/mt/99523809/21656 Group Owner: [email protected] Unsubscribe: https://lists.yoctoproject.org/g/yocto/leave/6691583/21656/737036229/xyzzy [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
