On Tue, 2025-07-29 at 00:49 +0200, Miro Hrončok wrote: > On 28. 07. 25 20:46, Adam Williamson wrote: > > Mass rebuild changes bypass automated testing and gating > > This begs the question: Should we stop doing it that way? > > What if we let all the builds from mass rebuild go trough bodhi? One by one. > Would Bodhi + OpenQA handle the load?
Well, *eventually* it would. There are 1311 packages in the critpath groups that get tested by openQA and that we gate on (the overall number is bigger because we have critpath groups for non-blocking desktops). Probably not *all* of those were in the mass rebuild, so...say it's 1000 or so? The number of tests run on each update varies depending on how many groups it's in, from as few as 4 to as many as 71. Looking at the history, let's say we average about 50 (there are a lot of 4s, but most of those are ELN builds which skews the numbers). So, we'd have about 50,000 tests to run. openQA currently has three x86_64 worker hosts running 60 works each, so we can run 180 tests concurrently. If average test execution time is 10 minutes (that's a rough guess, probably a somewhat low one), we can run six tests per hour per 180 workers, so 1080 tests per hour...so we'd be done in, oh, a couple of days. Of course this is all hand-wavy, but it's probably not *too* wrong? We would then of course have to manually poke through 1000 sets of results for flakes and re-run them. (I suspect there would also be some awkward cases where there are hard- versioned inter-package dependencies produced by some kind of macro which would result in the individual updates failing tests). -- Adam Williamson (he/him/his) Fedora QA Fedora Chat: @adamwill:fedora.im | Mastodon: @ad...@fosstodon.org https://www.happyassassin.net -- _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
