Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2023-06-18 Thread Adam Williamson
On Tue, 2023-06-13 at 08:57 +0200, Petr Pisar wrote: > V Mon, Jun 12, 2023 at 08:29:13AM -0700, Adam Williamson napsal(a): > > On Mon, 2023-06-12 at 12:05 +0200, Petr Pisar wrote: > > > or there must be some one else to do it. > > > > We (QA team) will do this. > > > > > I would expect answers

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2023-06-13 Thread Petr Pisar
V Mon, Jun 12, 2023 at 08:29:13AM -0700, Adam Williamson napsal(a): > On Mon, 2023-06-12 at 12:05 +0200, Petr Pisar wrote: > > or there must be some one else to do it. > > We (QA team) will do this. > > > I would expect answers for these questions to be available in a > > documentation. > >

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2023-06-12 Thread Adam Williamson
On Mon, 2023-06-12 at 12:05 +0200, Petr Pisar wrote: > V Fri, Jun 09, 2023 at 11:38:51AM -0700, Adam Williamson napsal(a): > > On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > > > Hi folks! > > > > > > More significantly, I'd also propose that we turn on gating on openQA > > > results

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2023-06-12 Thread Petr Pisar
V Fri, Jun 09, 2023 at 11:38:51AM -0700, Adam Williamson napsal(a): > On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > > Hi folks! > > > > More significantly, I'd also propose that we turn on gating on openQA > > results for Rawhide updates. This would mean Rawhide updates would be > >

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2023-06-09 Thread Adam Williamson
On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > Hi folks! > > More significantly, I'd also propose that we turn on gating on openQA > results for Rawhide updates. This would mean Rawhide updates would be > held from going 'stable' (and included in the next compose) until the > gating

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-07-28 Thread Adam Williamson
On Thu, 2022-06-09 at 17:05 -0700, Kevin Fenzi wrote: > Big +1 from me... I think this would be great to enable. Update here: as the feedback was broadly positive, today I went ahead and hit the big switch and enabled the *tests* on openQA production. I did not yet enable *gating*. So, you

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-22 Thread Kevin Fenzi
On Wed, Jun 22, 2022 at 06:18:08PM -0700, Adam Williamson wrote: > On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > > Hi folks! > ... > > I think doing this could really help us keep Rawhide solid and avoid > > introducing major compose-breaking bugs, at minimal cost. But it's a > >

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-22 Thread Adam Williamson
On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > Hi folks! ... > I think doing this could really help us keep Rawhide solid and avoid > introducing major compose-breaking bugs, at minimal cost. But it's a > significant change and I wanted to see what folks think. In particular, > if you

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-17 Thread Adam Williamson
On Fri, 2022-06-17 at 19:33 +, Dan Čermák wrote: > Sounds like a great addition Adam! > > Just to double check: if you have not enabled gating, then openQA will not be > run at all? No, the two are separable. We can enable the tests before we turn on gating. Right now, the tests are already

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-17 Thread Dan Čermák
Sounds like a great addition Adam! Just to double check: if you have not enabled gating, then openQA will not be run at all? Cheers, Dan On June 9, 2022 7:48:29 PM UTC, Adam Williamson wrote: >Hi folks! > >We've had openQA testing of updates for stable and branched releases, >and gating

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-13 Thread Zbigniew Jędrzejewski-Szmek
On Thu, Jun 09, 2022 at 05:05:42PM -0700, Kevin Fenzi wrote: > Big +1 from me... I think this would be great to enable. The same, +1 from me. Zbyszek ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-09 Thread Kevin Fenzi
Big +1 from me... I think this would be great to enable. kevin signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-09 Thread Adam Williamson
On Thu, 2022-06-09 at 22:01 +0200, Miro Hrončok wrote: > On 09. 06. 22 21:48, Adam Williamson wrote: > > Hi folks! > > > > ... > > > > So, I'd like to propose that we enable Rawhide update testing on the > > production openQA instance also. This would cause results to appear on > > the Automated

Re: Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-09 Thread Miro Hrončok
On 09. 06. 22 21:48, Adam Williamson wrote: Hi folks! ... So, I'd like to propose that we enable Rawhide update testing on the production openQA instance also. This would cause results to appear on the Automated Tests tab in Bodhi, but they would be only informational (and unless the update

Plan / proposal: enable openQA update testing and potentially gating on Rawhide updates

2022-06-09 Thread Adam Williamson
Hi folks! We've had openQA testing of updates for stable and branched releases, and gating based on those tests, enabled for a while now. I believe this is going quite well, and I think we addressed the issues reported when we first enabled gating - Bodhi's gating status updates work more