Re: What to do when test gating in bodhi fails (no test results found)?

2018-05-09 Thread Michael Cronenworth
On 05/09/2018 10:16 AM, Randy Barlow wrote: I deployed bodhi-3.7.0[0] to production today. It has some improvements in the test gating area, though unfortunately not all the goals have been met. I wrote a bit more about it in this FESCo ticket: https://pagure.io/fesco/issue/1872#comment-511227

Re: What to do when test gating in bodhi fails (no test results found)?

2018-05-09 Thread Randy Barlow
I deployed bodhi-3.7.0[0] to production today. It has some improvements in the test gating area, though unfortunately not all the goals have been met. I wrote a bit more about it in this FESCo ticket: https://pagure.io/fesco/issue/1872#comment-511227 [0] https://bodhi.fedoraproject.org/docs/user

Re: What to do when test gating in bodhi fails (no test results found)?

2018-04-04 Thread Michael Cronenworth
On 04/04/2018 10:39 AM, Randy Barlow wrote: Infra is still in a freeze (we will probably lift it sometime today). I can't personally take care of the ticket because I don't have access to create the necessary token. I also suspect the admins will be too busy to do this this week, because they are

Re: What to do when test gating in bodhi fails (no test results found)?

2018-04-04 Thread Randy Barlow
On 04/04/2018 09:15 AM, Michael Cronenworth wrote: > It is now Wednesday. Could this be implemented now? Infra is still in a freeze (we will probably lift it sometime today). I can't personally take care of the ticket because I don't have access to create the necessary token. I also suspect the ad

Re: What to do when test gating in bodhi fails (no test results found)?

2018-04-04 Thread Michael Cronenworth
On 04/02/2018 10:25 AM, Randy Barlow wrote: I don't know if there is a way to know this right now, other than waiting up to 6 hours. Bodhi does actually have a UI to submit waivers (to avoid the CLI and the confusing data hunting), but it needs an auth token configured to allow it to talk to wai

Re: What to do when test gating in bodhi fails (no test results found)?

2018-04-02 Thread Randy Barlow
On 04/01/2018 11:29 PM, Parag Nemade wrote: > Now exactly after 12 hrs I logged into bodhi and can see that link to > push to stable. Is there any delay in getting that link? If so why is > this much delay? The Bodhi integration with Greenwave is not complete, but is kind of a "bare minimum" imple

Re: What to do when test gating in bodhi fails (no test results found)?

2018-04-01 Thread Parag Nemade
Hi, On Wed, Mar 21, 2018 at 6:12 PM, Fabio Valentini wrote: > On Wed, Mar 21, 2018 at 11:28 AM, Pierre-Yves Chibon > wrote: >> On Mon, Mar 19, 2018 at 03:57:19PM +0100, Pierre-Yves Chibon wrote: >>> waiverdb-cli should now support waiving missing results, I'm double-checking it >>> and see if we

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-21 Thread Fabio Valentini
On Wed, Mar 21, 2018 at 11:28 AM, Pierre-Yves Chibon wrote: > On Mon, Mar 19, 2018 at 03:57:19PM +0100, Pierre-Yves Chibon wrote: >> waiverdb-cli should now support waiving missing results, I'm double-checking >> it >> and see if we can document it at: >> https://fedoraproject.org/wiki/Package_up

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-21 Thread Pierre-Yves Chibon
On Mon, Mar 19, 2018 at 03:57:19PM +0100, Pierre-Yves Chibon wrote: > waiverdb-cli should now support waiving missing results, I'm double-checking > it > and see if we can document it at: > https://fedoraproject.org/wiki/Package_update_HOWTO#Handling_feedback_from_automated_tests > next to the oth

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Adam Williamson
On Tue, 2018-03-20 at 10:09 +0100, Dan Horák wrote: > All the tests can be green if the "important" ones are missing, they > > don't show :( > > I suspect the problem of missing tests is that dist.rpmdeplint is > run on x86_64 only, but my update is for s390x only. So bodhi shouldn't > rely on a r

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Randy Barlow
On 03/20/2018 10:18 AM, Ralph Bean wrote: > FWIW, greenwave does supply the list of missing and/or failed testcase > names in its API response back to Bodhi. Surfacing those more > granular details in the Bodhi UI would be good. I filed an issue about this: https://github.com/fedora-infra/bodhi/

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Ralph Bean
On Mon, Mar 19, 2018 at 12:23:49PM -0700, Adam Williamson wrote: > On Mon, 2018-03-19 at 15:57 +0100, Pierre-Yves Chibon wrote: > > On Mon, Mar 19, 2018 at 03:41:15PM +0100, Dan Horák wrote: > > > On Mon, 19 Mar 2018 14:06:56 +0100 > > > Dan Horák wrote: > > > > > > > On Sun, 18 Mar 2018 20:25:31

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Dan Horák
On Tue, 20 Mar 2018 08:22:32 -0500 Richard Shaw wrote: > On Mon, Mar 19, 2018 at 9:57 AM, Pierre-Yves Chibon > wrote: > > > The important ones are the ones defined in the policy that gates > > packages and > > are listed here: https://fedoraproject.org/wiki/CI/gating_updates > > > > waiverdb-cl

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Richard Shaw
On Mon, Mar 19, 2018 at 9:57 AM, Pierre-Yves Chibon wrote: > The important ones are the ones defined in the policy that gates packages > and > are listed here: https://fedoraproject.org/wiki/CI/gating_updates > > waiverdb-cli should now support waiving missing results, I'm > double-checking it >

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-20 Thread Dan Horák
On Mon, 19 Mar 2018 15:57:19 +0100 Pierre-Yves Chibon wrote: > On Mon, Mar 19, 2018 at 03:41:15PM +0100, Dan Horák wrote: > > On Mon, 19 Mar 2018 14:06:56 +0100 > > Dan Horák wrote: > > > > > On Sun, 18 Mar 2018 20:25:31 +0100 > > > Fabio Valentini wrote: > > > > > > > On Sun, Mar 18, 2018 at

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-19 Thread Adam Williamson
On Mon, 2018-03-19 at 15:57 +0100, Pierre-Yves Chibon wrote: > On Mon, Mar 19, 2018 at 03:41:15PM +0100, Dan Horák wrote: > > On Mon, 19 Mar 2018 14:06:56 +0100 > > Dan Horák wrote: > > > > > On Sun, 18 Mar 2018 20:25:31 +0100 > > > Fabio Valentini wrote: > > > > > > > On Sun, Mar 18, 2018 at 7

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-19 Thread Julian Sikorski
W dniu 19.03.2018 o 15:57, Pierre-Yves Chibon pisze: > On Mon, Mar 19, 2018 at 03:41:15PM +0100, Dan Horák wrote: >> On Mon, 19 Mar 2018 14:06:56 +0100 >> Dan Horák wrote: >> >>> On Sun, 18 Mar 2018 20:25:31 +0100 >>> Fabio Valentini wrote: >>> On Sun, Mar 18, 2018 at 7:13 PM, Michael Cronen

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-19 Thread Pierre-Yves Chibon
On Mon, Mar 19, 2018 at 03:41:15PM +0100, Dan Horák wrote: > On Mon, 19 Mar 2018 14:06:56 +0100 > Dan Horák wrote: > > > On Sun, 18 Mar 2018 20:25:31 +0100 > > Fabio Valentini wrote: > > > > > On Sun, Mar 18, 2018 at 7:13 PM, Michael Cronenworth > > > wrote: > > > > On 03/18/2018 01:02 PM, Fab

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-19 Thread Dan Horák
On Mon, 19 Mar 2018 14:06:56 +0100 Dan Horák wrote: > On Sun, 18 Mar 2018 20:25:31 +0100 > Fabio Valentini wrote: > > > On Sun, Mar 18, 2018 at 7:13 PM, Michael Cronenworth > > wrote: > > > On 03/18/2018 01:02 PM, Fabio Valentini wrote: > > >> > > >> I've looked at waiverdb-cli too, but since

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-19 Thread Dan Horák
On Sun, 18 Mar 2018 20:25:31 +0100 Fabio Valentini wrote: > On Sun, Mar 18, 2018 at 7:13 PM, Michael Cronenworth > wrote: > > On 03/18/2018 01:02 PM, Fabio Valentini wrote: > >> > >> I've looked at waiverdb-cli too, but since no tests seem to have > >> run at all, it looks like the wrong tool fo

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-18 Thread Fabio Valentini
On Sun, Mar 18, 2018 at 7:13 PM, Michael Cronenworth wrote: > On 03/18/2018 01:02 PM, Fabio Valentini wrote: >> >> I've looked at waiverdb-cli too, but since no tests seem to have run >> at all, it looks like the wrong tool for the job: >> I don't want to push an update despite a failed test, I wa

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-18 Thread Michael Cronenworth
On 03/18/2018 01:02 PM, Fabio Valentini wrote: I've looked at waiverdb-cli too, but since no tests seem to have run at all, it looks like the wrong tool for the job: I don't want to push an update despite a failed test, I want to push my update despite no test data being available ... Randy sai

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-18 Thread Fabio Valentini
On Sun, Mar 18, 2018 at 6:28 PM, Michael Cronenworth wrote: > On 03/18/2018 05:03 AM, Fabio Valentini wrote: >> >> I've got two updates sitting in F26 and F27 updates-testing: >> >> https://bodhi.fedoraproject.org/updates/FEDORA-2018-c455a245b0 >>

Re: What to do when test gating in bodhi fails (no test results found)?

2018-03-18 Thread Michael Cronenworth
On 03/18/2018 05:03 AM, Fabio Valentini wrote: I've got two updates sitting in F26 and F27 updates-testing: https://bodhi.fedoraproject.org/updates/FEDORA-2018-c455a245b0 https://bodhi.fedoraproject.org/updates/FEDORA-2018-4d0e13

What to do when test gating in bodhi fails (no test results found)?

2018-03-18 Thread Fabio Valentini
Hi, I've got two updates sitting in F26 and F27 updates-testing: https://bodhi.fedoraproject.org/updates/FEDORA-2018-c455a245b0 https://bodhi.fedoraproject.org/updates/FEDORA-2018-4d0e13ff51 I can't push either of them to batched or stable (despite them being in -testing for over 10 days now), b