Re: Bulk Closing Intermittents

2017-07-12 Thread L. David Baron
On Wednesday 2017-07-12 06:18 -0700, emor...@mozilla.com wrote: > On Wednesday, 12 July 2017 04:09:52 UTC+1, Karl Tomlinson wrote: > > I assume this was integrated with OrangeFactor? > > > > That is the only way I know to determine whether an intermittent > > failure has occurred, because

Re: Bulk Closing Intermittents

2017-07-12 Thread Emma Humphries
Yes, my query for bugs to close filters for "leave-open". Thanks! -- Emma On Wed, Jul 12, 2017 at 6:18 AM, wrote: > On Wednesday, 12 July 2017 04:09:52 UTC+1, Karl Tomlinson wrote: > > I assume this was integrated with OrangeFactor? > > > > That is the only way I know to

Re: Bulk Closing Intermittents

2017-07-12 Thread emorley
On Wednesday, 12 July 2017 04:09:52 UTC+1, Karl Tomlinson wrote: > I assume this was integrated with OrangeFactor? > > That is the only way I know to determine whether an intermittent > failure has occurred, because failures are not necessarily > reported to bugzilla. This is no longer the

Re: Bulk Closing Intermittents

2017-07-11 Thread Karl Tomlinson
I assume this was integrated with OrangeFactor? That is the only way I know to determine whether an intermittent failure has occurred, because failures are not necessarily reported to bugzilla. Is there a mechanism for tracking a failure that we intend to addresss, even when it does not fail

Re: Bulk Closing Intermittents

2017-07-10 Thread Emma Humphries
This was the first time we bulk closed these bugs, and there will be some glitches. I don't consider this to be a blocker on continuing this work. Next time we do this, it won't be 5,000+ bugs. OrangeBot runs on Sundays, so we can do the cleanup on Monday. The long term goal is to stop using

Re: Bulk Closing Intermittents

2017-07-10 Thread Emma Humphries
Dylan, Thank you for clarifying that difference. That was sloppy of me to describe that as a DBA operation. -- Emma On Mon, Jul 10, 2017 at 7:25 AM, Dylan Hardison wrote: > > > > > On Jul 7, 2017, at 19:35, Emma Humphries wrote: > > > > The first batch of

Re: Bulk Closing Intermittents

2017-07-10 Thread Kartikaya Gupta
It might be a good idea to integrate this process with the OrangeFactor Robot, to avoid race conditions like what happened on bug 1328486 (it was bulk-closed, and then a couple of hours later the OF robot reported that there were two failures this week - but the bug remained closed). Cheers, kats

Bulk Closing Intermittents

2017-07-07 Thread Emma Humphries
As discussed earlier, Joel and I have kicked off a process to close intermittent test failures in Bugzilla. If a test associated with a bug does not fail in 21 days, we'll close the bug as RESOLVED:INCOMPLETE. The first batch of intermittent bugs to close has 5,130 tickets. I have a script to