On Tue, Oct 13, 2009 at 10:45 AM, Peter Kasting <[email protected]> wrote:
> On Tue, Oct 13, 2009 at 10:43 AM, Dimitri Glazkov > <[email protected]>wrote: > >> Let's not conflate the two. There are flakes, and there are clearly, >> consistently failing tests, arriving in chunks every day via WebKit >> rolls. > > > OK, I'm just saying that my observations are that the obvious, consistent > failing tests that arrive are like 0.1% compared with the flaky tests. I > added many dozens of flaky test lines in my last sheriffing stint and the > number of additional failures from WebKit updates was like 3. So I don't > agree with your assessment of the problem space. > It's because the sheriff don't notice the new failing tests, because most of the time the gardener does a good job of updating the list at the same time as the merge, so the tree stays mostly green. See http://src.chromium.org/viewvc/chrome?view=rev&revision=28727 What sheriffs see is leftovers and flakiness introduced by the merge. Nicolas Nicolas > PK > > > > --~--~---------~--~----~------------~-------~--~----~ Chromium Developers mailing list: [email protected] View archives, change email options, or unsubscribe: http://groups.google.com/group/chromium-dev -~----------~----~----~----~------~----~------~--~---
