Yeah, using the buildbots to rebaseline 1000 tests is not the right use for the buildbots. We shouldn't be checking in knowing that we're going to break bots.
-eric On Mon, Feb 8, 2010 at 6:51 PM, Nikolas Zimmermann <zimmerm...@physik.rwth-aachen.de> wrote: > Good morning crowd, > > can anyone explain the "--exit-after-n-failures=20" default behaviour for > the build bots? > > Background: > Today I had to update a lot of SVG *expected.txt files including all > platform specific variations (in LayoutTests/platform/<gtk/qt/win/mac-*>). > I landed my patch with updated mac results and planned to wait for the build > bots to show me all differences, so I could update all baselines > for the individual platforms needing custom layout test results differing > from the mac baseline. > > Though because the bots exit early after 20 test failures it took a long > time to identify all differences because I could only fix a maximum of > 20 failures per commit - that's odd. I'm aware it's a rare case to update > 900+ test results in one shot but I thought it's worth to mention. > > I think the best way to resolve this problem is to run layout tests on the > try bots, so any layout test differences can be identified before comitting. > I recall some talk about that in the past, what's the status? > > Cheers, > Niko > > _______________________________________________ > webkit-dev mailing list > webkit-dev@lists.webkit.org > http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev > _______________________________________________ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev
