Now that we've fixed most of these I went through it again and checked stuff. Filtering out scoped style and web components failures we only have a hundred tests left
I recategorized most of them: https://gist.github.com/Manishearth/086118c940ff86a6cfc573f53c508279 The major issues right now are first-line and the styloVsGecko <audio>/<video> issue (which does not block landing since it's a slight discrepancy between stylo and gecko) -Manish Goregaokar On Thu, May 11, 2017 at 5:19 PM, Manish Goregaokar <manishsm...@gmail.com> wrote: > And, it's done! All reftest failures classified. > > Permalink to current revision: > https://gist.github.com/Manishearth/086118c940ff86a6cfc573f53c508279/a181e327a4e2d83d75e28862d1fc01e121923bff > > Bear in mind that the try run this is based on is a few days old so some of > the things there may be fixed in master. I've been making drive-by patches > for many of the things I come across. > > I'll soon do a separate analysis of the HasAuthorSpecifiedRules stuff to see > what's still failing since Matt's patches have landed. There are 913 tests > marked as HasAuthorSpecified in that file, and Matt's patches fixed 530, so > we still have some input widget bugs floating around. > > > I will also be removing now-passing tests if I see them, but don't rely on > that being true. I don't intend to put too much time into maintaining this > list; the main point was to get an idea of what needs to be fixed. I will > try to investigate things which still fail when their corresponding bug > lands. > > > Thanks, > > -Manish Goregaokar > > On Wed, May 10, 2017 at 5:14 PM, Manish Goregaokar <manishsm...@gmail.com> > wrote: >> >> So I took a try push with all expectations set as passing and went about >> categorizing the reftest failures. >> >> I'm halfway done. This is pre-HasAuthorSpecifiedRules and there are lots >> of related failures. At some point I'll extract all the HASR-marked failures >> and have a second look at the ones which are still not passing after the >> HASR bug lands. >> >> https://gist.github.com/Manishearth/086118c940ff86a6cfc573f53c508279 >> >> While I've investigated many of these, many others still don't have well >> known reasons. >> >> It would be quite helpful if everyone could help investigate. Ctrl-F >> "unknown" on that page, anything with "unknown" in the explanation needs >> more investigation. >> >> If you do file bugs (or find existing bugs), please let me know so that I >> can update the page. I haven't yet had time to really file bugs for each >> failure, and I intend to do this once done with the rest, but help now would >> be appreciated! >> >> There are also some possibly-low-hanging-fruit failures where I've >> investigated the reason and mentioned it, but not yet filed an issue. >> >> I'll continue to push more reftest failure categorizations as I get >> through, and I intend to write some scripts that let me keep this doc >> somewhat up to date as major groups of failures get fixed. >> >> Thanks, >> -Manish Goregaokar > > _______________________________________________ dev-servo mailing list dev-servo@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-servo
