Thanks for the intriguing data, Philip. Is there a way to get a list of tests where all other browsers pass but Safari / WebKit fail?
That would allow us to quickly identify the set of tests we can fix to improve the interoperability across browsers right away. - R. Niwa On Tue, Oct 2, 2018 at 3:45 AM Philip Jägenstedt <foo...@chromium.org> wrote: > Hi WebKittens, > > Fresh off the bots, I'm excited to report more robust Safari results, > and that Safari WPT pass rates are clearly improving! Thanks to the > hard work of Mike Pennisi  we now have the first Safari 12 results: > https://wpt.fyi/results/?sha=ee2e69bfb1&product=safari-12.0 > > This uses the same setup as for Safari Technology Preview, which has > been running for a while  and are the results you see on the > "experimental" view: > https://wpt.fyi/results/?label=experimental > > This appears much more robust than the Safari 11 data we've collected > from Sauce Labs, and we can see a massive improvement between Safari > 11 and 12: > > https://wpt.fyi/results/?sha=ee2e69bfb1&product=safari-11.1&product=safari-12.0&diff > > This lumps together infrastructure improvements as well as Safari > 11->12 improvements, but improvements in service-workers/  stands > out, as well as in webdriver/, referrer-policy/, css/css-align/, and > others. (The effect of moving away from Sauce is mainly less > timeouts.) > > Also very interesting is to compare Safari 12 stable to TP: > > https://wpt.fyi/results/?sha=ee2e69bfb1&product=safari-12.0&product=safari-12.1&diff > > One can tell that work is going in canvas-related things, > web-animations/, css/css-logical/ and more! \o/ > > I hope you'll all find these results valuable, and please report bugs > or feature requests here: > https://github.com/web-platform-tests/wpt.fyi/issues > > P.S. We're also trying to use use these diff views to spot > regressions. It's a bit hard to use,  but a fix in in progress  > and I might check back here when that works. I'll append to the end of > this email a non-exhaustive list of possible regressions already > possible to spot. > >  https://github.com/web-platform-tests/results-collection/issues/604 >  https://wpt.fyi/test-runs?labels=safari,experimental >  > https://wpt.fyi/results/service-workers?sha=ee2e69bfb1&product=safari-11.1&product=safari-12.0&diff=true >  https://github.com/web-platform-tests/wpt.fyi/issues/411 >  https://github.com/web-platform-tests/wpt.fyi/pull/609 > > P.P.S. Possible regressions in Safari TP: > > https://wpt.fyi/results/css/vendor-imports/mozilla/mozilla-central-reftests/shapes1?sha=ee2e69bfb1&product=safari-12.0&product=safari-12.1 > > https://wpt.fyi/results/service-workers/service-worker/extendable-event-async-waituntil.https.html?sha=ee2e69bfb1&product=safari-12.0&product=safari-12.1 > > https://wpt.fyi/results/service-workers/service-worker/skip-waiting-installed.https.html?sha=ee2e69bfb1&product=safari-12.0&product=safari-12.1 > _______________________________________________ > webkit-dev mailing list > email@example.com > https://lists.webkit.org/mailman/listinfo/webkit-dev >
_______________________________________________ webkit-dev mailing list firstname.lastname@example.org https://lists.webkit.org/mailman/listinfo/webkit-dev