Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-12 Thread Philip Jägenstedt
Hi Dean, On the run of Safari that was used for this report, the infrastructure test for ahem was actually passing: https://wpt.fyi/results/infrastructure/assumptions?sha=67152fdecd&product=chrome[stable]&product=edge[stable]&product=firefox[stable]&product=safari[experimental] Are you sure that

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-12 Thread Philip Jägenstedt
On Fri, Oct 12, 2018 at 4:07 PM Geoffrey Sneddon wrote: > > On Fri, Oct 12, 2018 at 4:23 AM Emilio Cobos Álvarez wrote: > > > > On 10/12/18 3:59 AM, Geoffrey Garen wrote: > > > Honest question: What’s gross about using @font-face? > > > > > > It would be lots of test edits. That’s a bummer. > > >

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-12 Thread Geoffrey Sneddon
On Fri, Oct 12, 2018 at 4:23 AM Emilio Cobos Álvarez wrote: > > On 10/12/18 3:59 AM, Geoffrey Garen wrote: > > Honest question: What’s gross about using @font-face? > > > > It would be lots of test edits. That’s a bummer. > > > > But maybe it’s clearer for the tests to specify the font they want t

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-11 Thread Emilio Cobos Álvarez
On 10/12/18 3:59 AM, Geoffrey Garen wrote: Honest question: What’s gross about using @font-face? It would be lots of test edits. That’s a bummer. But maybe it’s clearer for the tests to specify the font they want to use. It makes the test self-describing, eliminating the requirement that the u

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-11 Thread Geoffrey Garen
Honest question: What’s gross about using @font-face? It would be lots of test edits. That’s a bummer. But maybe it’s clearer for the tests to specify the font they want to use. It makes the test self-describing, eliminating the requirement that the user take a step outside the test to get the

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-11 Thread Dean Jackson
It turns out that many (most?) of the CSS failures are because we no longer expose user-installed fonts, e.g. Ahem. Options: - update lots of tests to load Ahem via @font-face (yuck) - allow Ahem to be used if installed (weird to special case one font, but probably ok) Dean > On 12 Oct 2018,

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-11 Thread Philip Jägenstedt
Alright, I've written a one-off script [1] to find the Safari-only failures, and here's the output: https://gist.github.com/foolip/4d410ce79416bcdce71feb212159a02e Barring bugs, each of linked tests or one of its subtests should be failing in Safari Technology Preview and passing in stable version

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-08 Thread Philip Jägenstedt
That filtering capability unfortunately does not yet exist on wpt.fyi but it's a high priority and actively being worked on: https://github.com/web-platform-tests/wpt.fyi/issues/201 FWIW, I suspect that these purposes, comparing to the stable versions of all *other* browsers might be the most usef

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-04 Thread Ryosuke Niwa
Sounds like we should import those tests! - R. Niwa On Thu, Oct 4, 2018 at 2:55 PM Chris Dumez wrote: > > On Oct 2, 2018, at 3:45 AM, Philip Jägenstedt wrote: > > Hi WebKittens, > > Fresh off the bots, I'm excited to report more robust Safari results, > and that Safari WPT pass rates are clear

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-04 Thread Chris Dumez
> On Oct 2, 2018, at 3:45 AM, Philip Jägenstedt wrote: > > Hi WebKittens, > > Fresh off the bots, I'm excited to report more robust Safari results, > and that Safari WPT pass rates are clearly improving! Thanks to the > hard work of Mike Pennisi [1] we now have the first Safari 12 results: > ht

Re: [webkit-dev] Huge improvement in Safari results on wpt.fyi

2018-10-04 Thread Ryosuke Niwa
Thanks for the intriguing data, Philip. Is there a way to get a list of tests where all other browsers pass but Safari / WebKit fail? That would allow us to quickly identify the set of tests we can fix to improve the interoperability across browsers right away. - R. Niwa On Tue, Oct 2, 2018 at