Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-04-02 Thread Philip Jägenstedt
On Fri, Mar 29, 2019 at 6:16 PM Robert Ma wrote: > On Mon, Feb 25, 2019 at 8:49 AM Philip Jägenstedt > wrote: > >> I'd like to point out right away that diagnosing reftest failures is >> currently cumbersome because we don't store the screenshots. This is >> also a work in progress: >> >>

Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-26 Thread Sam Sneddon
A lot of the test results I'm seeing there are the "harness status", which has been a common cause of confusion: https://github.com/web-platform-tests/wpt.fyi/issues/62. Don't know quite what the right solution is here, but it's definitely still confusing. /Sam On Mon, Feb 25, 2019 at 9:57 PM

Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-25 Thread Maciej Stachowiak
> On Feb 25, 2019, at 1:57 PM, Philip Jägenstedt wrote: > > I think I know what's going on there. When drilling down into tests and > subtests, only those matching the filter are shown. Clearing the filter > things look a bit different in the directories you mentioned: >

Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-25 Thread Philip Jägenstedt
I think I know what's going on there. When drilling down into tests and subtests, only those matching the filter are shown. Clearing the filter things look a bit different in the directories you mentioned:

Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-25 Thread Maciej Stachowiak
Neat. I see some obvious areas for focus, where Safari fails lots of tests that the other browser don’t. For context, I tried looking at this view, which shows all tests that Safari and Firefox pass with Safari results regardless of result:

Re: [webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-25 Thread Philip Jägenstedt
I'd like to point out right away that diagnosing reftest failures is currently cumbersome because we don't store the screenshots. This is also a work in progress: https://docs.google.com/document/d/1IhZa4mrjK1msUMhtamKwKJ_HhXD-nqh_4-BcPWM6soQ/edit?usp=sharing Until that has launched, I would

[webkit-dev] Filtering results on wpt.fyi, Safari-specific failures

2019-02-25 Thread Philip Jägenstedt
Hi all, Following the improved Safari results last year [1] and the discussion that generated, I'm happy to announce that the filtering requested as now available in the search box. The full syntax is documented [2] but there's also a new insights view [3] with some useful searches. Especially