This is awesome!
On 28/07/2020 18:40, Andrew Sutherland wrote:
- How long your tests take to run (on average)!
- How many times your tests were run in the preceding 7 days[1]!
- How many times your tests were skipped in the preceding 7 days!
- What skip-patterns govern the skips from your test's
mochitest.ini-style files!
- What WPT disabled patterns govern the skips from your WPT test's meta
files!
- How many WPT subtests defy expectations!
- The wpt.fyi URL of the test you're looking at... by clicking on the
"Web Platform Tests Dashboard" link in the "Navigation" panel on the
right side of the searchfox page!
As an aside/reminder for people, for web-platform-tests in particular
the dashboard at https://jgraham.github.io/wptdash/ can give you
information about all tests in a component and is designed to answer
questions like "which tests are failing in Firefox but passing in both
Chrome and Safari", since knowing that can help prioritise issues that
are likely web-compat hazards.
This information is brought to you by:
- The "source-test-file-metadata-test-info-all" taskcluster job defined
at
https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/file-metadata.yml
that provides statistics on runs, skipped runs, and (non-WPT) skip
conditions.
- The "source-test-wpt-metadata-summary" taskcluster job defined at
https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/wpt-metadata.yml
that derives its data from `mach wpt-metadata-summary`. (Thanks :jgraham!)
And, as less of an aside, if there's more information people want, we
can definitely add it to the summary task. The current featureset was
based on the requirements of wptdash, but if there's more things that
would be useful we should go ahead and add them.
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
