Branch: refs/heads/main
  Home:   https://github.com/WebKit/WebKit
  Commit: 2fcc121ad432b553922ce4a0e23315eb1d998cf8
      
https://github.com/WebKit/WebKit/commit/2fcc121ad432b553922ce4a0e23315eb1d998cf8
  Author: Issac Roy <[email protected]>
  Date:   2026-07-21 (Tue, 21 Jul 2026)

  Changed paths:
    M Tools/Scripts/run-api-tests
    M Tools/Scripts/webkitpy/api_tests/manager.py
    A Tools/Scripts/webkitpy/common/net/results_database.py
    A Tools/Scripts/webkitpy/common/net/results_database_unittest.py
    M Tools/Scripts/webkitpy/layout_tests/controllers/manager.py
    M Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

  Log Message:
  -----------
  run-webkit-tests should optionally consult the results database to identify 
pre-existing failures when running at desk
https://bugs.webkit.org/show_bug.cgi?id=318754
rdar://180662445

Reviewed by Sam Sneddon.

Add a --check-pre-existing-failures flag to run-webkit-tests and run-api-tests.
When set, each unexpected failure is looked up against results.webkit.org after
the run completes and classified as either pre-existing (historically failing on
the post-commit infrastructure) or possibly new. A test is considered
pre-existing when its combined pass+warning rate is strictly below 80%. A
companion --max-pre-existing-checks option (default: 0, no limit) caps the
number of lookups for use on slow connections or with very large failure sets.

* Tools/Scripts/run-api-tests:
(parse_args):
* Tools/Scripts/run-webkit-tests:
(parse_args):
* Tools/Scripts/webkitpy/api_tests/manager.py:
(Manager.run):
* Tools/Scripts/webkitpy/common/net/results_database.py: Added.
(get_results_summary):
(is_pre_existing_failure):
(check_pre_existing_failures):
* Tools/Scripts/webkitpy/common/net/results_database_unittest.py: Added.
* Tools/Scripts/webkitpy/layout_tests/controllers/manager.py:
(Manager._end_test_run):
* Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py:
(parse_args):

Canonical link: https://commits.webkit.org/317639@main



To unsubscribe from these emails, change your notification settings at 
https://github.com/WebKit/WebKit/settings/notifications

Reply via email to