Branch: refs/heads/main
Home: https://github.com/WebKit/WebKit
Commit: 2b7f2071e6b8785f55437cd04eaac74834c40d30
https://github.com/WebKit/WebKit/commit/2b7f2071e6b8785f55437cd04eaac74834c40d30
Author: Marta Darbinyan <[email protected]>
Date: 2026-09-09 (Wed, 09 Sep 2026)
Changed paths:
M Tools/CISupport/ews-build/steps.py
M Tools/CISupport/ews-build/steps_unittest.py
Log Message:
-----------
Enable --exit-after-n-failures 60 on API test EWS builders
https://bugs.webkit.org/show_bug.cgi?id=321046
rdar://176804299
Reviewed by Aakash Jain.
Follow-up to the run-api-tests --exit-after-n-failures option. Enable it
on EWS with a cap of 60, matching layout tests via
RunWebKitTests.EXIT_AFTER_FAILURES. When a run hits the cap,
first_run_failures and second_run_failures are nondeterministic
truncated subsets, so intersection-based flake filtering can
misclassify real regressions as flaky. Track a per-run
{suffix}_exceeded_failure_limit property; when either flag is set the
analyzer falls back to (first ∪ second) - clean_tree and skips flake
classification. Mirrors AnalyzeLayoutTestsResults.
Also bumps MAX_FAILURES_TO_CHECK_RESULTS_DB from 50 to 60 so every
failure in a capped run gets checked against results-db.
* Tools/CISupport/ews-build/steps.py:
(RunAPITests):
Set EXIT_AFTER_FAILURES = '60'. Bump MAX_FAILURES_TO_CHECK_RESULTS_DB
from 50 to 60 to match.
(RunAPITests.run):
Append --exit-after-n-failures 60 to the command. Set
{suffix}_exceeded_failure_limit when failedTestCount reaches the cap.
(RunAPITestsWithoutChange):
Set EXIT_AFTER_FAILURES = None so the clean-tree run doesn't cap.
(AnalyzeAPITestsResults.run):
When either run hit the cap, use union-of-runs minus clean-tree
failures and skip flake classification. Append "(failure limit
exceeded)" to the message.
* Tools/CISupport/ews-build/steps_unittest.py:
Update expected command strings for TestRunAPITests to include the
flag.
(TestAnalyzeAPITestsResults):
Add four tests locking in the cap-hit branch.
Canonical link: https://commits.webkit.org/320753@main
To unsubscribe from these emails, change your notification settings at
https://github.com/WebKit/WebKit/settings/notifications
