When a test starts failing on a bot that uses old-run-webkit-tests, we 
typically check in expected failure results for that test (e.g., 
<http://trac.webkit.org/changeset/90235>). That way we can find out if the 
test's behavior changes in the future even though the test is still failing. 
This is particularly useful for tests that are actually testing multiple things 
at once. (Maybe they should be broken up into multiple tests, but that's a 
different discussion.)

Is there a way to achieve this with new-run-webkit-tests? I know that you can 
mark a test as an expected failure (either a text diff, or an image diff, or 
both). Does it let you specify that the test should fail in a particular way?

-Adam

_______________________________________________
webkit-dev mailing list
webkit-dev@lists.webkit.org
http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev

Reply via email to