Reviewers: Jakob,

Message:
PTAL

Description:
Add broader custom test expectations for blink tests to detect crashes.

Most of these tests had some problems (failure, crash or timeout), but which
problem exactly cannot be retrieved anymore.

We let them rum for a while with a broader test expectation (pass fail slow) and
analyse the results.

Tests that crash get a crash expectation. Timeouts will get a timeout
expectation.

Please review this at https://codereview.chromium.org/18319005/

SVN Base: https://v8.googlecode.com/svn/branches/bleeding_edge

Affected files:
  M tools/blink_tests/TestExpectations


Index: tools/blink_tests/TestExpectations
diff --git a/tools/blink_tests/TestExpectations b/tools/blink_tests/TestExpectations index fa3ce3c592a506c7d5f4dc1599b7920097cab3ee..5c75db0d7e475ceba2e345b3e9ea9bcb6a5f7f5f 100644
--- a/tools/blink_tests/TestExpectations
+++ b/tools/blink_tests/TestExpectations
@@ -1,25 +1,19 @@
-# Created by test_result_analyzer.py
-# Date:          2013-06-07 15:09:29.286522
-# Waterfall:     v8_blink
-# Revision type: webkit
-# Fail ratio:    0.2
-[ Linux Release x86 ] fast/js/JSON-stringify.html [ Skip ]
-[ Linux Release x86 ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/thai-baht-space.html [ Skip ]
-[ Linux Release x86 ] fast/text/international/thai-line-breaks.html [ Skip ] -[ Linux Release x86 ] inspector/profiler/memory-instrumentation-external-array.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Release x86_64 ] fast/text/international/thai-baht-space.html [ Skip ] -[ Linux Release x86_64 ] fast/text/international/thai-line-breaks.html [ Skip ] -[ Linux Release x86_64 ] inspector/profiler/memory-instrumentation-external-array.html [ Skip ]
-[ Linux Debug ] fast/text/atsui-multiple-renderers.html [ Skip ]
-[ Linux Debug ] fast/text/international/complex-joining-using-gpos.html [ Skip ]
-[ Linux Debug ] fast/text/international/danda-space.html [ Skip ]
-[ Linux Debug ] fast/text/international/thai-baht-space.html [ Skip ]
-[ Linux Debug ] fast/text/international/thai-line-breaks.html [ Skip ]
-
-# Manually added tests:
+# Tests that sometimes fail only on the V8 waterfall:
+[ Linux Release x86 ] fast/js/JSON-stringify.html [ Pass Failure Slow ]
+[ Linux Release x86 ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ] +[ Linux Release x86 ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ] +[ Linux Release x86 ] fast/text/international/danda-space.html [ Pass Failure Slow ] +[ Linux Release x86 ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ] +[ Linux Release x86 ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ] +[ Linux Release x86 ] inspector/profiler/memory-instrumentation-external-array.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] fast/text/international/danda-space.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ] +[ Linux Release x86_64 ] inspector/profiler/memory-instrumentation-external-array.html [ Pass Failure Slow ] +[ Linux Debug ] fast/text/atsui-multiple-renderers.html [ Pass Failure Slow ] +[ Linux Debug ] fast/text/international/complex-joining-using-gpos.html [ Pass Failure Slow ] +[ Linux Debug ] fast/text/international/danda-space.html [ Pass Failure Slow ] +[ Linux Debug ] fast/text/international/thai-baht-space.html [ Pass Failure Slow ] +[ Linux Debug ] fast/text/international/thai-line-breaks.html [ Pass Failure Slow ]


--
--
v8-dev mailing list
[email protected]
http://groups.google.com/group/v8-dev
--- You received this message because you are subscribed to the Google Groups "v8-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.


Reply via email to