I have added an application option ktf-to-fail that when specified accumulates
tests with known-to-fail status as if they failed. When this option is missing,
failure statistics do not include known-to-fail results and there is a summary
at the end of parserTests that specifies how many known-to-fail tests were run
(unless that number is zero). I also have modified parserTests to indicate the
known-to-fail status when that option is specified.
But, there is still an issue. How should the per-test known-to-fail option
interact with the compare and record application options? Should parserTests be
modified to record and compare known-to-fail results? Or, should these results
be silent for recording purposes and treated as failures only if the
ktf-to-fail application options is specified?
_______________________________________________
Wikitech-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
