How else are you going to deal with "you've run more tests than you said you were"? If you accept the results and assume the count is wrong how do you know what the program didn't silently die part way through and in fact you are dealing with a catastrophic failure in the middle of more tests than were run?
Yep, too many tests is a major error, not of those test, but of the plan.You promised to run X tests, you didn't. FAIL. Over or under, it doesn't matter. That's why the plan is there.
Adam K
