Update...I've used --merge on prove! This merges the outputs into one. Removing this option and using note for the output will give correct results
ok 1 - test 1 1..1 ok 1 - pestering 1 not ok 5 - pestering 2 ok All tests successful.Files=1, Tests=1, 0 wallclock secs ( 0.03 usr 0.00 sys + 0.15 cusr 0.02 csys = 0.20 CPU)
Result: PASS