I am sorry for bugging you about this, but I didn't get any answer on this email and I am still wondering the presence of such feature (see email below).

Best regards,
Plamen Dimitrov


On 04/08/2014 12:09 PM, Plamen Dimitrov wrote:
Hi guys,

I was wondering does Autotest have a feature whereby it can detect an expected test failure? Say we have some tests that we have developed and that for various reasons we want to temporarily disable. Is there a better way to do this than commenting them out? I would prefer to have them in the test results report generated in the end, but neither as "FAIL" nor as "PASS". I would be happy even if I could have "WARN" although a better status would be "EXPECT_FAIL" or possibly something shorter. Do you think we have a way around this?

On a side note, trying to use the boolean return value of utils_misc.run_tests() it never seems to give False although the test has practically failed. The reason for this are the lines:

        if not current_status:
            failed = True
        status_dict[param_dict.get("name")] = current_status

    return not failed

Where if the test failed, the current status will be "FAIL" which will still resolve to "failed = False". Is this intended behavior?

Best,
Plamen Dimitrov



_______________________________________________
Virt-test-devel mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/virt-test-devel

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
Virt-test-devel mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/virt-test-devel

Reply via email to