hello everyone i have created a plugin that adds the ability to quarantine a test case that fails intermittently:
https://github.com/samsta/quarantine we are using it on our jenkins instance, but it has one major area of concern. because the build status can't be made better, but only worse, i can't just run another step after the test result archiver, so i had to piggy-back functionality on a sub-class of JUnitResultArchiver: https://github.com/samsta/quarantine/blob/master/src/main/java/org/jenkinsci/plugins/quarantine/QuarantinableJUnitResultArchiver.java personally, i do not like this approach because of the following issues: - it is brittle - it is confusing and error prone in the job configuration - it is too tightly coupled to the junit result format i would really like to resolve this before releasing this plugin into the wider world as i am not really willing to provide support, knowing of these architectural deficiencies. can anyone suggest a way forward, please? all ideas i have so far require changes in the core: - add an extension point that allows to assess test results after the archiver has run - this would mean that the archiver is no longer making the decision about the build status - not really backwards compatible - drop the requirement that builds can only be made worse - yuck! potentially opens a can of worms - allow to modify a test result from within a TestAction or TestDataPublisher, either using the skipped state or by adding a new ignored/quarantined state - test result has been immutable so far - a fair bit of work in TestResult and friends, but these could do with some work because the relation between the hudson.tasks.test.TestResult and hudson.tasks.junit.TestResult is a bit confusing cheers, sam -- Samuel Nobs Senior Design Engineer Tait Communications DDI: +64 7 825 7538 Email: [email protected] <http://www.taitradio.com> www.taitradio.com -- ------------------------------ This email, including any attachments, is only for the intended recipient. It is subject to copyright, is confidential and may be the subject of legal or other privilege, none of which is waived or lost by reason of this transmission. If you are not an intended recipient, you may not use, disseminate, distribute or reproduce such email, any attachments, or any part thereof. If you have received a message in error, please notify the sender immediately and erase all copies of the message and any attachments. Unfortunately, we cannot warrant that the email has not been altered or corrupted during transmission nor can we guarantee that any email or any attachments are free from computer viruses or other conditions which may damage or interfere with recipient data, hardware or software. The recipient relies upon its own procedures and assumes all risk of use and of opening any attachments. ------------------------------ -- You received this message because you are subscribed to the Google Groups "Jenkins Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
