Using GivenScenarios causes failed tests to be forgotten
--------------------------------------------------------

                 Key: JBEHAVE-282
                 URL: http://jira.codehaus.org/browse/JBEHAVE-282
             Project: JBehave
          Issue Type: Bug
          Components: Core
    Affects Versions: 2.5.3
            Reporter: Martin Hutchinson
         Attachments: JBehave-GivenScenarios.zip

We have multiple related scenarios within the same JBehave script.  This seems 
to be supported functionality but a major issue came to light earlier: using 
GivenScenarios at the start of a later scenario will cause any failed scenarios 
thus far to be forgotten.  For example:

""
Story: Test showing that using a given scenario skews the overall result

Scenario: Fail

GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
 Then I fail

Scenario: Succeed

GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
 Then I pass
""

The JUnit result for running a scenario with the above script is a pass, even 
though the "I fail" step threw an exception.  If you remove the GivenScenarios 
line from the Succeed case then the JUnit result is a fail.

Attached is an Eclipse project that demonstrates this.  This is a major issue 
for us: we run the JBehave tests from our build farm in an automated process.  
This bug would give us the green light for the whole build despite tests 
failing.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

    http://xircles.codehaus.org/manage_email


Reply via email to