Using GivenScenarios causes failed tests to be forgotten
--------------------------------------------------------
Key: JBEHAVE-282
URL: http://jira.codehaus.org/browse/JBEHAVE-282
Project: JBehave
Issue Type: Bug
Components: Core
Affects Versions: 2.5.3
Reporter: Martin Hutchinson
Attachments: JBehave-GivenScenarios.zip
We have multiple related scenarios within the same JBehave script. This seems
to be supported functionality but a major issue came to light earlier: using
GivenScenarios at the start of a later scenario will cause any failed scenarios
thus far to be forgotten. For example:
""
Story: Test showing that using a given scenario skews the overall result
Scenario: Fail
GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
Then I fail
Scenario: Succeed
GivenScenarios: com/example/sandpit/jbehave/noop
Given I do nothing
Then I pass
""
The JUnit result for running a scenario with the above script is a pass, even
though the "I fail" step threw an exception. If you remove the GivenScenarios
line from the Succeed case then the JUnit result is a fail.
Attached is an Eclipse project that demonstrates this. This is a major issue
for us: we run the JBehave tests from our build farm in an automated process.
This bug would give us the green light for the whole build despite tests
failing.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe from this list, please visit:
http://xircles.codehaus.org/manage_email