See <http://robot.radiaatto.ri.fi/hudson/job/RobotFrameworkJython/87/changes>
Changes:
[pekka.klarck] added some more complexity
[pekka.klarck] added some more complex tests
[janne.t.harkonen] Added public name for fixtures
[janne.t.harkonen] Removed steps that test nothing (at least according to my
understanding)
[janne.t.harkonen] Removed steps that test nothing (at least according to my
understanding)
[pekka.klarck] Use Fail instead of Log with kws that should not be run + some
cleanup.
[jussi.ao.malinen] Added some ∏ön ÄßÇïï characters to log- and error messages
on "continue on failure" tests
[janne.t.harkonen] Moved responsibility of running fixtures to their own class
[jussi.ao.malinen] cleanup
[jussi.ao.malinen] Issue 544 (run keywords always on teardown except when fatal
exception occurs)
[jussi.ao.malinen] ExecutionFailures is now not printed out on error messages
[jussi.ao.malinen] fixed unicode handling on error messages with continue on
failure
[jussi.ao.malinen] tests for checking that test and suite teardown continue on
failure (except fatal failure).
[KariHusa] Renamed and unicode fix
[KariHusa] Cleanup
[KariHusa] Merge
[KariHusa] Use new api
[KariHusa] Fixed unicode
[KariHusa] Refatoring
[KariHusa] merge
[janne.t.harkonen] Added test for parallel user keywords failing
[jussi.ao.malinen] Added test for teardowns in signaling. (Issue 108, stopping
with signal)
[janne.t.harkonen] refactoring
[janne.t.harkonen] Only log return value of failing keyword if the failure is
continuable
[janne.t.harkonen] Added tests for log messages of return values in case of
continuable failures
------------------------------------------
[...truncated 5404 lines...]
Different Variable Files :: Verifies that it is possible to import... | PASS |
------------------------------------------------------------------------------
Same Variable File :: Verifies that if the same variable file is r... | PASS |
------------------------------------------------------------------------------
Robot.Variables.Same Variable File Names | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Robot.Variables.Suite Source
==============================================================================
${SUITE SOURCE} In Dir Suite | PASS |
------------------------------------------------------------------------------
${SUITE SOURCE} In File Suite | PASS |
------------------------------------------------------------------------------
${SUITE SOURCE} In User Keyword | PASS |
------------------------------------------------------------------------------
${SUITE SOURCE} In Resource File | PASS |
------------------------------------------------------------------------------
Robot.Variables.Suite Source | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Robot.Variables.Test And Suite Status Variables
==============================================================================
Previous Test Variables Should Have Default Values | PASS |
------------------------------------------------------------------------------
Test Name In Test | PASS |
------------------------------------------------------------------------------
Test Name In Setup | PASS |
------------------------------------------------------------------------------
Test Tags | PASS |
------------------------------------------------------------------------------
Test Status Should Not Exist Outside Teardown | PASS |
------------------------------------------------------------------------------
Test Message Should Not Exist Outside Teardown | PASS |
------------------------------------------------------------------------------
Test Status When Test Fails | PASS |
------------------------------------------------------------------------------
Test Status When Setup Fails | PASS |
------------------------------------------------------------------------------
...ous Test Variables Should Have Correct Values When That Test Fails | PASS |
------------------------------------------------------------------------------
...ious Test Variables Should Have Default Values From Previous Suite | PASS |
------------------------------------------------------------------------------
Suite And Prev Test Variables Work Correctly In Setup | PASS |
------------------------------------------------------------------------------
Suite And Prev Test Variables Work Correctly In Teardown | PASS |
------------------------------------------------------------------------------
Suite Variables In Test | PASS |
------------------------------------------------------------------------------
Robot.Variables.Test And Suite Status Variables | PASS |
13 critical tests, 13 passed, 0 failed
13 tests total, 13 passed, 0 failed
==============================================================================
Robot.Variables.Variable Priorities :: Some of these tests are testing same...
==============================================================================
Individual CLI Variables Override All Other Variables | PASS |
------------------------------------------------------------------------------
Variable Files From CLI Override All Variables In Test Data | PASS |
------------------------------------------------------------------------------
...riable Files Are Given From CLI The First One Has Highest Priority | PASS |
------------------------------------------------------------------------------
...les Override Variables From Resource And Variable Files It Imports | PASS |
------------------------------------------------------------------------------
...les Override Variables From Resource And Variable Files It Imports | PASS |
------------------------------------------------------------------------------
... Or Variable Files Are Imported The First One Has Highest Priority | PASS |
------------------------------------------------------------------------------
Variables With Different Priorities Are Seen Also In User Keywords | PASS |
------------------------------------------------------------------------------
...es Set During Test Execution Override All Variables In Their Scope | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Priorities :: Some of these tests are tes... | PASS |
8 critical tests, 8 passed, 0 failed
8 tests total, 8 passed, 0 failed
==============================================================================
Robot.Variables.Variable Scopes :: These tests are somewhat related to test...
==============================================================================
Variables Set In Test Case Are Seen By User Keywords | PASS |
------------------------------------------------------------------------------
Variables Set In One Test Are Not Visible In Another | PASS |
------------------------------------------------------------------------------
...les Set In User Keyword Are Seen Only By Lower Level User Keywords | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Scopes :: These tests are somewhat relate... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Robot.Variables.Variable Table
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
List With One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List Created From List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Assign Mark With Scalar Variable | PASS |
------------------------------------------------------------------------------
Assign Mark With List Variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Table | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Resource Files
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
List With One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List Created From List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Assign Mark With Scalar Variable | PASS |
------------------------------------------------------------------------------
Assign Mark With List Variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables From Resource Files | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Variable Files
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
Scalar Object | PASS |
------------------------------------------------------------------------------
List With One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
List With Objects | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables From Variable Files | PASS |
16 critical tests, 16 passed, 0 failed
16 tests total, 16 passed, 0 failed
==============================================================================
Robot.Variables.Variables In Import Settings
==============================================================================
Variable Defined In Test Case File Is Used To Import Resources | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables In Import Settings | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Robot.Variables.Variables Inside Variables
==============================================================================
Variable Inside Variable In Variable Table | PASS |
------------------------------------------------------------------------------
Variable Inside Variable In Test Case | PASS |
------------------------------------------------------------------------------
Variable Inside Variable In User Keyword | PASS |
------------------------------------------------------------------------------
Variable Inside List Variable | PASS |
------------------------------------------------------------------------------
Variable Inside List Variable Index | PASS |
------------------------------------------------------------------------------
Variable Inside Variable And Extended Variable Syntax | PASS |
------------------------------------------------------------------------------
Non-Existing Variable Inside Variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables Inside Variables | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Robot.Variables | PASS |
162 critical tests, 162 passed, 0 failed
162 tests total, 162 passed, 0 failed
==============================================================================
Robot :: Robot Framework acceptance tests | FAIL |
1999 critical tests, 1988 passed, 11 failed
2029 tests total, 1990 passed, 39 failed
==============================================================================
Output:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFrameworkJython/ws/robotframework/atest/results/output.xml>
Report:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFrameworkJython/ws/robotframework/atest/results/report.html>
Log:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFrameworkJython/ws/robotframework/atest/results/log.html>