See <http://robot.radiaatto.ri.fi/hudson/job/RobotFramework/1857/changes>
Changes:
[Pekka Klärck] Tests and implementation for custom regexps with embedded
arguments.
Update issue 854
Owner: pekka.klarck
Status: Started
I had some extra time and decided to go ahead and implement this.
It turned out that hangling invalid regexps (e.g. "I do ${x:[}") and
regexps containing groups (e.g. "I do ${x:(a|b)c}") was somewhat more
difficult than I had thought.
The problem with the groups was that the overall regexp matching the
keyword names has capturing groups, and groups in the custom regexps
broke the logic of setting the values of the matched groups to
variables. To fix that I decided to make the groups in custom regexps
automatically non-capturing by adding ?: to them.
Adding ?: to all groups broke the possiblity to use other regexp
extensions in the custom regexps. Fixing that would have been way too
big a task compared to benefits. The match is already case-insensitive
and other features available via extensions don't make much sense in
this context. Instead creating keywords with regexp extensions now
fails with a clear error message.
Remaining task is updating the User Guide which I will do later today.
Any kind of testing and comments regarding the new functionality is
also appreciated.
[Pekka Klärck] _OutputSplitter deserves its own module and better name
------------------------------------------
[...truncated 8854 lines...]
------------------------------------------------------------------------------
${SUITE SOURCE} in file suite | PASS |
------------------------------------------------------------------------------
${SUITE SOURCE} in user keyword | PASS |
------------------------------------------------------------------------------
${SUITE SOURCE} in resource file | PASS |
------------------------------------------------------------------------------
Robot.Variables.Suite Source | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Robot.Variables.Test And Suite Status Variables
==============================================================================
Previous Test Variables Should Have Default Values | PASS |
------------------------------------------------------------------------------
Test Name In Test | PASS |
------------------------------------------------------------------------------
Test Name In Setup | PASS |
------------------------------------------------------------------------------
Test Tags | PASS |
------------------------------------------------------------------------------
Test Status Should Not Exist Outside Teardown | PASS |
------------------------------------------------------------------------------
Test Message Should Not Exist Outside Teardown | PASS |
------------------------------------------------------------------------------
Test Status When Test Fails | PASS |
------------------------------------------------------------------------------
Test Status When Setup Fails | PASS |
------------------------------------------------------------------------------
...ous Test Variables Should Have Correct Values When That Test Fails | PASS |
------------------------------------------------------------------------------
...ious Test Variables Should Have Default Values From Previous Suite | PASS |
------------------------------------------------------------------------------
Suite And Prev Test Variables Work Correctly In Setup | PASS |
------------------------------------------------------------------------------
Suite And Prev Test Variables Work Correctly In Teardown | PASS |
------------------------------------------------------------------------------
Suite Variables In Test | PASS |
------------------------------------------------------------------------------
Robot.Variables.Test And Suite Status Variables | PASS |
13 critical tests, 13 passed, 0 failed
13 tests total, 13 passed, 0 failed
==============================================================================
Robot.Variables.Variable Priorities :: Some of these tests are testing same...
==============================================================================
Individual CLI Variables Override All Other Variables | PASS |
------------------------------------------------------------------------------
Variable Files From CLI Override All Variables In Test Data | PASS |
------------------------------------------------------------------------------
...riable Files Are Given From CLI The First One Has Highest Priority | PASS |
------------------------------------------------------------------------------
...les Override Variables From Resource And Variable Files It Imports | PASS |
------------------------------------------------------------------------------
...les Override Variables From Resource And Variable Files It Imports | PASS |
------------------------------------------------------------------------------
... Or Variable Files Are Imported The First One Has Highest Priority | PASS |
------------------------------------------------------------------------------
Variables With Different Priorities Are Seen Also In User Keywords | PASS |
------------------------------------------------------------------------------
...es Set During Test Execution Override All Variables In Their Scope | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Priorities :: Some of these tests are tes... | PASS |
8 critical tests, 8 passed, 0 failed
8 tests total, 8 passed, 0 failed
==============================================================================
Robot.Variables.Variable Scopes :: These tests are somewhat related to test...
==============================================================================
Variables Set In Test Case Are Seen By User Keywords | PASS |
------------------------------------------------------------------------------
Variables Set In One Test Are Not Visible In Another | PASS |
------------------------------------------------------------------------------
...les Set In User Keyword Are Seen Only By Lower Level User Keywords | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Scopes :: These tests are somewhat relate... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Robot.Variables.Variable Table
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
List With One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List Created From List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Assign Mark With Scalar Variable | PASS |
------------------------------------------------------------------------------
Assign Mark With List Variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variable Table | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Resource Files
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
List with One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List Created From List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Assign Mark With Scalar variable | PASS |
------------------------------------------------------------------------------
Assign Mark With List variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables From Resource Files | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Variable Files
==============================================================================
Scalar String | PASS |
------------------------------------------------------------------------------
Scalar Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar String With Escapes | PASS |
------------------------------------------------------------------------------
Empty Scalar String | PASS |
------------------------------------------------------------------------------
Scalar List | PASS |
------------------------------------------------------------------------------
Scalar List With Non-Strings | PASS |
------------------------------------------------------------------------------
Scalar List With Escapes | PASS |
------------------------------------------------------------------------------
Scalar Object | PASS |
------------------------------------------------------------------------------
List with One Item | PASS |
------------------------------------------------------------------------------
List With Multiple Items | PASS |
------------------------------------------------------------------------------
List With Escapes | PASS |
------------------------------------------------------------------------------
List With No Items | PASS |
------------------------------------------------------------------------------
List With Objects | PASS |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable | PASS |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive | PASS |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables From Variable Files | PASS |
16 critical tests, 16 passed, 0 failed
16 tests total, 16 passed, 0 failed
==============================================================================
Robot.Variables.Variables In Import Settings
==============================================================================
Variable Defined In Test Case File Is Used To Import Resources | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables In Import Settings | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Robot.Variables.Variables Inside Variables
==============================================================================
Variable Inside Variable In Variable Table | PASS |
------------------------------------------------------------------------------
Variable Inside Variable In Test Case | PASS |
------------------------------------------------------------------------------
Variable Inside Variable In User Keyword | PASS |
------------------------------------------------------------------------------
Variable Inside List Variable | PASS |
------------------------------------------------------------------------------
Variable Inside List Variable Index | PASS |
------------------------------------------------------------------------------
Variable Inside Variable And Extended Variable Syntax | PASS |
------------------------------------------------------------------------------
Non-Existing Variable Inside Variable | PASS |
------------------------------------------------------------------------------
Robot.Variables.Variables Inside Variables | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Robot.Variables | PASS |
156 critical tests, 156 passed, 0 failed
156 tests total, 156 passed, 0 failed
==============================================================================
Robot :: Robot Framework acceptance tests | FAIL |
2107 critical tests, 2104 passed, 3 failed
2223 tests total, 2104 passed, 119 failed
==============================================================================
Output:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFramework/ws/atest/results/output.xml>
Log:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFramework/ws/atest/results/log.html>
Report:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFramework/ws/atest/results/report.html>
XUnit:
<http://robot.radiaatto.ri.fi/hudson/job/RobotFramework/ws/atest/results/xunit.xml>
Robot results publisher started...
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
