See <http://robot.radiaatto.ri.fi/job/RobotFramework-Jython/1949/changes>
Changes:
[Pekka Klärck] new run: handle keyword teardowns (in pretty ugly manner)
[Pekka Klärck] new run: handle variables in tags and issue warning if an
executed suite has multiple tests with same name
now 90% of tests pass with new run!
[Pekka Klärck] Added '.' at the end of warning about executing same test
multiple times. Also changed format of the related tests.
[Pekka Klärck] made tests related to automatic variables independent on suite
metadata string repr
[Pekka Klärck] new run: fixed handling deprecated '3x Kw Name' syntax
This was broken after changing args from lists to tuples.
[Pekka Klärck] new run: fixed handling suite metadata
[Pekka Klärck] new run: randomizing suites/tests
[Pekka Klärck] new run: criticality
[Pekka Klärck] new run: support disabling setup/teardown with NONE
[Pekka Klärck] new run: support for templates
[Pekka Klärck] model and result building: Changed arguments to be tuples, not
lists.
New run model already build args as tuples, but empty tuples were turned
into empty lists behind the scenes. Now the API is consistent.
The change saves memory on result building because empty tuples are
singletons and thus take a lot less memory than empty lists. Small
tuples also take less memory than small lists in general.
Building results was changed from `args.append('arg')` to `args += ('arg',)`.
Because the number of args is small, there is no performance penalty.
I tested processing output originating from running Robot's acceptance
tests both before and after the change. This confirmed that a little
memory was saved (155MB->150MB) and performance was the same. With
results containing lot of keywords memory savings could be bigger.
[Pekka Klärck] new run: build setups/teardowns as any other keyword. requires
API compatibility changes also to parsing.
[Pekka Klärck] new run: fixed import in init files
[Pekka Klärck] new run: tuning setting status and message
------------------------------------------
[...truncated 8842 lines...]
==============================================================================
${SUITE SOURCE} in dir suite |
[32mPASS [0m |
------------------------------------------------------------------------------
${SUITE SOURCE} in file suite |
[32mPASS [0m |
------------------------------------------------------------------------------
${SUITE SOURCE} in user keyword |
[32mPASS [0m |
------------------------------------------------------------------------------
${SUITE SOURCE} in resource file |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Suite Source |
[32mPASS [0m |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Robot.Variables.Variable File Implemented As Class
==============================================================================
Python Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Methods in Python Class Do Not Create Variables |
[32mPASS [0m |
------------------------------------------------------------------------------
Properties in Python Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Dynamic Python Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Java Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Methods in Java Class Do Not Create Variables |
[32mPASS [0m |
------------------------------------------------------------------------------
Properties in Java Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Dynamic Java Class |
[32mPASS [0m |
------------------------------------------------------------------------------
Instantiating Fails |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variable File Implemented As Class |
[32mPASS [0m |
9 critical tests, 9 passed, 0 failed
9 tests total, 9 passed, 0 failed
==============================================================================
Robot.Variables.Variable Priorities :: Some of these tests are testing same...
==============================================================================
Individual CLI Variables Override All Other Variables |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Files From CLI Override All Variables In Test Data |
[32mPASS [0m |
------------------------------------------------------------------------------
When Multiple Variable Files Are Given From CLI The First One Has ... |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Tables In test Case Files Override Variables From Resourc... |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Tables In Resource Files Override Variables From Resource... |
[32mPASS [0m |
------------------------------------------------------------------------------
When Multiple Resource Or Variable Files Are Imported The First On... |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables With Different Priorities Are Seen Also In User Keywords |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables Set During Test Execution Override All Variables In Thei... |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variable Priorities :: Some of these tests are tes... |
[32mPASS [0m |
8 critical tests, 8 passed, 0 failed
8 tests total, 8 passed, 0 failed
==============================================================================
Robot.Variables.Variable Scopes :: These tests are somewhat related to test...
==============================================================================
Variables Set In Test Case Are Seen By User Keywords |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables Set In One Test Are Not Visible In Another |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables Set In User Keyword Are Seen Only By Lower Level User Ke... |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variable Scopes :: These tests are somewhat relate... |
[32mPASS [0m |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Robot.Variables.Variable Table
==============================================================================
Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Non-Strings |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar String With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
Empty Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
List With One Item |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Multiple Items |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List Created From List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List With No Items |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Assign Mark With Scalar Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Assign Mark With List Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Three dots on the same line should be interpreted as string |
[32mPASS [0m |
------------------------------------------------------------------------------
Using Scalar List Should Fail |
[32mPASS [0m |
------------------------------------------------------------------------------
Creating variable using non-existing variable fails |
[32mPASS [0m |
------------------------------------------------------------------------------
Using variable created from non-existing variable in imports fails |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variable Table |
[32mPASS [0m |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Resource Files
==============================================================================
Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Non-Strings |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar String With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
Empty Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List With Non-Strings |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List with One Item |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Multiple Items |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List Created From List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List With No Items |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Space Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Assign Mark With Scalar variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Assign Mark With List variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables From Resource Files Can Be Used In Local Variable Table |
[32mPASS [0m |
------------------------------------------------------------------------------
Imported Resource Can Use Variables From Resources It Imports In I... |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variables From Resource Files |
[32mPASS [0m |
20 critical tests, 20 passed, 0 failed
20 tests total, 20 passed, 0 failed
==============================================================================
Robot.Variables.Variables From Variable Files
==============================================================================
Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Non-Strings |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar String With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
Empty Scalar String |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List With Non-Strings |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Object |
[32mPASS [0m |
------------------------------------------------------------------------------
List with One Item |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Multiple Items |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Escapes |
[32mPASS [0m |
------------------------------------------------------------------------------
List With No Items |
[32mPASS [0m |
------------------------------------------------------------------------------
List With Objects |
[32mPASS [0m |
------------------------------------------------------------------------------
Scalar Variable Containing List Is Different Than List Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Case Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Names Are Underscore Insensitive |
[32mPASS [0m |
------------------------------------------------------------------------------
Variables From Variable Files Can Be Used In Local Variable Table |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variables From Variable Files |
[32mPASS [0m |
17 critical tests, 17 passed, 0 failed
17 tests total, 17 passed, 0 failed
==============================================================================
Robot.Variables.Variables In Import Settings
==============================================================================
Variable Defined In Test Case File Is Used To Import Resources |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variables In Import Settings |
[32mPASS [0m |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Robot.Variables.Variables Inside Variables
==============================================================================
Variable Inside Variable In Variable Table |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Inside Variable In Test Case |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Inside Variable In User Keyword |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Inside List Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Inside List Variable Index |
[32mPASS [0m |
------------------------------------------------------------------------------
Variable Inside Variable And Extended Variable Syntax |
[32mPASS [0m |
------------------------------------------------------------------------------
Non-Existing Variable Inside Variable |
[32mPASS [0m |
------------------------------------------------------------------------------
Robot.Variables.Variables Inside Variables |
[32mPASS [0m |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Robot.Variables |
[32mPASS [0m |
215 critical tests, 215 passed, 0 failed
215 tests total, 215 passed, 0 failed
==============================================================================
Robot :: Robot Framework acceptance tests |
[31mFAIL [0m |
3113 critical tests, 3097 passed, 16 failed
3198 tests total, 3100 passed, 98 failed
==============================================================================
Output:
<http://robot.radiaatto.ri.fi/job/RobotFramework-Jython/ws/atest/results/jython/output.xml>
Log:
<http://robot.radiaatto.ri.fi/job/RobotFramework-Jython/ws/atest/results/jython/log.html>
Report:
<http://robot.radiaatto.ri.fi/job/RobotFramework-Jython/ws/atest/results/jython/report.html>
Build step 'Execute shell' marked build as failure
Robot results publisher started...
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
--
---
You received this message because you are subscribed to the Google Groups
"robotframework-commit" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to robotframework-commit+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
