See <http://robot.radiaatto.ri.fi/job/RobotFramework/3210/changes>
Changes: [Pekka Klärck] Automated merge with https://code.google.com/p/robotframework/ [Pekka Klärck] run/rebot: validate that given arguments exist to provide better error message in common usage errors Update issue 1184 Status: Review Owner: pekka.klarck Cc: mikko.korpela Error reporting with Robot and Rebot was enhanced by verifying that given arguments exist and giving warning like this about all failed arguments: [ WARN ] Arguments 'foo', '--log', 'loki.html', '--report' and 'raportti.html' did not exist and were ignored. Validate the used command line syntax. This new argument validation is done only when one or more argument is given on purpose or by accident. Thus the behavior has not changed if you mess up your only argument somehow. Mikko, do you think this new system is good enough? [Pekka Klärck] small atest fix and cleanup [Mikko Korpela <[email protected]>] proto/parallel: partial fix ------------------------------------------ [...truncated 7088 lines...] Test Name In Setup | PASS | ------------------------------------------------------------------------------ Test Tags | PASS | ------------------------------------------------------------------------------ Test Status Should Not Exist Outside Teardown | PASS | ------------------------------------------------------------------------------ Test Message Should Not Exist Outside Teardown | PASS | ------------------------------------------------------------------------------ Test Status When Test Fails | PASS | ------------------------------------------------------------------------------ Test Status When Setup Fails | PASS | ------------------------------------------------------------------------------ Previous Test Variables Should Have Correct Values When That Test ... | PASS | ------------------------------------------------------------------------------ Previous Test Variables Should Have Default Values From Previous S... | PASS | ------------------------------------------------------------------------------ Suite And Prev Test Variables Work Correctly In Setup | PASS | ------------------------------------------------------------------------------ Suite And Prev Test Variables Work Correctly In Teardown | PASS | ------------------------------------------------------------------------------ Suite Variables In Test | PASS | ------------------------------------------------------------------------------ Robot.Variables.Test And Suite Status Variables | PASS | 13 critical tests, 13 passed, 0 failed 13 tests total, 13 passed, 0 failed ============================================================================== Robot.Variables.Variable File Implemented As Class ============================================================================== Python Class | PASS | ------------------------------------------------------------------------------ Methods in Python Class Do Not Create Variables | PASS | ------------------------------------------------------------------------------ Properties in Python Class | PASS | ------------------------------------------------------------------------------ Dynamic Python Class | PASS | ------------------------------------------------------------------------------ Instantiating Fails | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variable File Implemented As Class | PASS | 5 critical tests, 5 passed, 0 failed 5 tests total, 5 passed, 0 failed ============================================================================== Robot.Variables.Variable Priorities :: Some of these tests are testing same... ============================================================================== Individual CLI Variables Override All Other Variables | PASS | ------------------------------------------------------------------------------ Variable Files From CLI Override All Variables In Test Data | PASS | ------------------------------------------------------------------------------ When Multiple Variable Files Are Given From CLI The First One Has ... | PASS | ------------------------------------------------------------------------------ Variable Tables In test Case Files Override Variables From Resourc... | PASS | ------------------------------------------------------------------------------ Variable Tables In Resource Files Override Variables From Resource... | PASS | ------------------------------------------------------------------------------ When Multiple Resource Or Variable Files Are Imported The First On... | PASS | ------------------------------------------------------------------------------ Variables With Different Priorities Are Seen Also In User Keywords | PASS | ------------------------------------------------------------------------------ Variables Set During Test Execution Override All Variables In Thei... | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variable Priorities :: Some of these tests are tes... | PASS | 8 critical tests, 8 passed, 0 failed 8 tests total, 8 passed, 0 failed ============================================================================== Robot.Variables.Variable Scopes :: These tests are somewhat related to test... ============================================================================== Variables Set In Test Case Are Seen By User Keywords | PASS | ------------------------------------------------------------------------------ Variables Set In One Test Are Not Visible In Another | PASS | ------------------------------------------------------------------------------ Variables Set In User Keyword Are Seen Only By Lower Level User Ke... | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variable Scopes :: These tests are somewhat relate... | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Robot.Variables.Variable Table ============================================================================== Scalar String | PASS | ------------------------------------------------------------------------------ Scalar Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar String With Escapes | PASS | ------------------------------------------------------------------------------ Empty Scalar String | PASS | ------------------------------------------------------------------------------ Scalar List | PASS | ------------------------------------------------------------------------------ Scalar List With Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar List With Escapes | PASS | ------------------------------------------------------------------------------ List With One Item | PASS | ------------------------------------------------------------------------------ List With Multiple Items | PASS | ------------------------------------------------------------------------------ List With Escapes | PASS | ------------------------------------------------------------------------------ List Created From List With Escapes | PASS | ------------------------------------------------------------------------------ List With No Items | PASS | ------------------------------------------------------------------------------ Scalar Variable Containing List Is Different Than List Variable | PASS | ------------------------------------------------------------------------------ Variable Names Are Case Insensitive | PASS | ------------------------------------------------------------------------------ Variable Names Are Space Insensitive | PASS | ------------------------------------------------------------------------------ Variable Names Are Underscore Insensitive | PASS | ------------------------------------------------------------------------------ Assign Mark With Scalar Variable | PASS | ------------------------------------------------------------------------------ Assign Mark With List Variable | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variable Table | PASS | 18 critical tests, 18 passed, 0 failed 18 tests total, 18 passed, 0 failed ============================================================================== Robot.Variables.Variables From Resource Files ============================================================================== Scalar String | PASS | ------------------------------------------------------------------------------ Scalar Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar String With Escapes | PASS | ------------------------------------------------------------------------------ Empty Scalar String | PASS | ------------------------------------------------------------------------------ Scalar List | PASS | ------------------------------------------------------------------------------ Scalar List With Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar List With Escapes | PASS | ------------------------------------------------------------------------------ List with One Item | PASS | ------------------------------------------------------------------------------ List With Multiple Items | PASS | ------------------------------------------------------------------------------ List With Escapes | PASS | ------------------------------------------------------------------------------ List Created From List With Escapes | PASS | ------------------------------------------------------------------------------ List With No Items | PASS | ------------------------------------------------------------------------------ Scalar Variable Containing List Is Different Than List Variable | PASS | ------------------------------------------------------------------------------ Variable Names Are Case Insensitive | PASS | ------------------------------------------------------------------------------ Variable Names Are Space Insensitive | PASS | ------------------------------------------------------------------------------ Variable Names Are Underscore Insensitive | PASS | ------------------------------------------------------------------------------ Assign Mark With Scalar variable | PASS | ------------------------------------------------------------------------------ Assign Mark With List variable | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variables From Resource Files | PASS | 18 critical tests, 18 passed, 0 failed 18 tests total, 18 passed, 0 failed ============================================================================== Robot.Variables.Variables From Variable Files ============================================================================== Scalar String | PASS | ------------------------------------------------------------------------------ Scalar Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar String With Escapes | PASS | ------------------------------------------------------------------------------ Empty Scalar String | PASS | ------------------------------------------------------------------------------ Scalar List | PASS | ------------------------------------------------------------------------------ Scalar List With Non-Strings | PASS | ------------------------------------------------------------------------------ Scalar List With Escapes | PASS | ------------------------------------------------------------------------------ Scalar Object | PASS | ------------------------------------------------------------------------------ List with One Item | PASS | ------------------------------------------------------------------------------ List With Multiple Items | PASS | ------------------------------------------------------------------------------ List With Escapes | PASS | ------------------------------------------------------------------------------ List With No Items | PASS | ------------------------------------------------------------------------------ List With Objects | PASS | ------------------------------------------------------------------------------ Scalar Variable Containing List Is Different Than List Variable | PASS | ------------------------------------------------------------------------------ Variable Names Are Case Insensitive | PASS | ------------------------------------------------------------------------------ Variable Names Are Underscore Insensitive | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variables From Variable Files | PASS | 16 critical tests, 16 passed, 0 failed 16 tests total, 16 passed, 0 failed ============================================================================== Robot.Variables.Variables In Import Settings ============================================================================== Variable Defined In Test Case File Is Used To Import Resources | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variables In Import Settings | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Robot.Variables.Variables Inside Variables ============================================================================== Variable Inside Variable In Variable Table | PASS | ------------------------------------------------------------------------------ Variable Inside Variable In Test Case | PASS | ------------------------------------------------------------------------------ Variable Inside Variable In User Keyword | PASS | ------------------------------------------------------------------------------ Variable Inside List Variable | PASS | ------------------------------------------------------------------------------ Variable Inside List Variable Index | PASS | ------------------------------------------------------------------------------ Variable Inside Variable And Extended Variable Syntax | PASS | ------------------------------------------------------------------------------ Non-Existing Variable Inside Variable | PASS | ------------------------------------------------------------------------------ Robot.Variables.Variables Inside Variables | PASS | 7 critical tests, 7 passed, 0 failed 7 tests total, 7 passed, 0 failed ============================================================================== Robot.Variables | PASS | 183 critical tests, 183 passed, 0 failed 183 tests total, 183 passed, 0 failed ============================================================================== Robot :: Robot Framework acceptance tests | FAIL | 2525 critical tests, 2524 passed, 1 failed 2560 tests total, 2524 passed, 36 failed ============================================================================== Output: <http://robot.radiaatto.ri.fi/job/RobotFramework/ws/atest/results/output.xml> XUnit: <http://robot.radiaatto.ri.fi/job/RobotFramework/ws/atest/results/xunit.xml> Log: <http://robot.radiaatto.ri.fi/job/RobotFramework/ws/atest/results/log.html> Report: <http://robot.radiaatto.ri.fi/job/RobotFramework/ws/atest/results/report.html> Build step 'Execute shell' marked build as failure Robot results publisher started... -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results.
