We are amped to announce the release of: sahara-tests 0.3.0: Sahara tests
With source available at: https://git.openstack.org/cgit/openstack/sahara-tests For more details, please see below. 0.3.0 ^^^^^ Added ability to use clouds.yaml with scenario tests Client tests have been imported from the Sahara repository. Migrate sahara cli tests from saharaclient to sahara-tests Yaml-files for deprecated plugins was removed Tests no longer depend on fake plugin to run Sahara Tests plugin now uses tempest stable interface New Features ************ * User can now use clouds.yaml in the format defined by os-client- config to specify the auth values wanted on a scenario test. * The tests for the official Python clients have been moved here from the Sahara repository. They are based on the Tempest libraries even they do not follow the Tempest guidelines (as they need to test the Python clients, they do not use the native Tempest clients). Upgrade Notes ************* * Migration from novaclient.v2.images to glanceclient Bug Fixes ********* * Removed yaml-files for Kilo release * Removed unused yaml-files for master branch Other Notes *********** * Adapt Sahara Tests code to stop relying only on the fake plugin and use the default plugin available. However, it's worth noting that - if available - the fake plugin will be used. * Sahara Tests plugin is adapted to use in-tree client, which was migrated from Tempest code. Also, there's a new stable interface for Service Clients in Tempest, so this change adapts the code to use it. Changes in sahara-tests 0.2.0..0.3.0 ------------------------------------ 4ebba66 Added folder with defaults for newton 44a4503 Temporarily skip test_cluster_cli to avoid timeouts 026e612 Fix creation of ng with proxy node 883a09f Fix the network settings of the templates 1670a25 Fixed unit tests in sahara scenario d70d4cc Use default plugin instead of fake f844235 define output datasource for spark wordcount a0314ad Trivial: delete openstack/common in flake8 exclude list e91f1f2 Moving hdfs_username to cluster configuration 881409e add impl of SparkWordCount example b25514b Added cli-tests for job template 2378cae Add image clean up to test_cluster_cli 9a93de6 Added verification of cluster to scenario-framework 5ed393d Added cli tests for data sources eee440c Fix using additional parameters in 'credentials' ed3a540 Added cli tests for job binary 4accb7d Remove hardcoded config values in CLI tests 60d35c6 Test fix for CLI tests 6459b15 Update home-page 4f320f6 Added tests for job types 59ae23b Adding link on documentation in README c614216 TrivialFix: Remove logging import unused 0d41475 Add MapR 520 test 6a2b026 Adapt plugin to use new tempest stable interface 501c3ed Use session to create Sahara Client in tests 288d963 Update tests for plugin, cluster and image 0169a4f Trivial: Replace 'assertTrue(a in b)' with 'assertIn(a, b)' 560c3c5 Add Spark WordCount job for Vanilla Plugin 0d4db58 fix bug: skipException() instead of SkipException() f32eb1e Fix tempest.conf generation 8fd39dc Remove the deprecated access to Exception message a38f750 Removed 'scenario' section from ambari scenarios 66dc1c0 Migrate the imported client tests to the Tempest plugin 77fa63e New Pig example with a User Defined Function d5e565d Correct place for the imported Tempest client bc969cd Added the possibility to set auto_security_group par to False 4d5cb98 Service client modules in various services __init__ dd7d457 Make data_processing/baremetal use rest_client 8d91e32 Fix H404/405 violations for service clients 49c6c59 Full response for DataProcessingClient methods e354df9 Switch all uses of json to oslo_serialization b473dce Remove CONF values from data_processing client 8eb3310 Rename data_processing client e7bef91 Change data_processing client to return one value and update tests e5b5321 Remove all CONF values from RestClient c651538 Move _get_region() to NegativeRestClient d853750 Remove _get_endpoint_type() from RestClient 3a64b4e Separate build_interval/timeout from RestClient 0e283b5 Sahara: preparations for job tests 2cc7cfd Add client response checking for data processing service 894ded5 Sahara: preparations for job binary tests 8485358 Sahara: add API tests for job binary internals fbe51d0 Sahara: preparations for job binary internal tests f2c685a Sahara: editing licenses 407a266 Sahara: preparations for data source tests 07825b7 Sahara: preparations for new tests 9c3f914 Savanna: add API client and tests for plugins 9c940b0 Multiversion authentication part1 4f32f83 Convert all service clients to global CONF object 395d077 Add Savanna client for node group templates d01f168 Check if resources are really deleted in api tests dfbe9f9 Fix CDH 5.7.0 template 62d8842 Strengthen the permission for the generated ssh key 57a6616 embedded jars: replace spark-example.jar 35173b3 Added ability to use clouds.yaml with scenario tests 12872a5 Move CLI tests under sahara_tempest_plugin cd2d236 Improve documentation 1409bc4 Ubuntu 16.04 cloud image for the fake plugin testing f2e3c31 fix storm template 33bc238 Add unit-tests for runner.py 78ef51c Removing not existing dir from coveragerc 171c0c4 Fix coverage test by setting the analyzed directory c575ee4 Update README d3d64f4 Move auto_security_group to page args 1e82a40 Update README b3356ba Migrate tests with tempest-lib to tempest 3b9cb59 Remove unused yaml files b2a3190 Adding ability to run transient cluster in gate 2daa3f1 Added ability to use auth env variables or flags 105eb5d Added tests for "cluster template" and "cluster" commands for Sahara CLI 57d2c10 Added page args for transient mode for fake plugin 0620b5a Fix for uploading image in sahara_cli tests 30bf03c Moved floating ip on Cloudera Manager 77412d2 Created yaml-file for storm plugin a9061b8 Added README for Sahara CLI tests 87bae85 Remove unecessary decorators from private interface f4db822 update options mentioned in tempest readme f82c7db Use the integrated tempest.lib module 85ce728 Replacing all hard coded cluster status using cluster_utils 0abdc18 Add missed checks for testing update method 80bfb9a Adding tests for checking updating of templates 2e68007 Fix tempest tests 4f116d0 Fix of client tests in tempest 512b207 Adapt python client tests to use Tempest plugin interface a356fc3 Python client tests: access to credentials/net clients 5fc4c51 Set up network client for tempest client tests b5ae7bd Fix order of arguments in assertEqual - Part1 9d62e63 Fix log import error in tempest tests for Sahara 0db1e94 Change imports after moving tempest common code ce39d65 Skip job_execution tempest client test e31343f Fix tempest tests for Sahara 375e070 Fix tempest client tests in Sahara dd2d383 Using oslo_* instead of oslo.* 08f6043 Fix getting not registered images d758afd Saharaclient tests for tempest 5606480 Added tests with "node group" commands for Sahara CLI 51ebc59 Tests for Sahara CLI client. 3da2e19 fix test and adding empty pre_test_hook 5c6a853 Removed unused dir 9ad7973 Add CDH 5.7.0 scenario test e8d032e Migrate "post_test_hook" from sahara-client to sahara-tests 83bc8b3 Migrate functional tests to openstack-client e38ae68 Replace tempest_lib with tempest.lib 9001b96 Deprecation of the Sahara CLI a6ddbc2 Fix functional tests in gate b270548 Fix functional tests in saharaclient 2fdd6ff Add post_test_hook for functional tests 1755d70 Copy functional tests from tempest CLI 4e6dcee novaclient.v2.images to glanceclient migration 28c9bb0 Temporary disable check kafka tests 354fafd Update name for ambari_2.4 template 77559ef [HDP 2.4] Added yaml file Diffstat (except docs and test files) ------------------------------------- .coveragerc | 1 - README.rst | 4 +- etc/scenario/gate/credentials.yaml.mako | 6 - etc/scenario/gate/edp.yaml.mako | 6 +- etc/scenario/gate/fake.yaml.mako | 7 +- etc/scenario/simple-testcase.yaml | 6 - ...bility-to-use-clouds-yaml-5f66a2c3959f894b.yaml | 7 + ...nt_images_to_glanceclient-9f8351330147f770.yaml | 3 + .../remove-old-yaml-files-97ecb4a11582f033.yaml | 6 + .../support-non-fake-plugin-a4ba718b787246e8.yaml | 8 + ...-tempest-stable-interface-aefdfd8f81361dc8.yaml | 8 + requirements.txt | 4 +- sahara_tempest_plugin/clients.py | 30 + sahara_tempest_plugin/common/__init__.py | 0 sahara_tempest_plugin/common/plugin_utils.py | 318 ++++++++++ sahara_tempest_plugin/config.py | 31 + sahara_tempest_plugin/plugin.py | 42 +- sahara_tempest_plugin/services/__init__.py | 0 .../services/data_processing/__init__.py | 0 .../services/data_processing/v1_1/__init__.py | 18 + .../data_processing/v1_1/data_processing_client.py | 280 +++++++++ .../scenario/defaults/ambari-2.3.yaml.mako | 15 +- .../scenario/defaults/ambari-2.4.yaml.mako | 67 +++ .../scenario/defaults/credentials.yaml.mako | 6 - .../edp-examples/edp-pig/cleanup-string/README.rst | 35 ++ .../edp-pig/cleanup-string/data/expected_output | 3 + .../edp-examples/edp-pig/cleanup-string/data/input | 3 + .../cleanup-string/edp-pig-udf-stringcleaner.jar | Bin 0 -> 1539 bytes .../edp-pig/cleanup-string/example.pig | 3 + .../edp-pig/cleanup-string/src/StringCleaner.java | 25 + .../edp-examples/edp-pig/trim-spaces/README.rst | 11 - .../edp-examples/edp-pig/trim-spaces/example.pig | 3 - .../edp-examples/edp-pig/trim-spaces/udf.jar | Bin 1526 -> 0 bytes .../edp-examples/edp-spark/spark-example.jar | Bin 4268 -> 0 bytes .../defaults/edp-examples/edp-spark/spark-pi.py | 39 ++ .../edp-examples/edp-spark/spark-wordcount.jar | Bin 28997 -> 6900 bytes .../edp-examples/edp-spark/wordcountapp/pom.xml | 61 ++ .../scala/sahara/edp/spark/SparkWordCount.scala | 38 ++ .../edp-examples/json-api-examples/v1.1/README.rst | 12 +- .../v1.1/data-sources/create.swift-pig-input.json | 2 +- .../v1.1/data-sources/create.swift-pig-output.json | 2 +- .../v1.1/job-binaries/create.pig-job.json | 2 +- .../v1.1/job-binaries/create.pig-udf.json | 4 +- .../scenario/defaults/kilo/cdh-5.3.0.yaml.mako | 75 --- .../scenario/defaults/kilo/hdp-1.3.2.yaml.mako | 43 -- .../scenario/defaults/kilo/hdp-2.0.6.yaml.mako | 54 -- .../scenario/defaults/kilo/spark-1.0.0.yaml.mako | 33 -- .../scenario/defaults/kilo/vanilla-1.2.1.yaml.mako | 76 --- .../scenario/defaults/kilo/vanilla-2.6.0.yaml.mako | 90 --- .../scenario/defaults/liberty/ambari-2.3.yaml.mako | 10 +- .../scenario/defaults/liberty/cdh-5.4.0.yaml.mako | 16 +- .../scenario/defaults/liberty/fake.yaml.mako | 6 +- .../scenario/defaults/liberty/hdp-2.0.6.yaml.mako | 54 ++ .../defaults/liberty/mapr-5.0.0.mrv2.yaml.mako | 8 +- .../defaults/liberty/spark-1.3.1.yaml.mako | 6 +- .../scenario/defaults/liberty/transient.yaml.mako | 6 +- .../defaults/liberty/vanilla-2.7.1.yaml.mako | 14 +- .../scenario/defaults/mapr-4.0.2.mrv2.yaml.mako | 50 -- .../scenario/defaults/mapr-5.0.0.mrv2.yaml.mako | 8 +- .../scenario/defaults/mapr-5.1.0.mrv2.yaml.mako | 8 +- .../scenario/defaults/mapr-5.2.0.mrv2.yaml.mako | 54 ++ .../scenario/defaults/mitaka/ambari-2.3.yaml.mako | 10 +- .../scenario/defaults/mitaka/cdh-5.5.0.yaml.mako | 16 +- .../scenario/defaults/mitaka/fake.yaml.mako | 6 +- .../defaults/mitaka/mapr-5.0.0.mrv2.yaml.mako | 8 +- .../defaults/mitaka/mapr-5.1.0.mrv2.yaml.mako | 8 +- .../scenario/defaults/mitaka/spark-1.3.1.yaml.mako | 6 +- .../scenario/defaults/mitaka/spark-1.6.0.yaml.mako | 6 +- .../scenario/defaults/mitaka/transient.yaml.mako | 6 +- .../defaults/mitaka/vanilla-2.7.1.yaml.mako | 14 +- .../scenario/defaults/newton/ambari-2.4.yaml.mako | 67 +++ .../scenario/defaults/newton/cdh-5.7.0.yaml.mako | 90 +++ .../defaults/newton/mapr-5.1.0.mrv2.yaml.mako | 54 ++ .../defaults/newton/mapr-5.2.0.mrv2.yaml.mako | 54 ++ .../scenario/defaults/newton/spark-1.6.0.yaml.mako | 37 ++ .../scenario/defaults/newton/storm-1.0.1.yaml.mako | 37 ++ .../defaults/newton/vanilla-2.7.1.yaml.mako | 81 +++ .../scenario/defaults/spark-1.0.0.yaml.mako | 33 -- .../scenario/defaults/spark-1.3.1.yaml.mako | 6 +- .../scenario/defaults/spark-1.6.0.yaml.mako | 6 +- .../scenario/defaults/storm-1.0.1.yaml.mako | 37 ++ .../scenario/defaults/vanilla-1.2.1.yaml.mako | 76 --- .../scenario/defaults/vanilla-2.6.0.yaml.mako | 90 --- .../scenario/defaults/vanilla-2.7.1.yaml.mako | 20 +- .../unit/scenario/templatevars_complete.ini | 6 +- .../unit/scenario/templatevars_incomplete.ini | 4 - .../unit/scenario/templatevars_nodefault.ini | 4 - setup.cfg | 2 +- tools/cover.sh | 14 +- tools/gate/scenario/commons | 4 + tools/gate/scenario/post_test_hook.sh | 12 +- tools/gate/scenario/pre_test_hook.sh | 6 +- tools/gate/scenario/settings | 8 +- tox.ini | 8 +- 158 files changed, 5236 insertions(+), 1933 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 0bda827..52d0060 100644 --- a/requirements.txt +++ b/requirements.txt @@ -14,0 +15 @@ oslotest>=1.10.0 # Apache-2.0 +os-client-config>=1.13.1 # Apache-2.0 @@ -16,0 +18 @@ paramiko>=1.16.0 # LGPL +python-glanceclient>=2.0.0 # Apache-2.0 @@ -23 +25 @@ six>=1.9.0 # MIT -tempest-lib>=0.14.0 # Apache-2.0 +tempest>=12.2.0 # Apache-2.0 __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev