Hello,
I am seeing odd behavior with Jenkins CI for the patch:
https://review.openstack.org/180019
A quick background:
1. I could see all the tests passing on my virtual box and have attached
the logs for your ready reference.
2. Whereas in Jenkins, I could see the different behavior which is not
reproducible on my virtual box. I have tried the following to make it
succeed.
(a) 'recheck' comment - Jenkins reported unhappy.
(b) restacked my devstack instance on my vm and run 'tox -e tempest', it
succeeds on virtual box, but not for Jenkins.
Not sure of the exact problem though, but would like to have community help
on the same.
Thanks!
Madhu
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
git commit --amend
[review/madhusudhan_kandadai/pools_admin_ddt_tests acba386] Tempest tests using
testscenarios for create/update pool
Author: Ubuntu <madhusudhan.openst...@gmail.com>
1 file changed, 169 insertions(+)
create mode 100644
neutron_lbaas/tests/tempest/v2/scenario/test_pools_admin_state.py
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
git review
remote: Resolving deltas: 100% (5/5)
remote: Processing changes: updated: 1, refs: 1, done
remote:
remote: Updated Changes:
remote: https://review.openstack.org/180019 Tempest tests using testscenarios
for create/update pool
remote:
To
ssh://madhusudhan-kanda...@review.openstack.org:29418/openstack/neutron-lbaas.git
* [new branch] HEAD -> refs/publish/master/pools_admin_ddt_tests
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$
tox -e tempest
tempest develop-inst-nodeps: /opt/stack/neutron-lbaas
tempest runtests: PYTHONHASHSEED='3706390691'
tempest runtests: commands[0] | sh tools/pretty_tox.sh
running testr
running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1}
OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} OS_LOG_CAPTURE=${OS_LOG_CAPTURE:-1}
${PYTHON:-python} -m subunit.run discover -t ./
${OS_TEST_PATH:-./neutron_lbaas/tests/unit}
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_create_health_monitor
[11.086096s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_create_health_monitor_extra_attribute
[0.013065s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_create_health_monitor_invalid_attribute
[0.033716s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_create_health_monitor_missing_attribute
[0.020612s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_delete_health_monitor
[10.916318s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_get_health_monitor
[11.037575s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_list_health_monitors_empty
[0.062835s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_list_health_monitors_one
[10.991776s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_list_health_monitors_two
[44.915230s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_udpate_health_monitor_invalid_attribute
[10.893886s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_update_health_monitor
[21.516263s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_update_health_monitor_extra_attribute
[11.019241s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener
[11.068447s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_admin_state_up
[0.123651s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_connection_limit
[0.163494s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_description
[11.030286s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_load_balancer_id
[0.127011s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_name
[11.307731s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_protocol
[0.116693s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_protocol_port
[0.092309s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_empty_tenant_id
[0.094332s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_incorrect_attribute
[0.087970s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_admin_state_up
[0.085526s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_connection_limit
[0.088063s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_description
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_load_balancer_id
[0.094772s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_name
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_protocol
[0.121459s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_protocol_port
[0.092034s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_invalid_tenant_id
[0.098116s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_missing_admin_state_up
[11.179978s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_missing_field_loadbalancer
[0.222242s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_missing_field_protocol
[0.229247s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_create_listener_missing_field_protocol_port
[0.213649s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_delete_listener
[11.306885s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_get_listener
[0.166007s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_list_listeners
[0.139346s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_list_listeners_two
[11.065927s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener
[11.004654s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_empty_admin_state_up
[0.086417s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_empty_connection_limit
[0.086580s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_empty_description
[11.061832s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_empty_name
[10.663355s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_empty_tenant_id
[0.080020s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_incorrect_attribute
[0.093714s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_invalid_admin_state_up
[0.083988s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_invalid_connection_limit
[0.087887s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_invalid_description
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_invalid_name
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_invalid_tenant_id
[0.168058s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_missing_admin_state_up
[10.752892s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_missing_connection_limit
[10.811559s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_missing_description
[10.933215s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_listeners.ListenersTestJSON.test_update_listener_missing_name
[10.846424s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_tenant_id_field
[0.816632s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_admin.LoadBalancersTestJSON.test_create_load_balancer_for_another_tenant
[0.640490s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_tenant_id_field_for_admin
[0.614730s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_tenant_id_for_other_tenant
[0.461520s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer
[0.816734s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_admin_state_up_field
[0.008969s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_description_field
[0.933730s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_name
[0.753785s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_provider_field
[0.015910s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_tenant_id_field
[0.009164s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_vip_address_field
[0.009542s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_empty_vip_subnet_id
[0.010016s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_incorrect_attribute
[0.007289s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_invalid_description
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_invalid_name
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_invalid_tenant_id
[0.009482s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_invalid_vip_subnet_id
[0.008394s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_admin_state_up
[0.764475s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_description
[0.584089s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_name
[0.488519s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_provider_field
[0.655639s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_tenant_id_field
[0.772870s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_vip_address
[0.640980s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_missing_vip_subnet_id_field
[0.008994s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_create_load_balancer_other_tenant_id_field
[0.010071s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_delete_load_balancer
[0.739590s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_get_load_balancer
[0.058033s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_get_load_balancer_stats
[0.221338s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_get_load_balancer_status_tree
[0.109894s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_list_load_balancers
[0.052806s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_list_load_balancers_two
[0.761310s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer
[10.429872s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_empty_admin_state_up_field
[0.007777s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_empty_description
[10.417425s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_empty_name
[10.454167s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_incorrect_attribute
[0.018868s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_invalid_admin_state_up_field
[0.015886s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_invalid_description
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_invalid_name
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_missing_admin_state_up
[10.568904s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_missing_description
[10.580491s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.LoadBalancersTestJSON.test_update_load_balancer_missing_name
[10.457505s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_add_member
[11.303808s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_address
[0.078549s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_admin_state_up
[0.102597s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_protocol_port
[0.039473s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_subnet_id
[0.148632s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_tenant_id
[0.066572s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_empty_weight
[0.013277s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_address
[0.028981s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_admin_state_up
[0.015442s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_protocol_port
[0.030438s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_subnet_id
[0.012639s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_tenant_id
[0.019131s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_invalid_weight
[0.028844s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_missing_required_field_address
[0.013019s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_missing_required_field_protocol_port
[0.042446s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_missing_required_field_subnet_id
[0.027830s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_create_member_missing_required_field_tenant_id
[11.006435s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_delete_member
[11.119334s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_get_member
[10.973422s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_list_3_members
[32.555824s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_list_empty_members
[0.070125s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_raises_BadRequest_when_missing_attrs_during_member_create
[0.018527s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_raises_exception_on_invalid_attr_on_create
[0.019461s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_raises_exception_on_invalid_attr_on_update
[10.760900s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_raises_immutable_when_updating_immutable_attrs_on_member
[11.109004s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member
[21.478323s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_empty_admin_state_up
[10.927192s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_empty_weight
[10.918129s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_invalid_admin_state_up
[10.845882s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_invalid_weight
[10.885405s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_missing_admin_state_up
[21.216835s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_members.MemberTestJSON.test_update_member_missing_weight
[21.295145s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_admin.TestPools.test_create_pool_for_another_tenant
[21.593896s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_admin.TestPools.test_create_pool_missing_tenant_id_for_admin
[21.498328s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_admin.TestPools.test_create_pool_missing_tenant_id_for_other_tenant
[21.427859s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_admin.TestPools.test_create_pool_using_empty_tenant_field
[22.105668s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool
[22.047516s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_admin_state_up
[0.014442s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_algorithm
[0.034964s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_description_field
[21.706984s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_listener_field
[0.096584s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_name_field
[21.479874s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_protocol
[0.023397s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_session_persistence_field
[0.010829s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_empty_tenant_field
[0.021230s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_for_other_tenant_field
[0.012657s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_incorrect_attribute
[0.038056s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_admin_state_up
[0.035527s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_algorithm
[0.020632s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_desc_field
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_listener_field
[0.020583s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_name_field
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_protocol
[0.016265s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_session_persistence_field
[0.034640s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_invalid_tenant_id_field
[0.275444s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_admin_state_up_field
[31.681844s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_description_field
[22.314880s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_lb_algorithm_field
[0.554487s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_listener_id_field
[0.043019s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_name_field
[32.039734s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_protocol_field
[0.393243s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_required_fields
[0.030604s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_session_pers_field
[32.069100s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_missing_tenant_field
[21.632039s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_with_session_persistence_app_cookie
[21.805712s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_with_session_persistence_http_cookie
[21.549721s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_with_session_persistence_redundant_cookie_name
[0.036096s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_with_session_persistence_unsupported_type
[0.030151s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_create_pool_with_session_persistence_without_cookie_name
[0.028952s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_delete_invalid_pool
[21.789179s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_delete_pool
[22.044401s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_get_pool
[21.690581s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_list_pools_empty
[0.049452s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_list_pools_one
[22.299352s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_list_pools_two
[44.739155s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool
[32.301746s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_empty_admin_state_up
[21.896730s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_empty_description
[32.541866s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_empty_name
[32.130750s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_empty_session_persistence
[21.712006s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_incorrect_attribute
[21.685781s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_invalid_admin_state_up
[21.595043s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_invalid_attribute
[21.857489s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_invalid_desc
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_invalid_name
... SKIPPED: Skipped until Bug: 1434717 is resolved.
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_invalid_session_persistence
[21.728657s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_missing_admin_state_up
[32.291603s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_missing_description
[32.556195s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_missing_name
[32.515178s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_update_pool_missing_session_persistence
[32.169479s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_T,listener_T,pool_T)
[24.252088s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_T,listener_T,pool_F)
[24.407499s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_T,listener_F,pool_T)
[24.512059s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_T,listener_F,pool_F)
[24.477372s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_F,listener_T,pool_T)
[24.162564s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_F,listener_T,pool_F)
[24.955881s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_F,listener_F,pool_T)
[24.642878s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_create_pool_with_scenarios(lb_F,listener_F,pool_F)
[24.625857s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_T,listener_T,pool_T)
[35.898441s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_T,listener_T,pool_F)
[35.266306s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_T,listener_F,pool_T)
[35.191563s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_T,listener_F,pool_F)
[35.188797s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_F,listener_T,pool_T)
[35.329687s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_F,listener_T,pool_F)
[36.610240s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_F,listener_F,pool_T)
[34.858267s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios(lb_F,listener_F,pool_F)
[35.292330s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_T,listener_T,pool_T)
[37.401386s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_T,listener_T,pool_F)
[38.235109s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_T,listener_F,pool_T)
[35.839744s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_T,listener_F,pool_F)
[35.683229s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_F,listener_T,pool_T)
[35.579142s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_F,listener_T,pool_F)
[35.621352s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_F,listener_F,pool_T)
[35.367817s] ... ok
{0}
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios(lb_F,listener_F,pool_F)
[35.510691s] ... ok
Slowest Tests
Test id
Runtime (s)
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------
neutron_lbaas.tests.tempest.v2.api.test_health_monitors.TestHealthMonitors.test_list_health_monitors_two[gate,smoke]
44.915
neutron_lbaas.tests.tempest.v2.api.test_pools_non_admin.TestPools.test_list_pools_two[gate,smoke]
44.739
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_T,listener_T,pool_F)
38.235
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_T,listener_T,pool_T)
37.401
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios[gate,smoke](lb_F,listener_T,pool_F)
36.610
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_admin_state_up_true_with_scenarios[gate,smoke](lb_T,listener_T,pool_T)
35.898
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_T,listener_F,pool_T)
35.840
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_T,listener_F,pool_F)
35.683
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_F,listener_T,pool_F)
35.621
neutron_lbaas.tests.tempest.v2.scenario.test_pools_admin_state.TestPoolsAdminState.test_update_pool_state_up_false_with_scenarios[gate,smoke](lb_F,listener_T,pool_T)
35.579
======
Totals
======
Run: 210 in 2154.944022 sec.
- Passed: 198
- Skipped: 12
- Failed: 0
==============
Worker Balance
==============
- Worker 0 (210 tests) => 0:37:03.601079s
________________________________________________________________________________
summary
________________________________________________________________________________
tempest: commands succeeded
congratulations :)
devstack@ubuntu:/opt/stack/neutron-lbaas/neutron_lbaas/tests/tempest/v2/scenario$__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
