blueorangutan commented on issue #2344: CLOUDSTACK-10163: Component tests sanity URL: https://github.com/apache/cloudstack/pull/2344#issuecomment-353765807 <b>Trillian test result (tid-1858)</b> Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7 Total time taken: 229463 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2344-t1858-kvm-centos7.zip Smoke tests completed. 64 look OK, 3 have error(s) Only failed tests results shown below: Test | Result | Time (s) | Test File --- | --- | --- | --- test_01_vpc_privategw_acl | `Failure` | 61.92 | test_privategw_acl.py test_02_vpc_privategw_static_routes | `Failure` | 223.93 | test_privategw_acl.py test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 319.24 | test_privategw_acl.py test_04_rvpc_privategw_static_routes | `Failure` | 394.87 | test_privategw_acl.py test_02_create_template_with_checksum_sha1 | `Error` | 5.24 | test_templates.py test_03_create_template_with_checksum_sha256 | `Error` | 5.23 | test_templates.py test_04_create_template_with_checksum_md5 | `Error` | 5.24 | test_templates.py test_01_vpc_remote_access_vpn | `Error` | 71.06 | test_vpc_vpn.py Additional tests completed. 87 look ok, 45 have error(s) Test | Result | Time (s) | Test File --- | --- | --- | --- test_01_createVM_snapshotTemplate | `Error` | 217.34 | test_snapshots.py test_04_delete_snapshot | `Failure` | 108.25 | test_snapshots.py test_07_template_from_snapshot | `Error` | 318.66 | test_snapshots.py test_05_volume_snapshot | `Error` | 147.81 | test_escalations_volumes.py test_11_volume_extract | `Error` | 157.76 | test_escalations_volumes.py ContextSuite context=TestBrowseUploadVolume>:setup | `Error` | 0.00 | test_browse_volumes.py test_02_deploy_ha_vm_from_iso | `Error` | 1514.16 | test_stopped_vm.py test_07_deploy_startvm_attach_iso | `Failure` | 1519.34 | test_stopped_vm.py test_deploy_vm_password_enabled | `Error` | 5.75 | test_stopped_vm.py test_02_accountSnapshotClean | `Failure` | 82.30 | test_snapshot_gc.py test_06_template_tag | `Error` | 156.64 | test_tags.py test_05_templates_per_account | `Error` | 454.69 | test_resource_limits.py test_05_templates_per_domain | `Error` | 378.63 | test_resource_limits.py ContextSuite context=TestResourceLimitsDomain>:teardown | `Error` | 388.87 | test_resource_limits.py test_05_create_delete_lbrule_forvpc | `Error` | 46.39 | test_escalations_ipaddresses.py test_10_create_delete_portforwarding_forvpc | `Error` | 46.33 | test_escalations_ipaddresses.py test_15_enable_disable_staticnat_forvpc | `Error` | 46.34 | test_escalations_ipaddresses.py ContextSuite context=TestIpAddresses>:teardown | `Error` | 0.86 | test_escalations_ipaddresses.py test_02_internallb_rules_traffic | `Failure` | 604.04 | test_vpc_network_internal_lbrules.py test_03_internallb_rules_vpc_network_restarts_traffic | `Failure` | 376.63 | test_vpc_network_internal_lbrules.py test_04_internallb_appliance_operations_traffic | `Error` | 1015.43 | test_vpc_network_internal_lbrules.py ContextSuite context=TestTemplates>:setup | `Error` | 0.00 | test_escalations_templates.py ContextSuite context=TestVMPasswordEnabled>:teardown | `Error` | 244.72 | test_vm_passwdenabled.py test_browser_upload_template_incomplete | `Failure` | 0.08 | test_browse_templates2.py test_01_list_vpncustomergateways_pagination | `Error` | 5.14 | test_escalations_vpncustomergateways.py test_02_update_vpncustomergateways | `Error` | 5.12 | test_escalations_vpncustomergateways.py test_04_public_private_template_use_in_project | `Error` | 267.59 | test_project_resources.py test_05_use_private_template_in_project | `Error` | 348.15 | test_project_resources.py ContextSuite context=TestTemplates>:teardown | `Error` | 383.67 | test_project_resources.py test_add_ip_to_nic_1_SHARED | `Failure` | 0.74 | test_multiple_ips_per_nic.py test_add_static_nat_rule_2_SHARED | `Failure` | 0.81 | test_multiple_ips_per_nic.py test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED | `Failure` | 0.73 | test_multiple_ips_per_nic.py test_01_create_template_snampshot | `Error` | 5.14 | test_template_from_snapshot_with_template_details.py test_02_add_nw_stopped_vm_2_shared | `Error` | 131.14 | test_add_remove_network.py test_03_add_nw_multiple_times_2_shared | `Error` | 30.77 | test_add_remove_network.py test_06_add_nw_ipaddress_running_vm | `Error` | 86.14 | test_add_remove_network.py test_14_add_nw_different_account_1_isolated | `Failure` | 66.20 | test_add_remove_network.py test_14_add_nw_different_account_2_shared | `Error` | 0.78 | test_add_remove_network.py ContextSuite context=TestAddNetworkToVirtualMachine>:teardown | `Error` | 198.97 | test_add_remove_network.py test_01_create_template | `Error` | 5.18 | test_templates.py test_03_delete_template | `Error` | 5.15 | test_templates.py test_04_template_from_snapshot | `Error` | 106.85 | test_templates.py test_01_reset_keypair_normal_user | `Failure` | 909.81 | test_reset_ssh_keypair.py test_02_reset_keypair_domain_admin | `Failure` | 843.20 | test_reset_ssh_keypair.py test_03_reset_keypair_root_admin | `Failure` | 893.72 | test_reset_ssh_keypair.py ContextSuite context=TestResetSSHKeyUserRights>:teardown | `Error` | 919.14 | test_reset_ssh_keypair.py test_01_reset_ssh_keys | `Failure` | 901.37 | test_reset_ssh_keypair.py test_02_reset_ssh_key_password_enabled_template | `Failure` | 780.47 | test_reset_ssh_keypair.py test_03_reset_ssh_with_no_key | `Failure` | 785.56 | test_reset_ssh_keypair.py test_04_reset_key_passwd_enabled_no_key | `Failure` | 861.40 | test_reset_ssh_keypair.py ContextSuite context=TestResetSSHKeypair>:teardown | `Error` | 81.65 | test_reset_ssh_keypair.py test_attach_volume_exceeding_primary_limits | `Error` | 126.94 | test_ps_resource_limits_volume.py test_attach_volume_exceeding_primary_limits | `Error` | 152.25 | test_ps_resource_limits_volume.py test_01_volume_iso_attach | `Failure` | 1758.77 | test_volumes.py test_01_register_template_with_project | `Error` | 11.09 | test_ss_project_limits.py test_02_register_iso | `Error` | 672.59 | test_ss_project_limits.py test_01_host_ha_with_nfs_storagepool_with_vm | `Error` | 63.25 | test_host.py ContextSuite context=TestVMLifeCycleSharedNwVPC>:setup | `Error` | 395.06 | test_vpc_vm_life_cycle.py test_04_reboot_instance_in_network | `Failure` | 820.97 | test_vpc_vm_life_cycle.py test_05_destroy_instance_in_network | `Failure` | 742.73 | test_vpc_vm_life_cycle.py test_04_create_template_delete_account | `Failure` | 7.27 | test_ss_domain_limits.py test_04_create_template_delete_account | `Error` | 17.48 | test_ss_domain_limits.py test_01_multiple_domains_secondary_storage_limits | `Failure` | 7.24 | test_ss_domain_limits.py test_02_multiple_domains_secondary_storage_counts | `Failure` | 7.18 | test_ss_domain_limits.py ContextSuite context=TestDataPersistency>:teardown | `Error` | 398.96 | test_blocker_bugs.py test_01_create_template | `Error` | 5.14 | test_blocker_bugs.py test_02_check_size_snapshotTemplate | `Error` | 85.87 | test_blocker_bugs.py test_03_reuse_template_name | `Error` | 70.73 | test_blocker_bugs.py test_02_create__template_new_resized_rootvolume_size | `Error` | 372.40 | test_rootvolume_resize.py test_03_vmsnapshot__on_resized_rootvolume_vm | `Error` | 206.40 | test_rootvolume_resize.py test_04_vmreset_after_migrate_vm__rootvolume_resized | `Error` | 210.86 | test_rootvolume_resize.py test_22_disablePod_admin_deployVM | `Error` | 5.24 | test_organization_states.py test_43_disableHost_admin_deployVM | `Failure` | 5.19 | test_organization_states.py test_44_disableHost_admin_stop_startVM | `Failure` | 131.03 | test_organization_states.py test_46_disableHost_user_stop_startVM | `Failure` | 40.50 | test_organization_states.py ContextSuite context=TestISOUsage>:setup | `Error` | 0.00 | test_project_usage.py test_01_template_usage | `Error` | 5.13 | test_project_usage.py test_03_restore_vm_with_new_template | `Error` | 1514.45 | test_base_image_updation.py test_07_templates_per_project | `Error` | 5.21 | test_project_limits.py test_06_create_network_in_vpc | `Error` | 45.72 | test_escalations_networks.py test_10_list_networks_in_vpc | `Failure` | 0.06 | test_escalations_networks.py test_11_update_vpc | `Failure` | 0.04 | test_escalations_networks.py test_12_list_create_delete_networkACL | `Failure` | 0.04 | test_escalations_networks.py test_19_create_list_reset_delete_vpnconnections | `Error` | 55.81 | test_escalations_networks.py test_01_Browser_template_Life_cycle_tpath | `Error` | 0.09 | test_browse_templates.py test_browser_upload_template_incomplete | `Failure` | 195.59 | test_browse_templates.py test_08_ip_reallocation_CS5986 | `Error` | 661.34 | test_vpc_vms_deployment.py ContextSuite context=TestVMDeployVPC>:teardown | `Error` | 1406.32 | test_vpc_vms_deployment.py test_01_VPN_service | `Error` | 76.61 | test_vpn_service.py test_04_update_aff_grp_remove_all | `Error` | 5.22 | test_affinity_groups.py test_06_update_aff_grp_invalid_args | `Error` | 221.98 | test_affinity_groups.py test_05_network_services_VPC_StopDeletePF | `Failure` | 217.26 | test_vpc_network_pfrules.py test_06_network_services_VPC_DeletePF | `Failure` | 207.49 | test_vpc_network_pfrules.py test_07_network_services_VPC_StopDeleteAllPF | `Failure` | 242.96 | test_vpc_network_pfrules.py test_08_network_services_VPC_DeleteAllPF | `Failure` | 157.98 | test_vpc_network_pfrules.py test_09_network_services_VPC_StopDeleteAllMultiplePF | `Failure` | 253.03 | test_vpc_network_pfrules.py test_10_network_services_VPC_DeleteAllMultiplePF | `Failure` | 297.77 | test_vpc_network_pfrules.py test_01_2_egress_fr1 | `Failure` | 186.53 | test_egress_fw_rules.py test_create_template_snapshot_1_root_domain_admin | `Failure` | 343.66 | test_ps_limits.py test_listtemplate | `Failure` | 226.69 | test_escalation_listTemplateDomainAdmin.py test_iptable_rules | `Error` | 0.04 | test_multiple_public_interfaces.py test_port_forwarding_on_ip_from_non_src_nat_ip_range | `Error` | 0.03 | test_multiple_public_interfaces.py test_routing_tables | `Error` | 0.03 | test_multiple_public_interfaces.py test_static_nat_on_ip_from_non_src_nat_ip_range | `Error` | 0.03 | test_multiple_public_interfaces.py test_network_services_VPC_CreatePF | `Error` | 132.10 | test_multiple_public_interfaces.py test_network_services_VPC_CreatePF | `Error` | 142.13 | test_multiple_public_interfaces.py test_05_remove_used_range | `Failure` | 147.24 | test_non_contiguous_vlan.py test_acquire_ip | `Error` | 0.76 | test_shared_networks.py test_createSharedNetwork_usedVlan2 | `Error` | 0.85 | test_shared_networks.py test_deployVM_isolatedAndShared | `Error` | 0.95 | test_shared_networks.py test_deployVM_multipleSharedNetwork | `Error` | 0.87 | test_shared_networks.py test_associate_ip_address_services_enable_disable | `Failure` | 1423.40 | test_portable_ip.py test_list_portable_ip_range_non_root_admin | `Failure` | 1264.15 | test_portable_ip.py test_01_VPC_StaticNatRuleCreateStoppedState | `Failure` | 786.24 | test_vpc_network_staticnatrule.py test_05_network_services_VPC_DeleteAllPF | `Failure` | 144.72 | test_vpc_network_staticnatrule.py test_06_network_services_VPC_DeleteAllMultiplePF | `Failure` | 254.56 | test_vpc_network_staticnatrule.py
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
