Rayees Namathponnan created CLOUDSTACK-4261:
-----------------------------------------------
Summary: [Automaiton]
TestVPCNetworkUpgrade.test_01_network_services_upgrade failed to upgrade the
network offering
Key: CLOUDSTACK-4261
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4261
Project: CloudStack
Issue Type: Test
Security Level: Public (Anyone can view this level - this is the default.)
Components: Automation
Affects Versions: 4.2.0
Environment: Automation
Reporter: Rayees Namathponnan
Fix For: 4.2.0
TestVPCNetworkUpgrade.test_01_network_services_upgrade failed to upgrade the
network offering
Observed below error in log
Error Message
failed to upgrade the network offering- Execute cmd: asyncquery failed, due to:
{errorcode : 530, errortext : u'Failed to implement network (with specified id)
elements and resources as a part of network update'}
-------------------- >> begin captured logging << --------------------
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Creating a VPC offering..
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Check if the VPC offering is
created successfully?
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: VPC offering is created
successfully - VPC off-D6D8U7
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Enabling the VPC offering
created
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: creating a VPC network in the
account: test-SIDD23
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Check if the VPC network is
created successfully?
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: VPC network validated -
TestVPC-ZVCYT5
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Creating network with network
offering: 68270510-b671-4c67-99d6-038825ddab10
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Created network with ID:
f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: deploying VMs in network:
Test Network
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Deployed VM in network:
f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Deployed another VM in
network: f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associating public IP for
network: Test Network
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associated 10.223.122.98 with
network f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Creating LB rule for IP
address: 10.223.122.98
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Adding virtual machines
1aa01bbe-2a3a-4c4f-87fe-5b14b052e8dd and 89c0a243-3797-4129-8dbb-e2ad91227f75
to LB rule
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associating public IP for
network: Test Network
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associated 10.223.122.95 with
network f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Enabling static NAT for IP:
10.223.122.95
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Static NAT enabled for IP:
10.223.122.95
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Adding NetwrokACl rules to
make PF and LB accessible
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Adding Egress rules to
network Test Network to access internet
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Checking if we can SSH into
VM_1? - IP: 10.223.122.98
paramiko.transport: DEBUG: starting thread (client mode): 0x49bdd90L
paramiko.transport: ERROR: Exception: Error reading SSH protocol banner
paramiko.transport: ERROR: Traceback (most recent call last):
paramiko.transport: ERROR: File
"/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1555, in
run
paramiko.transport: ERROR: self._check_banner()
paramiko.transport: ERROR: File
"/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1681, in
_check_banner
paramiko.transport: ERROR: raise SSHException('Error reading SSH protocol
banner' + str(x))
paramiko.transport: ERROR: SSHException: Error reading SSH protocol banner
paramiko.transport: ERROR:
paramiko.transport: DEBUG: starting thread (client mode): 0x49c08d0L
paramiko.transport: ERROR: Exception: Error reading SSH protocol banner
paramiko.transport: ERROR: Traceback (most recent call last):
paramiko.transport: ERROR: File
"/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1555, in
run
paramiko.transport: ERROR: self._check_banner()
paramiko.transport: ERROR: File
"/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1681, in
_check_banner
paramiko.transport: ERROR: raise SSHException('Error reading SSH protocol
banner' + str(x))
paramiko.transport: ERROR: SSHException: Error reading SSH protocol banner
paramiko.transport: ERROR:
paramiko.transport: DEBUG: starting thread (client mode): 0x49bdd90L
paramiko.transport: INFO: Connected (version 2.0, client OpenSSH_4.3)
paramiko.transport: DEBUG: kex algos:['diffie-hellman-group-exchange-sha1',
'diffie-hellman-group14-sha1', 'diffie-hellman-group1-sha1'] server
key:['ssh-rsa', 'ssh-dss'] client encrypt:['aes128-cbc', '3des-cbc',
'blowfish-cbc', 'cast128-cbc', 'arcfour128', 'arcfour256', 'arcfour',
'aes192-cbc', 'aes256-cbc', '[email protected]', 'aes128-ctr',
'aes192-ctr', 'aes256-ctr'] server encrypt:['aes128-cbc', '3des-cbc',
'blowfish-cbc', 'cast128-cbc', 'arcfour128', 'arcfour256', 'arcfour',
'aes192-cbc', 'aes256-cbc', '[email protected]', 'aes128-ctr',
'aes192-ctr', 'aes256-ctr'] client mac:['hmac-md5', 'hmac-sha1',
'hmac-ripemd160', '[email protected]', 'hmac-sha1-96', 'hmac-md5-96']
server mac:['hmac-md5', 'hmac-sha1', 'hmac-ripemd160',
'[email protected]', 'hmac-sha1-96', 'hmac-md5-96'] client
compress:['none', '[email protected]'] server compress:['none',
'[email protected]'] client lang:[''] server lang:[''] kex follows?False
paramiko.transport: DEBUG: Ciphers agreed: local=aes128-ctr, remote=aes128-ctr
paramiko.transport: DEBUG: using kex diffie-hellman-group1-sha1; server key
type ssh-rsa; cipher: local aes128-ctr, remote aes128-ctr; mac: local
hmac-sha1, remote hmac-sha1; compression: local none, remote none
paramiko.transport: DEBUG: Switch to new keys ...
paramiko.transport: DEBUG: Adding ssh-rsa host key for [10.223.122.98]:2222:
0f8b3ff9dc4dce10340227dab3cac032
paramiko.transport: DEBUG: Trying discovered key
76be480fa6b8ad3b78082d6d19e4ee44 in /root/.ssh/id_rsa
paramiko.transport: DEBUG: userauth is OK
paramiko.transport: INFO: Authentication (publickey) failed.
paramiko.transport: DEBUG: userauth is OK
paramiko.transport: INFO: Authentication (password) successful!
sshClient: DEBUG: SSH connect: [email protected] with passwd password
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: SSH into VM is successfully
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Verifying if we can ping to
outside world from VM?
paramiko.transport: DEBUG: [chan 1] Max packet in: 34816 bytes
paramiko.transport: DEBUG: [chan 1] Max packet out: 32768 bytes
paramiko.transport: INFO: Secsh channel 1 opened.
paramiko.transport: DEBUG: [chan 1] Sesch channel 1 request ok
paramiko.transport: DEBUG: [chan 1] EOF received (1)
sshClient: DEBUG: {Cmd: ping -c 1 www.google.com via Host: 10.223.122.98}
{returns: ['PING www.google.com (74.125.239.49) 56(84) bytes of data.', '64
bytes from nuq04s19-in-f17.1e100.net (74.125.239.49): icmp_seq=1 ttl=48
time=6.70 ms', '', '--- www.google.com ping statistics ---', '1 packets
transmitted, 1 received, 0% packet loss, time 0ms', 'rtt min/avg/max/mdev =
6.702/6.702/6.702/0.000 ms']}
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Result: ['PING www.google.com
(74.125.239.49) 56(84) bytes of data.', '64 bytes from
nuq04s19-in-f17.1e100.net (74.125.239.49): icmp_seq=1 ttl=48 time=6.70 ms', '',
'--- www.google.com ping statistics ---', '1 packets transmitted, 1 received,
0% packet loss, time 0ms', 'rtt min/avg/max/mdev = 6.702/6.702/6.702/0.000 ms']
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Checking if we can SSH into
VM_2?
paramiko.transport: DEBUG: starting thread (client mode): 0x49c74d0L
paramiko.transport: DEBUG: [chan 1] EOF sent (1)
paramiko.transport: INFO: Connected (version 2.0, client OpenSSH_4.3)
paramiko.transport: DEBUG: kex algos:['diffie-hellman-group-exchange-sha1',
'diffie-hellman-group14-sha1', 'diffie-hellman-group1-sha1'] server
key:['ssh-rsa', 'ssh-dss'] client encrypt:['aes128-cbc', '3des-cbc',
'blowfish-cbc', 'cast128-cbc', 'arcfour128', 'arcfour256', 'arcfour',
'aes192-cbc', 'aes256-cbc', '[email protected]', 'aes128-ctr',
'aes192-ctr', 'aes256-ctr'] server encrypt:['aes128-cbc', '3des-cbc',
'blowfish-cbc', 'cast128-cbc', 'arcfour128', 'arcfour256', 'arcfour',
'aes192-cbc', 'aes256-cbc', '[email protected]', 'aes128-ctr',
'aes192-ctr', 'aes256-ctr'] client mac:['hmac-md5', 'hmac-sha1',
'hmac-ripemd160', '[email protected]', 'hmac-sha1-96', 'hmac-md5-96']
server mac:['hmac-md5', 'hmac-sha1', 'hmac-ripemd160',
'[email protected]', 'hmac-sha1-96', 'hmac-md5-96'] client
compress:['none', '[email protected]'] server compress:['none',
'[email protected]'] client lang:[''] server lang:[''] kex follows?False
paramiko.transport: DEBUG: Ciphers agreed: local=aes128-ctr, remote=aes128-ctr
paramiko.transport: DEBUG: using kex diffie-hellman-group1-sha1; server key
type ssh-rsa; cipher: local aes128-ctr, remote aes128-ctr; mac: local
hmac-sha1, remote hmac-sha1; compression: local none, remote none
paramiko.transport: DEBUG: Switch to new keys ...
paramiko.transport: DEBUG: Adding ssh-rsa host key for 10.223.122.95:
0f8b3ff9dc4dce10340227dab3cac032
paramiko.transport: DEBUG: Trying discovered key
76be480fa6b8ad3b78082d6d19e4ee44 in /root/.ssh/id_rsa
paramiko.transport: DEBUG: userauth is OK
paramiko.transport: INFO: Authentication (publickey) failed.
paramiko.transport: DEBUG: userauth is OK
paramiko.transport: INFO: Authentication (password) successful!
sshClient: DEBUG: SSH connect: [email protected] with passwd password
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: SSH into VM is successfully
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Verifying if we can ping to
outside world from VM?
paramiko.transport: DEBUG: [chan 1] Max packet in: 34816 bytes
paramiko.transport: DEBUG: [chan 1] Max packet out: 32768 bytes
paramiko.transport: INFO: Secsh channel 1 opened.
paramiko.transport: DEBUG: [chan 1] Sesch channel 1 request ok
paramiko.transport: DEBUG: [chan 1] EOF received (1)
sshClient: DEBUG: {Cmd: ping -c 1 www.google.com via Host: 10.223.122.95}
{returns: ['PING www.google.com (74.125.239.51) 56(84) bytes of data.', '64
bytes from nuq04s19-in-f19.1e100.net (74.125.239.51): icmp_seq=1 ttl=48
time=5.97 ms', '', '--- www.google.com ping statistics ---', '1 packets
transmitted, 1 received, 0% packet loss, time 0ms', 'rtt min/avg/max/mdev =
5.973/5.973/5.973/0.000 ms']}
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Result: ['PING www.google.com
(74.125.239.51) 56(84) bytes of data.', '64 bytes from
nuq04s19-in-f19.1e100.net (74.125.239.51): icmp_seq=1 ttl=48 time=5.97 ms', '',
'--- www.google.com ping statistics ---', '1 packets transmitted, 1 received,
0% packet loss, time 0ms', 'rtt min/avg/max/mdev = 5.973/5.973/5.973/0.000 ms']
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associating public IP for
network: TestVPC-ZVCYT5
paramiko.transport: DEBUG: [chan 1] EOF sent (1)
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Associated 10.223.122.97 with
network f355327c-4d8e-44b3-a4e5-52f615a74f24
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Creatinng NAT rule in network
shall through exception?
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Create NAT rule failed!
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Stopping all the virtual
machines in network before upgrade
paramiko.transport: DEBUG: EOF in transport thread
paramiko.transport: DEBUG: EOF in transport thread
testclient.testcase.TestVPCNetworkUpgrade: DEBUG: Upgrading network offering to
support PF services
--------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/local/lib/python2.7/unittest/case.py", line 318, in run
testMethod()
File
"/Repo_30X/ipcl/cloudstack/test/integration/component/test_vpc_network.py",
line 1953, in test_01_network_services_upgrade
self.fail("failed to upgrade the network offering- %s" % e)
File "/usr/local/lib/python2.7/unittest/case.py", line 393, in fail
raise self.failureException(msg)
failed to upgrade the network offering- Execute cmd: asyncquery failed, due to:
{errorcode : 530, errortext : u'Failed to implement network (with specified id)
elements and resources as a part of network update'}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira