Abhinav Roy created CLOUDSTACK-4181:
---------------------------------------
Summary: [upgrade][2.2.14 to 4.2][vmware]After upgrade the system
vms fail to start
Key: CLOUDSTACK-4181
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4181
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: SystemVM, Upgrade, VMware
Affects Versions: 4.2.0
Environment: upgrade from 2.2.14 to 4.2 on CentOS 5.6 management srver
ESX 4.1 host
Reporter: Abhinav Roy
Priority: Critical
Fix For: 4.2.0
Attachments: CS-4181.zip
Steps :
================
1. Deploy a CS advanced zone setup with CS 2.2.14
2. Do some configurations.
3. upgrade to 4.2, then run cloudstack-setup-encryption and start management
server
Expected behaviour:
===============
The upgrade should go through and system vms should come up
Observed behaviour :
===============
The upgrade succeeds but system vms fail to start with
13-08-07 19:54:47,236 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Asking BareMetalDhcp to prepare for
Nic[119-40-null-10.102.195.67]
2013-08-07 19:54:47,236 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Asking BareMetalPxe to prepare for
Nic[119-40-null-10.102.195.67]
2013-08-07 19:54:47,236 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Asking BareMetalUserdata to prepare for
Nic[119-40-null-10.102.195.67]
2013-08-07 19:54:47,239 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Lock is acquired for network id 202 as a part of network
implement
2013-08-07 19:54:47,240 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Network id=202 is already implemented
2013-08-07 19:54:47,241 DEBUG [cloud.network.NetworkManagerImpl]
(secstorage-1:null) Lock is released for network id 202 as a part of network
implement
2013-08-07 19:54:47,319 WARN [vmware.resource.VmwareResource]
(DirectAgent-16:10.102.192.17) StartCommand failed due to Exception:
com.vmware.vim25.InvalidProperty
message: []
com.vmware.vim25.InvalidPropertyFaultMsg:
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at
com.sun.xml.internal.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:130)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
at sun.proxy.$Proxy89.retrieveProperties(Unknown Source)
at
com.cloud.hypervisor.vmware.util.VmwareClient.retrieveMoRefProperties(VmwareClient.java:263)
at
com.cloud.hypervisor.vmware.util.VmwareClient.getDynamicProperty(VmwareClient.java:218)
at
com.cloud.hypervisor.vmware.mo.VirtualMachineMO.getCoresPerSocket(VirtualMachineMO.java:2201)
at
com.cloud.hypervisor.vmware.mo.VirtualMachineMO.isCpuHotAddSupported(VirtualMachineMO.java:2242)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2674)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:518)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-07 19:54:47,323 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-16:null) Seq 1-609353762: Cancelling because one of the answers is
false and it is stop on error.
2013-08-07 19:54:47,323 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-16:null) Seq 1-609353762: Response Received:
2013-08-07 19:54:47,327 DEBUG [agent.transport.Request] (DirectAgent-16:null)
Seq 1-609353762: Processing: { Ans: , MgmtId: 90310994128556, via: 1, Ver: v1,
Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":36,"name":"v-36-VM","bootloader":"HVM","type":"ConsoleProxy","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP type=consoleproxy
host=10.102.192.175 port=8250 name=v-36-VM premium=true zone=1 pod=1
guid=Proxy.36 proxy_vm=36 disable_rp_filter=true eth2ip=10.102.195.68
eth2mask=255.255.252.0 gateway=10.102.192.1 eth0ip=0.0.0.0 eth0mask=0.0.0.0
eth1ip=10.102.195.56 eth1mask=255.255.252.0 mgmtcidr=10.102.192.0/22
localgw=10.102.192.1 internaldns1=10.103.128.15
dns1=10.103.128.15","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"36bb8d79846425d2","params":{"nicAdapter":"E1000"},"uuid":"f1e12329-f08c-42b8-ab39-fdd011b504d7","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"cc465a2b-2a4c-4dcd-92f6-45fd7b6e6dcb","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"3f4c460a-1634-3db0-8b1f-60fe7b17a264","id":202,"poolType":"NetworkFilesystem","host":"10.102.192.100","path":"/cpg_vol/abhinav/esx-pri2","port":2049}},"name":"ROOT-36","size":2097152000,"path":"ROOT-36","volumeId":39,"vmName":"v-36-VM","accountId":1,"format":"OVA","id":39,"hypervisorType":"VMware"}},"diskSeq":0,"type":"ROOT"}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"7d688a60-4531-4be6-a81a-1fae6951763a","ip":"10.102.195.68","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:50:9a:00:00:12","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"07027cf2-afb1-420c-b4e1-24da7973eee3","mac":"02:00:17:e7:00:1e","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"fd495339-45ad-4f5a-8e49-2fcc5836d3d0","ip":"10.102.195.56","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:14:42:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false}]},"result":false,"details":"StartCommand
failed due to Exception: com.vmware.vim25.InvalidProperty\nmessage:
[]\n","wait":0}}] }
2013-08-07 19:54:47,327 DEBUG [agent.transport.Request] (consoleproxy-1:null)
Seq 1-609353762: Received: { Ans: , MgmtId: 90310994128556, via: 1, Ver: v1,
Flags: 10, { StartAnswer } }
2013-08-07 19:54:47,329 INFO [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Unable to start VM on Host[-1-Routing] due to
StartCommand failed due to Exception: com.vmware.vim25.InvalidProperty
message: []
Attaching the logs and dumps
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
