shweta agarwal created CLOUDSTACK-4518:
------------------------------------------
Summary: unable to start router vm on vmware4.1 after upgrade;
hitting exception
Key: CLOUDSTACK-4518
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4518
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Upgrade, VMware
Affects Versions: 4.2.1
Environment: 3.0.4 patch1 to 4.2 upgrade with exi4.1 host
Reporter: shweta agarwal
Priority: Blocker
Fix For: 4.2.1
id and upgrade on 3.0.4 patch1 to 4.2 .
Having two advance zone
1 with EXI 4.1
second with xen
With vmware zone i stopped router vm and then trying to restart it
router vm fails to start
Getting following exception in Ms log :
2013-08-27 14:11:38,901 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null)
===END=== 10.146.0.13 -- GET
command=queryAsyncJobResult&jobId=6cbdc727-6f37-4311-bf68-c494ae8d1606&response=json&sessionkey=JfGwnKwdSVyjkqkZFWtNSAK0JKU%3D&_=1377607652726
2013-08-27 14:11:39,034 WARN [vmware.resource.VmwareResource]
(DirectAgent-302:10.147.40.27) StartCommand failed due to Exception:
java.lang.Exception
Message: Unable to find ROOT-28.vmdk in datastore:
d9a91dba343e38dcbbe169a3f57fd335
java.lang.Exception: Unable to find ROOT-28.vmdk in datastore:
d9a91dba343e38dcbbe169a3f57fd335
at
com.cloud.storage.resource.VmwareStorageLayoutHelper.syncVolumeToRootFolder(VmwareStorageLayoutHelper.java:142)
at
com.cloud.storage.resource.VmwareStorageLayoutHelper.syncVolumeToVmDefaultFolder(VmwareStorageLayoutHelper.java:115)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.syncDiskChain(VmwareResource.java:3012)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2858)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:515)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-27 14:11:39,038 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-302:null) Seq 5-982581486: Cancelling because one of the answers
is false and it is stop on error.
2013-08-27 14:11:39,038 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-302:null) Seq 5-982581486: Response Received:
2013-08-27 14:11:39,034 WARN [vmware.resource.VmwareResource]
(DirectAgent-302:10.147.40.27) StartCommand failed due to Exception:
java.lang.Exception
Message: Unable to find ROOT-28.vmdk in datastore:
d9a91dba343e38dcbbe169a3f57fd335
java.lang.Exception: Unable to find ROOT-28.vmdk in datastore:
d9a91dba343e38dcbbe169a3f57fd335
at
com.cloud.storage.resource.VmwareStorageLayoutHelper.syncVolumeToRootFolder(VmwareStorageLayoutHelper.java:142)
at
com.cloud.storage.resource.VmwareStorageLayoutHelper.syncVolumeToVmDefaultFolder(VmwareStorageLayoutHelper.java:115)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.syncDiskChain(VmwareResource.java:3012)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2858)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:515)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-27 14:11:39,038 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-302:null) Seq 5-982581486: Cancelling because one of the answers
is false and it is stop on error.
2013-08-27 14:11:39,038 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-302:null) Seq 5-982581486: Response Received:
2013-08-27 14:11:39,039 DEBUG [agent.transport.Request] (DirectAgent-302:null)
Seq 5-982581486: Processing: { Ans: , MgmtId: 7217726095403, via: 5, Ver: v1,
Flags: 110,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":28,"name":"r-28-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"hostName":"r-28-VM","arch":"x86_64","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP name=r-28-VM
eth2ip=10.147.51.119 eth2mask=255.255.255.0 gateway=10.147.51.1 eth0ip=10.1.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal dhcprange=10.1.1.1
eth1ip=10.147.41.100 eth1mask=255.255.254.0 mgmtcidr=10.147.38.0/24
localgw=10.147.40.1 type=router disable_rp_filter=true extra_pubnics=2
dns1=10.103.128.16
nic_macs=02:00:30:b7:00:02|02:00:7b:f7:00:1c|06:c7:30:00:00:1e|02:00:0f:93:00:09|02:00:0f:48:00:0a","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"b1d85f74cf74c7f5","params":{"nicAdapter":"E1000"},"uuid":"da6d1b87-40c0-4a2a-b8e1-9768a98f3ab1","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"84d9cfc9-432e-4101-bb7b-ea707a6d5744","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d9a91dba-343e-38dc-bbe1-69a3f57fd335","id":201,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/shweta/304patch1.vmware.primary","port":2049}},"name":"ROOT-28","size":2097152000,"path":"ROOT-28","volumeId":47,"vmName":"r-28-VM","accountId":2,"chainInfo":"{\"diskDeviceBusName\":\"scsi0:0\",\"diskChain\":[\"[d9a91dba343e38dcbbe169a3f57fd335]
r-28-VM/ROOT-28.vmdk\"]}","format":"OVA","id":47,"hypervisorType":"VMware"}},"diskSeq":0,"type":"ROOT"}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"5f1d98ed-63b6-4061-b0ae-1067621b5335","ip":"10.147.51.119","netmask":"255.255.255.0","gateway":"10.147.51.1","mac":"06:c7:30:00:00:1e","dns1":"10.103.128.16","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://51","isolationUri":"vlan://51","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"18ecd99e-131d-4853-8811-4cbf9b1725a9","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:30:b7:00:02","dns1":"10.103.128.16","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://1058","isolationUri":"vlan://1058","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"e2074834-21d9-4b48-bb94-ecf362576024","ip":"10.147.41.100","netmask":"255.255.254.0","gateway":"10.147.40.1","mac":"02:00:7b:f7:00:1c","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"ip":"0.0.0.0","netmask":"255.255.255.255","gateway":"10.147.51.1","mac":"02:00:0f:93:00:09","dns1":"10.103.128.16","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://51","isolationUri":"vlan://51","isSecurityGroupEnabled":false},{"deviceId":4,"networkRateMbps":-1,"defaultNic":false,"ip":"0.0.0.0","netmask":"255.255.255.255","gateway":"10.147.51.1","mac":"02:00:0f:48:00:0a","dns1":"10.103.128.16","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://51","isolationUri":"vlan://51","isSecurityGroupEnabled":false}]},"result":false,"details":"StartCommand
failed due to Exception: java.lang.Exception\nMessage: Unable to find
ROOT-28.vmdk in datastore: d9a91dba343e38dcbbe169a3f57fd335\n","wait":0}}] }
2013-08-27 14:11:39,039 DEBUG [agent.manager.AgentAttache]
(DirectAgent-302:null) Seq 5-982581486: No more commands found
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira