Ryan created CLOUDSTACK-6367:
--------------------------------
Summary: Cold Storage migration fails between Pods - Basic
Network- Xenserver 6.1 CS 4.3
Key: CLOUDSTACK-6367
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6367
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Automation
Affects Versions: 4.3.0
Environment: Xenserver 6.1
Cloudstack 4.3 (Upgraded from 4.1.1)
Reporter: Ryan
We have a 4 node management setup. We have a zone with 2 pods, each with a
cluster of 5 Xenserver 6.1 nodes. Both clusters have a primary NFS storage
volume. The vm is stored on the primary volume. Basic networking is being used
and each pod has it's own guest network, on a different subnet.
The steps taken are:
1. Power down the VM.
2. Attempt to migrate from one POD's primary storage volume to the other.
3. Migration is successful and the volume does appear to have been transferred
over to the new volume.
4. When trying to start the VM, the user interface reports "Unable to start a
VM due to concurrent operation".
Errors in management-log are as follows:
{noformat}
2014-04-09 14:02:04,243 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-59:ctx-4081e333) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vm.StartVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to
concurrent operation
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:607)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.exception.AgentUnavailableException: Resource [Host:206]
is unreachable: Host 206: Unable to start instance due to null
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1072)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
... 36 more
Caused by: java.lang.NullPointerException
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.createDhcpEntryCommand(VirtualNetworkApplianceManagerImpl.java:3527)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.access$700(VirtualNetworkApplianceManagerImpl.java:286)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl$7.execute(VirtualNetworkApplianceManagerImpl.java:3050)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3903)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyDhcpEntry(VirtualNetworkApplianceManagerImpl.java:3043)
at sun.reflect.GeneratedMethodAccessor380.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy240.applyDhcpEntry(Unknown Source)
at
com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:921)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1187)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:1309)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1245)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
... 38 more
2014-04-09 14:02:04,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-59:ctx-4081e333) Complete async job-6364, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to start a VM due to concurrent operation"}
2014-04-09 14:02:04,255 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-59:ctx-4081e333) Done executing
org.apache.cloudstack.api.command.user.vm.StartVMCmd for job-6364
2014-04-09 14:02:04,261 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-59:ctx-4081e333) Remove job-6364 from job monitoring
2014-04-09 14:02:05,800 DEBUG [c.c.a.ApiServlet]
(catalina-exec-25:ctx-294549f5) ===START=== 192.168.101.8 -- GET
command=queryAsyncJobResult&jobId=24e3f503-dc4d-4042-a89a-e3679d421190&response=json&sessionkey=ndLVG8JwV8KKyfvueQQTn7ci%2F%2B8%3D&_=1397048525803
2014-04-09 14:02:05,843 DEBUG [c.c.a.ApiServlet] (catalina-exec-25:ctx-294549f5
ctx-92460525) ===END=== 192.168.101.8 -- GET
command=queryAsyncJobResult&jobId=24e3f503-dc4d-4042-a89a-e3679d421190&response=json&sessionkey=ndLVG8JwV8KKyfvueQQTn7ci%2F%2B8%3D&_=1397048525803
{noformat}
At this point the user interface shows that the root volume is now present in
the target volume. The IP address for the VM in the user interface has also
been updated and now displays an IP address in the correct range.
However, in the database, the vm_instance table still shows the
private_ip_address as being on the old range.
The nics table shows two entries for the instance. The old nic, with an IP on
the old POD guest range with a state of Deallocating. It also has an entry with
a new nic, on the correct range, with a state of Allocated.
/etc/dhcphosts.txt on the routers however has not been updated. This file still
contains the old mac address with the IP on the old POD guest range.
Migrating from local storage to local storage within a POD works fine.
Migrating from local storage in one POD to local storage in another POD does
not work correctly.
The following error is seen:
{noformat}
010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-04-09 14:21:56,497 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Applying dhcp entry in network
Ntwk[219|Guest|47]
2014-04-09 14:21:56,502 ERROR [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Failed to start instance
VM[User|localtest004]
java.lang.NullPointerException
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.createDhcpEntryCommand(VirtualNetworkApplianceManagerImpl.java:3527)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.access$700(VirtualNetworkApplianceManagerImpl.java:286)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl$7.execute(VirtualNetworkApplianceManagerImpl.java:3050)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3903)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyDhcpEntry(VirtualNetworkApplianceManagerImpl.java:3043)
at sun.reflect.GeneratedMethodAccessor380.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy240.applyDhcpEntry(Unknown Source)
at
com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:921)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1187)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:1309)
at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1245)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:228)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2014-04-09 14:21:56,510 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Cleaning up resources for the vm
VM[User|localtest004] in Starting state
2014-04-09 14:21:56,515 DEBUG [c.c.a.t.Request] (Job-Executor-60:ctx-9fbb1b22
ctx-6aa95237) Seq 190-780080003: Sending { Cmd , MgmtId: 345049290103, via:
190(dc1csxen002.live.dc1.tradermedia.net), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-304-VM","wait":0}}]
}
2014-04-09 14:21:56,515 DEBUG [c.c.a.t.Request] (Job-Executor-60:ctx-9fbb1b22
ctx-6aa95237) Seq 190-780080003: Executing: { Cmd , MgmtId: 345049290103, via:
190(dc1csxen002.live.dc1.tradermedia.net), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-304-VM","wait":0}}]
}
2014-04-09 14:21:56,516 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-399:ctx-f63e60d9) Seq 190-780080003: Executing request
2014-04-09 14:21:56,610 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-339:ctx-73b5759d) Seq 645-94377697: Response Received:
2014-04-09 14:21:56,610 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-339:ctx-73b5759d) Seq 645-94377697: MgmtId 345049276599: Resp:
Routing to peer
2014-04-09 14:21:56,691 INFO [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-399:ctx-f63e60d9) VM does not exist on
XenServer605e9b26-9b55-4fd3-8685-f13238b113b9
2014-04-09 14:21:56,691 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-399:ctx-f63e60d9) Seq 190-780080003: Response Received:
2014-04-09 14:21:56,691 DEBUG [c.c.a.t.Request] (DirectAgent-399:ctx-f63e60d9)
Seq 190-780080003: Processing: { Ans: , MgmtId: 345049290103, via: 190, Ver:
v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM
does not exist","wait":0}}] }
****SNIP*******
2014-04-09 14:21:56,985 DEBUG [c.c.d.FirstFitPlanner]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Removing from the clusterId list
these clusters from avoid set: [19]
2014-04-09 14:21:56,985 DEBUG [c.c.d.FirstFitPlanner]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) No clusters found after removing
disabled clusters and clusters in avoid list, returning.
2014-04-09 14:21:57,004 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) VM state transitted from :Starting
to Stopped with event: OperationFailedvm's original host id: null new host id:
null host id before state transition: null
2014-04-09 14:21:57,038 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-60:ctx-9fbb1b22) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vm.StartVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to
insufficient capacity
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[User|localtest004]Scope=interface
com.cloud.dc.DataCenter; id=26
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
... 36 more
2014-04-09 14:21:57,040 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-60:ctx-9fbb1b22) Complete async job-6372, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to start a VM due to insufficient capacity"}
{noformat}
Error displayed to the end user is:
Unable to start a VM due to insufficient capacity
--
This message was sent by Atlassian JIRA
(v6.2#6252)
