Rayees Namathponnan created CLOUDSTACK-5731:
-----------------------------------------------
Summary: [Automation] VM deployment failed with
ConcurrentOperationException in vmware
Key: CLOUDSTACK-5731
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5731
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server, VMware
Affects Versions: 4.3.0
Environment: vmware 5.0
branch 4.3
Reporter: Rayees Namathponnan
Priority: Critical
Fix For: 4.3.0
Attachments: management-server.rar
This issue observed in automation environment, where mulpitple deployment and
delete operation happens parallel
Vew of the vm deployment failed with below error, i will attach complete log
with this defect
2014-01-02 13:24:29,612 WARN [o.a.c.alerts] (Job-Executor-2:ctx-9e3b8e54
ctx-dd556c3f) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId::
null // message:: Failed to deploy
Vm with Id: 5, on Host with Id: null
2014-01-02 13:24:29,653 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-2:ctx-9e3b8e54) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to serialize:
com.cloud.exception.AgentUnavailableException/{"_scope":"com.cloud.host.Host","_id":1,"idList":[],"csErrorCode":4285,"detailMessage":"Resource
[Host:1] is unreachable: Host 1: Unable to start instance due to Unable to
transition to a new state from Running via
OperationFailed","cause":{"class":"com.cloud.exception.ConcurrentOperationException","msg":"Unable
to transition to a new state from Running via
OperationFailed"},"stackTrace":[{"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"orchestrateStart","fileName":"VirtualMachineManagerImpl.java","lineNumber":1053},{"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"orchestrateStart","fileName":"VirtualMachineManagerImpl.java","lineNumber":4736},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":606},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.vm.VirtualMachineManagerImpl","methodName":"handleVmWorkJob","fileName":"VirtualMachineManagerImpl.java","lineNumber":4855},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":522},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":262},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1145},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":615},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":744}],"suppressedExceptions":[]}
at
org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:135)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl.unmarshallResultObject(AsyncJobManagerImpl.java:667)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:758)
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:592)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3572)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3152)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
