angeline shen created CLOUDSTACK-5830:
-----------------------------------------
Summary: [vmware] Vcenter 5.5 host ESXi 5.5 unable to deploy VM,
unable to destroy SSVM
Key: CLOUDSTACK-5830
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5830
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server
Affects Versions: 4.3.0
Environment: MS build 1/7/2014
vcenter 5.5 host1 host2 ESXi 5.5
Reporter: angeline shen
Priority: Blocker
Fix For: 4.3.0
1. advance zone.
2. mysql DB: update service_offering set ram_size = 512 where vm_type=
'secondarystoragevm'
3. attempt to destroy SSVM s-1-VM failed.
2014-01-07 13:18:27,627 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-24:ctx-f3730c63 ctx-e22956d8) Unable to destroy the vm because it
is not in the correct state: VM[SecondaryStorageVm|s-1-VM]
2014-01-07 13:18:27,644 WARN [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-26:ctx-5c84cfbd) job-24 is scheduled for wakeup run, but there is
no joining info anymore
2014-01-07 13:18:27,644 ERROR [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-26:ctx-5c84cfbd) Unable to find a wakeup dispatcher from the
joined job: AsyncJobVO {id:24, userId: 2, accountId: 2, instanceType: S
ystemVm, instanceId: 1, cmd:
org.apache.cloudstack.api.command.admin.systemvm.DestroySystemVmCmd, cmdInfo:
{"response":"json","id":"d7bd162e-308a-4b4e-92ff-e27d223f0346","sessionkey":"l+d7+bwKNP/cJpgZSM8Z1WRcne
M\u003d","cmdEventType":"SSVM.DESTROY","ctxUserId":"2","httpmethod":"GET","_":"1389129851873","ctxAccountId":"2","ctxStartEventId":"58"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 7425730021290, completeMsid: null, lastUpdated: null,
lastPolled: Tue Jan 07 13:18:25 PST 2014, created: Tue Jan 07 13:17:57 PST 2014}
2014-01-07 13:18:27,645 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-26:ctx-5c84cfbd) Done executing
org.apache.cloudstack.api.command.admin.systemvm.DestroySystemVmCmd for job-24
2014-01-07 13:18:27,650 DEBUG [o.a.c.f.j.i.SyncQueueManagerImpl]
(Job-Executor-25:ctx-284719f1) Sync queue (1) is currently empty
2014-01-07 13:18:27,654 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-25:ctx-284719f1) Remove job-25 from job monitoring
2014-01-07 13:18:27,658 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-26:ctx-5c84cfbd) Remove job-24 from job monitoring
2014-01-07 13:18:27,660 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-24:ctx-f3730c63) Unexpected exception while executing
org.apache.cloudstack.api.command.admin.systemvm.DestroySystemVmCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to destroy
VM[SecondaryStorageVm|s-1-VM]
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:469)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:448)
at
com.cloud.vm.VirtualMachineManagerImpl.expunge(VirtualMachineManagerImpl.java:437)
at
com.cloud.storage.secondary.SecondaryStorageManagerImpl.destroySecStorageVm(SecondaryStorageManagerImpl.java:975)
at
com.cloud.server.ManagementServerImpl.destroySecondaryStorageVm(ManagementServerImpl.java:3060)
at
com.cloud.server.ManagementServerImpl.destroySystemVM(ManagementServerImpl.java:3238)
at
com.cloud.server.ManagementServerImpl.destroySystemVM(ManagementServerImpl.java:610)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at sun.proxy.$Proxy193.destroySystemVM(Unknown Source)
at
org.apache.cloudstack.api.command.admin.systemvm.DestroySystemVmCmd.execute(DestroySystemVmCmd.java:97)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:524)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.utils.fsm.NoTransitionException: Unable to transition to a
new state from Running via ExpungeOperation
at com.cloud.utils.fsm.StateMachine2.getNextState(StateMachine2.java:83)
at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:100)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.utils.fsm.NoTransitionException: Unable to transition to a
new state from Running via ExpungeOperation
at com.cloud.utils.fsm.StateMachine2.getNextState(StateMachine2.java:83)
at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:100)
at
com.cloud.vm.VirtualMachineManagerImpl.stateTransitTo(VirtualMachineManagerImpl.java:1511)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:462)
... 39 more
2014-01-07 13:18:27,665 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-24:ctx-f3730c63) Complete async job-24, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to destroy VM[SecondaryStorageVm|s-1-VM]"}
2014-01-07 13:18:27,676 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-24:ctx-f3730c63) Done executing
org.apache.cloudstack.api.command.admin.systemvm.DestroySystemVmCmd for job-24
2014-01-07 13:18:27,683 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-24:ctx-f3730c63) Remove job-24 from job monitoring
2014-01-07 13:18:28,012 DEBUG [c.c.a.ApiServlet] (catalina-exec-3:ctx-6f71e143)
===START=== 10.215.3.21 -- GET
command=queryAsyncJobResult&jobId=f7652025-f9dd-4ae3-8d57-4584012f7f97&response=json&sessionkey=l%2Bd7%2BbwKNP%2FcJpgZSM8Z1WRcneM%3D&_=1389129882078
2014-01-07 13:18:28,047 DEBUG [c.c.a.ApiServlet] (catalina-exec-3:ctx-6f71e143
ctx-1fbd0d13) ===END=== 10.215.3.21 -- GET
command=queryAsyncJobResult&jobId=f7652025-f9dd-4ae3-8d57-4584012f7f97&response=json
4. attempt to deploy VM failed.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
