Rajani Karuturi created CLOUDSTACK-8525:
-------------------------------------------

             Summary: [Browser Based Upload Volume] NPE while  updating the 
state of the volume after deletion 
                 Key: CLOUDSTACK-8525
                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8525
             Project: CloudStack
          Issue Type: Bug
      Security Level: Public (Anyone can view this level - this is the default.)
            Reporter: Rajani Karuturi


Steps:

1.  Install and configure adv zone (XenServer 65).
2.  Reduce Storage cleanup thread interval to 10 seconds 
3.  Upload Browser based Volume and it wait for it to get into uploadabandoned 
state 
4. Delete this volume before its cleaned by storage scavenger thread 

[root@localhost management]# cloudstack-sccs
9e5751d447de804236f737c7f609803509bc1fe6

Observation:
1. NPE while  updating the state of the volume after deletion 
2. Volume's removed field is updated correctly 

2015-05-25 01:07:03,110 DEBUG [c.c.a.t.Request] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq 
3-8581890564931191775: Sending  { Cmd , MgmtId: 227386426271380, via: 
3(xrtuk-11-37), Ver: v1, Flags: 100011, 
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","id":2,"poolType":"NetworkFilesystem","host":"10.81.56.7","path":"/xenrtnfs/1072973-sgP830","port":2049,"url":"NetworkFilesystem://10.81.56.7/xenrtnfs/1072973-sgP830/?ROLE=Primary&STOREUUID=7858e07c-8cd1-304f-ab6b-6797ffccef81"}},"name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","size":1073741824,"path":"459002b9-0bf0-4b0d-aa3f-717810243c7f","volumeId":36,"accountId":8,"format":"VHD","provisioningType":"THIN","id":36,"hypervisorType":"XenServer"}},"wait":0}}]
 }
2015-05-25 01:07:03,116 DEBUG [c.c.a.t.Request] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq 
3-8581890564931191775: Executing:  { Cmd , MgmtId: 227386426271380, via: 
3(xrtuk-11-37), Ver: v1, Flags: 100011, 
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","id":2,"poolType":"NetworkFilesystem","host":"10.81.56.7","path":"/xenrtnfs/1072973-sgP830","port":2049,"url":"NetworkFilesystem://10.81.56.7/xenrtnfs/1072973-sgP830/?ROLE=Primary&STOREUUID=7858e07c-8cd1-304f-ab6b-6797ffccef81"}},"name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","size":1073741824,"path":"459002b9-0bf0-4b0d-aa3f-717810243c7f","volumeId":36,"accountId":8,"format":"VHD","provisioningType":"THIN","id":36,"hypervisorType":"XenServer"}},"wait":0}}]
 }
2015-05-25 01:07:03,116 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-456:ctx-0089da79) (logid:e069e1a3) Seq 3-8581890564931191775: 
Executing request
2015-05-25 01:07:03,183 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-114:ctx-7c8d04b9) (logid:7e97efc8) Seq 3-8581890564931191774: 
Response Received:
2015-05-25 01:07:03,184 DEBUG [c.c.a.t.Request] (DirectAgent-114:ctx-7c8d04b9) 
(logid:7e97efc8) Seq 3-8581890564931191774: Processing:  { Ans: , MgmtId: 
227386426271380, via: 3, Ver: v1, Flags: 10, 
[{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2015-05-25 01:07:03,184 DEBUG [c.c.a.t.Request] 
(StorageManager-Scavenger-1:ctx-32a7c719) (logid:7e97efc8) Seq 
3-8581890564931191774: Received:  { Ans: , MgmtId: 227386426271380, via: 3, 
Ver: v1, Flags: 10, { Answer } }
2015-05-25 01:07:03,191 INFO  [o.a.c.s.v.VolumeServiceImpl] 
(StorageManager-Scavenger-1:ctx-32a7c719) (logid:7e97efc8) Volume 36 is not 
referred anywhere, remove it from volumes table
2015-05-25 01:07:03,520 DEBUG [c.c.s.StatsCollector] 
(StatsCollector-4:ctx-da28a558) (logid:9db09e02) AutoScaling Monitor is 
running...
2015-05-25 01:07:03,649 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-c8b82107) (logid:74fb8811) Zone 1 is ready to launch 
secondary storage VM
2015-05-25 01:07:03,668 DEBUG [c.c.c.ConsoleProxyManagerImpl] 
(consoleproxy-1:ctx-32fb0838) (logid:2868cf13) Zone 1 is ready to launch 
console proxy
2015-05-25 01:07:04,173 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentManager-Handler-10:null) (logid:) SeqA 4-4171: Processing Seq 4-4171:  { 
Cmd , MgmtId: -1, via: 4, Ver: v1, Flags: 11, 
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
  \"connections\": []\n}","wait":0}}] }
2015-05-25 01:07:04,176 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentManager-Handler-10:null) (logid:) SeqA 4-4171: Sending Seq 4-4171:  { 
Ans: , MgmtId: 227386426271380, via: 4, Ver: v1, Flags: 100010, 
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-05-25 01:07:06,495 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-17:ctx-19af0444) (logid:75ae8eb2) ===START===  10.102.192.188 -- 
GET  
jobid=c18e2a5b-195f-42c0-a680-f1c1dc493208&apiKey=kL1MvJiP7c7CHmgDkUmhZ_qxi0V_P9j6-c6_u5Y--7qmq3gM2QCRFjCizD3wdfJgL3RxtBmPoLr5nAen7CXSJg&command=queryAsyncJobResult&response=json&signature=L9vkSIG2PlB9gsFSnefyPDsoqrk%3D
2015-05-25 01:07:06,514 DEBUG [c.c.a.ApiServlet] (catalina-exec-17:ctx-19af0444 
ctx-17f75fdd ctx-701eac22) (logid:75ae8eb2) ===END===  10.102.192.188 -- GET  
jobid=c18e2a5b-195f-42c0-a680-f1c1dc493208&apiKey=kL1MvJiP7c7CHmgDkUmhZ_qxi0V_P9j6-c6_u5Y--7qmq3gM2QCRFjCizD3wdfJgL3RxtBmPoLr5nAen7CXSJg&command=queryAsyncJobResult&response=json&signature=L9vkSIG2PlB9gsFSnefyPDsoqrk%3D
2015-05-25 01:07:07,742 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] 
(AsyncJobMgr-Heartbeat-1:ctx-6cc4b2f0) (logid:85e31bb2) Begin cleanup expired 
async-jobs
2015-05-25 01:07:07,748 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl] 
(AsyncJobMgr-Heartbeat-1:ctx-6cc4b2f0) (logid:85e31bb2) End cleanup expired 
async-jobs
2015-05-25 01:07:09,417 DEBUG [c.c.h.x.r.XenServerStorageProcessor] 
(DirectAgent-456:ctx-0089da79) (logid:c18e2a5b) Failed to delete volume
You gave an invalid object reference.  The object may have recently been 
deleted.  The class parameter gives the type of reference given, and the handle 
parameter echoes the bad value given.
        at com.xensource.xenapi.Types.checkResponse(Types.java:693)
        at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
        at 
com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:463)
        at com.xensource.xenapi.VDI.destroy(VDI.java:416)
        at 
com.cloud.hypervisor.xenserver.resource.XenServerStorageProcessor.deleteVDI(XenServerStorageProcessor.java:402)
        at 
com.cloud.hypervisor.xenserver.resource.XenServerStorageProcessor.deleteVolume(XenServerStorageProcessor.java:466)
        at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:124)
        at 
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:57)
        at 
com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:532)
        at 
com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
        at 
com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:88)
        at 
com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
        at 
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:317)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,417 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-456:ctx-0089da79) (logid:c18e2a5b) Seq 3-8581890564931191775: 
Response Received:
2015-05-25 01:07:09,422 DEBUG [c.c.a.t.Request] (DirectAgent-456:ctx-0089da79) 
(logid:c18e2a5b) Seq 3-8581890564931191775: Processing:  { Ans: , MgmtId: 
227386426271380, via: 3, Ver: v1, Flags: 10, 
[{"com.cloud.agent.api.Answer":{"result":false,"details":"You gave an invalid 
object reference.  The object may have recently been deleted.  The class 
parameter gives the type of reference given, and the handle parameter echoes 
the bad value given.","wait":0}}] }
2015-05-25 01:07:09,422 DEBUG [c.c.a.t.Request] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq 
3-8581890564931191775: Received:  { Ans: , MgmtId: 227386426271380, via: 3, 
Ver: v1, Flags: 10, { Answer } }
2015-05-25 01:07:09,423 DEBUG [o.a.c.s.v.VolumeObject] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Failed 
to update state
java.lang.NullPointerException
        at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:113)
        at 
org.apache.cloudstack.storage.volume.VolumeObject.stateTransit(VolumeObject.java:185)
        at 
org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:331)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.deleteVolumeCallback(VolumeServiceImpl.java:341)
        at sun.reflect.GeneratedMethodAccessor331.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
        at 
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
        at 
org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:227)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:325)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolumeCallBack(VolumeServiceImpl.java:1029)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
        at 
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
        at 
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:467)
        at 
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
        at 
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
        at 
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
        at 
com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2002)
        at 
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
        at 
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
        at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
        at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy194.migrateVolume(Unknown Source)
        at 
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin.execute(MigrateVolumeCmdByAdmin.java:38)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
        at 
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:549)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:500)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,424 DEBUG [o.a.c.s.v.VolumeServiceImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) ignore 
delete volume status update failure, it will be picked up by storage clean up 
thread later
java.lang.NullPointerException
        at 
org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:337)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.deleteVolumeCallback(VolumeServiceImpl.java:341)
        at sun.reflect.GeneratedMethodAccessor331.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
        at 
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
        at 
org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:227)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:325)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolumeCallBack(VolumeServiceImpl.java:1029)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
        at 
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
        at 
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
        at 
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:467)
        at 
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
        at 
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
        at 
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
        at 
com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2002)
        at 
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
        at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
        at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy194.migrateVolume(Unknown Source)
        at 
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin.execute(MigrateVolumeCmdByAdmin.java:38)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
        at 
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:549)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:500)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) 
Complete async job-226, jobStatus: SUCCEEDED, resultCode: 0, result: 
org.apache.cloudstack.api.response.VolumeResponse/volume/{"id":"437c4ff1-af8a-4844-8484-fb0fe50a9823","name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","zoneid":"d1b399aa-cbb4-4388-8dde-a57b041bffb8","zonename":"XenRT-Zone-0","type":"DATADISK","provisioningtype":"thin","size":1073741824,"created":"2015-05-25T01:06:55+0000","state":"Ready","account":"test-a-TestBrowseUploadVolume-156334","domainid":"ddd2b082-022e-11e5-9d0a-cece872a2694","domain":"ROOT","storagetype":"shared","hypervisor":"XenServer","diskofferingid":"32673cea-76be-496c-99c4-2a4287ec43c9","diskofferingname":"Custom","diskofferingdisplaytext":"Custom
 
Disk","storage":"XenRT-Zone-0-Pod-0-Cluster-1-Primary-Store-0","destroyed":false,"isextractable":true,"tags":[],"displayvolume":true,"path":"66b8bb1a-6543-4103-aa6b-c07aa51f17ec","storageid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","quiescevm":false}
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) 
Publish async job-226 complete on message bus
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Wake 
up jobs related to job-226
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Update 
db status for job-226
2015-05-25 01:07:09,436 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Wake 
up jobs joined with job-226 and disjoin all subjobs created from job- 226
2015-05-25 01:07:09,442 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-92:ctx-7af38e5e job-226) (logid:c18e2a5b) Done executing 
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin for 
job-226
2015-05-25 01:07:09,442 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(API-Job-Executor-92:ctx-7af38e5e job-226) (logid:c18e2a5b) Remove job-226 from 
job monitoring


Notes:  I have not observed this in the previous automation runs.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to