Rajani Karuturi created CLOUDSTACK-8525:
-------------------------------------------
Summary: [Browser Based Upload Volume] NPE while updating the
state of the volume after deletion
Key: CLOUDSTACK-8525
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-8525
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Reporter: Rajani Karuturi
Steps:
1. Install and configure adv zone (XenServer 65).
2. Reduce Storage cleanup thread interval to 10 seconds
3. Upload Browser based Volume and it wait for it to get into uploadabandoned
state
4. Delete this volume before its cleaned by storage scavenger thread
[root@localhost management]# cloudstack-sccs
9e5751d447de804236f737c7f609803509bc1fe6
Observation:
1. NPE while updating the state of the volume after deletion
2. Volume's removed field is updated correctly
2015-05-25 01:07:03,110 DEBUG [c.c.a.t.Request]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq
3-8581890564931191775: Sending { Cmd , MgmtId: 227386426271380, via:
3(xrtuk-11-37), Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","id":2,"poolType":"NetworkFilesystem","host":"10.81.56.7","path":"/xenrtnfs/1072973-sgP830","port":2049,"url":"NetworkFilesystem://10.81.56.7/xenrtnfs/1072973-sgP830/?ROLE=Primary&STOREUUID=7858e07c-8cd1-304f-ab6b-6797ffccef81"}},"name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","size":1073741824,"path":"459002b9-0bf0-4b0d-aa3f-717810243c7f","volumeId":36,"accountId":8,"format":"VHD","provisioningType":"THIN","id":36,"hypervisorType":"XenServer"}},"wait":0}}]
}
2015-05-25 01:07:03,116 DEBUG [c.c.a.t.Request]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq
3-8581890564931191775: Executing: { Cmd , MgmtId: 227386426271380, via:
3(xrtuk-11-37), Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","id":2,"poolType":"NetworkFilesystem","host":"10.81.56.7","path":"/xenrtnfs/1072973-sgP830","port":2049,"url":"NetworkFilesystem://10.81.56.7/xenrtnfs/1072973-sgP830/?ROLE=Primary&STOREUUID=7858e07c-8cd1-304f-ab6b-6797ffccef81"}},"name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","size":1073741824,"path":"459002b9-0bf0-4b0d-aa3f-717810243c7f","volumeId":36,"accountId":8,"format":"VHD","provisioningType":"THIN","id":36,"hypervisorType":"XenServer"}},"wait":0}}]
}
2015-05-25 01:07:03,116 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-456:ctx-0089da79) (logid:e069e1a3) Seq 3-8581890564931191775:
Executing request
2015-05-25 01:07:03,183 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-114:ctx-7c8d04b9) (logid:7e97efc8) Seq 3-8581890564931191774:
Response Received:
2015-05-25 01:07:03,184 DEBUG [c.c.a.t.Request] (DirectAgent-114:ctx-7c8d04b9)
(logid:7e97efc8) Seq 3-8581890564931191774: Processing: { Ans: , MgmtId:
227386426271380, via: 3, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2015-05-25 01:07:03,184 DEBUG [c.c.a.t.Request]
(StorageManager-Scavenger-1:ctx-32a7c719) (logid:7e97efc8) Seq
3-8581890564931191774: Received: { Ans: , MgmtId: 227386426271380, via: 3,
Ver: v1, Flags: 10, { Answer } }
2015-05-25 01:07:03,191 INFO [o.a.c.s.v.VolumeServiceImpl]
(StorageManager-Scavenger-1:ctx-32a7c719) (logid:7e97efc8) Volume 36 is not
referred anywhere, remove it from volumes table
2015-05-25 01:07:03,520 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-da28a558) (logid:9db09e02) AutoScaling Monitor is
running...
2015-05-25 01:07:03,649 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-c8b82107) (logid:74fb8811) Zone 1 is ready to launch
secondary storage VM
2015-05-25 01:07:03,668 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-32fb0838) (logid:2868cf13) Zone 1 is ready to launch
console proxy
2015-05-25 01:07:04,173 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) (logid:) SeqA 4-4171: Processing Seq 4-4171: {
Cmd , MgmtId: -1, via: 4, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-05-25 01:07:04,176 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) (logid:) SeqA 4-4171: Sending Seq 4-4171: {
Ans: , MgmtId: 227386426271380, via: 4, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-05-25 01:07:06,495 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-19af0444) (logid:75ae8eb2) ===START=== 10.102.192.188 --
GET
jobid=c18e2a5b-195f-42c0-a680-f1c1dc493208&apiKey=kL1MvJiP7c7CHmgDkUmhZ_qxi0V_P9j6-c6_u5Y--7qmq3gM2QCRFjCizD3wdfJgL3RxtBmPoLr5nAen7CXSJg&command=queryAsyncJobResult&response=json&signature=L9vkSIG2PlB9gsFSnefyPDsoqrk%3D
2015-05-25 01:07:06,514 DEBUG [c.c.a.ApiServlet] (catalina-exec-17:ctx-19af0444
ctx-17f75fdd ctx-701eac22) (logid:75ae8eb2) ===END=== 10.102.192.188 -- GET
jobid=c18e2a5b-195f-42c0-a680-f1c1dc493208&apiKey=kL1MvJiP7c7CHmgDkUmhZ_qxi0V_P9j6-c6_u5Y--7qmq3gM2QCRFjCizD3wdfJgL3RxtBmPoLr5nAen7CXSJg&command=queryAsyncJobResult&response=json&signature=L9vkSIG2PlB9gsFSnefyPDsoqrk%3D
2015-05-25 01:07:07,742 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-6cc4b2f0) (logid:85e31bb2) Begin cleanup expired
async-jobs
2015-05-25 01:07:07,748 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-6cc4b2f0) (logid:85e31bb2) End cleanup expired
async-jobs
2015-05-25 01:07:09,417 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
(DirectAgent-456:ctx-0089da79) (logid:c18e2a5b) Failed to delete volume
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at com.xensource.xenapi.Types.checkResponse(Types.java:693)
at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
at
com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:463)
at com.xensource.xenapi.VDI.destroy(VDI.java:416)
at
com.cloud.hypervisor.xenserver.resource.XenServerStorageProcessor.deleteVDI(XenServerStorageProcessor.java:402)
at
com.cloud.hypervisor.xenserver.resource.XenServerStorageProcessor.deleteVolume(XenServerStorageProcessor.java:466)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:124)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:57)
at
com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:532)
at
com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
at
com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:88)
at
com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:317)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,417 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-456:ctx-0089da79) (logid:c18e2a5b) Seq 3-8581890564931191775:
Response Received:
2015-05-25 01:07:09,422 DEBUG [c.c.a.t.Request] (DirectAgent-456:ctx-0089da79)
(logid:c18e2a5b) Seq 3-8581890564931191775: Processing: { Ans: , MgmtId:
227386426271380, via: 3, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"You gave an invalid
object reference. The object may have recently been deleted. The class
parameter gives the type of reference given, and the handle parameter echoes
the bad value given.","wait":0}}] }
2015-05-25 01:07:09,422 DEBUG [c.c.a.t.Request]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Seq
3-8581890564931191775: Received: { Ans: , MgmtId: 227386426271380, via: 3,
Ver: v1, Flags: 10, { Answer } }
2015-05-25 01:07:09,423 DEBUG [o.a.c.s.v.VolumeObject]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Failed
to update state
java.lang.NullPointerException
at com.cloud.utils.fsm.StateMachine2.transitTo(StateMachine2.java:113)
at
org.apache.cloudstack.storage.volume.VolumeObject.stateTransit(VolumeObject.java:185)
at
org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:331)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.deleteVolumeCallback(VolumeServiceImpl.java:341)
at sun.reflect.GeneratedMethodAccessor331.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
at
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
at
org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:227)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:325)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolumeCallBack(VolumeServiceImpl.java:1029)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
at
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:467)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
at
com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2002)
at
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
at
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy194.migrateVolume(Unknown Source)
at
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin.execute(MigrateVolumeCmdByAdmin.java:38)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:549)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:500)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,424 DEBUG [o.a.c.s.v.VolumeServiceImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) ignore
delete volume status update failure, it will be picked up by storage clean up
thread later
java.lang.NullPointerException
at
org.apache.cloudstack.storage.volume.VolumeObject.processEvent(VolumeObject.java:337)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.deleteVolumeCallback(VolumeServiceImpl.java:341)
at sun.reflect.GeneratedMethodAccessor331.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
at
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
at
org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:227)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:325)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolumeCallBack(VolumeServiceImpl.java:1029)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.dispatch(AsyncCallbackDispatcher.java:148)
at
org.apache.cloudstack.framework.async.InplaceAsyncCallbackDriver.performCompletionCallback(InplaceAsyncCallbackDriver.java:25)
at
org.apache.cloudstack.framework.async.AsyncCallbackDispatcher.complete(AsyncCallbackDispatcher.java:126)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:467)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.copyVolume(VolumeServiceImpl.java:996)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolume(VolumeOrchestrator.java:923)
at
com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2002)
at
com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1988)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy194.migrateVolume(Unknown Source)
at
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin.execute(MigrateVolumeCmdByAdmin.java:38)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:549)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:500)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2015-05-25 01:07:09,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b)
Complete async job-226, jobStatus: SUCCEEDED, resultCode: 0, result:
org.apache.cloudstack.api.response.VolumeResponse/volume/{"id":"437c4ff1-af8a-4844-8484-fb0fe50a9823","name":"XenUploadVoltest-a-TestBrowseUploadVolume-156334P","zoneid":"d1b399aa-cbb4-4388-8dde-a57b041bffb8","zonename":"XenRT-Zone-0","type":"DATADISK","provisioningtype":"thin","size":1073741824,"created":"2015-05-25T01:06:55+0000","state":"Ready","account":"test-a-TestBrowseUploadVolume-156334","domainid":"ddd2b082-022e-11e5-9d0a-cece872a2694","domain":"ROOT","storagetype":"shared","hypervisor":"XenServer","diskofferingid":"32673cea-76be-496c-99c4-2a4287ec43c9","diskofferingname":"Custom","diskofferingdisplaytext":"Custom
Disk","storage":"XenRT-Zone-0-Pod-0-Cluster-1-Primary-Store-0","destroyed":false,"isextractable":true,"tags":[],"displayvolume":true,"path":"66b8bb1a-6543-4103-aa6b-c07aa51f17ec","storageid":"7858e07c-8cd1-304f-ab6b-6797ffccef81","quiescevm":false}
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b)
Publish async job-226 complete on message bus
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Wake
up jobs related to job-226
2015-05-25 01:07:09,435 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Update
db status for job-226
2015-05-25 01:07:09,436 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226 ctx-2995ce7d) (logid:c18e2a5b) Wake
up jobs joined with job-226 and disjoin all subjobs created from job- 226
2015-05-25 01:07:09,442 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-92:ctx-7af38e5e job-226) (logid:c18e2a5b) Done executing
org.apache.cloudstack.api.command.admin.volume.MigrateVolumeCmdByAdmin for
job-226
2015-05-25 01:07:09,442 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-92:ctx-7af38e5e job-226) (logid:c18e2a5b) Remove job-226 from
job monitoring
Notes: I have not observed this in the previous automation runs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)