[ https://issues.apache.org/jira/browse/CLOUDSTACK-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Srikanteswararao Talluri updated CLOUDSTACK-1608: ------------------------------------------------- Assignee: edison su > ZWPS: attach volume created on cluster wide primary storage to a VM whose > root volume is on ZWPS > ------------------------------------------------------------------------------------------------ > > Key: CLOUDSTACK-1608 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1608 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Volumes > Affects Versions: 4.2.0 > Environment: KVM, advanced zone > Reporter: Srikanteswararao Talluri > Assignee: edison su > Priority: Critical > Fix For: 4.2.0 > > > Steps to reproduce: > ============== > 1. add a zone wide primary storage "Z" with tag "z2" > 2. add a compute offering "C" with storage tag "z2" > 3. deploy a VM "testVM" with compute offering "C". > 4. create a volume "V" on disk offering which uses cluster wide primary > storage > 5. attache volume "V" to VM " testVM". > ===START=== 10.101.254.233 -- GET > command=createVolume&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&name=h&zoneId=371976d5-d065-4eb6-81d3-a229b7f90ce7&diskOfferingId=30ac6ef3-1a32-4f0d-806c-180f7740ea0f&_=1362754386929 > 2013-03-09 01:50:07,499 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) > ===START=== 10.101.254.233 -- GET > command=queryAsyncJobResult&jobId=91e2f11a-bb8a-4e52-b1f4-502d137afcd0&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754387005 > 2013-03-09 01:50:07,516 DEBUG [cloud.async.AsyncJobManagerImpl] > (catalina-exec-20:null) submit async job-27, details: AsyncJobVO {id:27, > userId: 2, accountId: 2, sessionKey: null, instanceType: null, instanceId: > 12, cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd, > cmdOriginator: null, cmdInfo: > {"id":"12","response":"json","sessionkey":"iBYcRekcomjfH6jh3i1k2Xi7vwo\u003d","ctxUserId":"2","diskOfferingId":"30ac6ef3-1a32-4f0d-806c-180f7740ea0f","name":"h","_":"1362754386929","ctxAccountId":"2","ctxStartEventId":"33","zoneId":"371976d5-d065-4eb6-81d3-a229b7f90ce7"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 7614406590488, > completeMsid: null, lastUpdated: null, lastPolled: null, created: null} > 2013-03-09 01:50:07,520 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) > ===END=== 10.101.254.233 -- GET > command=createVolume&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&name=h&zoneId=371976d5-d065-4eb6-81d3-a229b7f90ce7&diskOfferingId=30ac6ef3-1a32-4f0d-806c-180f7740ea0f&_=1362754386929 > 2013-03-09 01:50:07,523 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-14:job-27) Executing > org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-27 > 2013-03-09 01:50:07,546 DEBUG [cloud.async.AsyncJobManagerImpl] > (catalina-exec-2:null) Async job-26 completed > 2013-03-09 01:50:07,562 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-14:job-27) Complete async job-27, jobStatus: 1, resultCode: 0, > result: org.apache.cloudstack.api.response.VolumeResponse@5d9835b5 > 2013-03-09 01:50:07,567 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) > ===END=== 10.101.254.233 -- GET > command=queryAsyncJobResult&jobId=91e2f11a-bb8a-4e52-b1f4-502d137afcd0&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754387005 > 2013-03-09 01:50:07,573 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-14:job-27) Done executing > org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-27 > 2013-03-09 01:50:07,624 DEBUG [storage.secondary.SecondaryStorageManagerImpl] > (secstorage-1:null) Zone 1 is ready to launch secondary storage VM > 2013-03-09 01:50:07,723 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Zone 1 is ready to launch console proxy > 2013-03-09 01:50:08,061 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 1 routers to update status. > 2013-03-09 01:50:08,063 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-03-09 01:50:08,107 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 1 routers to update status. > 2013-03-09 01:50:08,109 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] > (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. > 2013-03-09 01:50:09,469 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-4:null) Ping from 3 > 2013-03-09 01:50:09,520 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-8:null) Ping from 4 > 2013-03-09 01:50:09,818 INFO [agent.manager.AgentMonitor] (Thread-6:null) > Found the following agents behind on ping: [1] > 2013-03-09 01:50:09,820 DEBUG [cloud.host.Status] (Thread-6:null) Ping > timeout for host 1, do invstigation > 2013-03-09 01:50:09,824 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Investigating why host 1 has disconnected with event > PingTimeout > 2013-03-09 01:50:09,824 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) checking if agent (1) is alive > 2013-03-09 01:50:09,830 DEBUG [agent.transport.Request] > (AgentTaskPool-10:null) Seq 1-602734731: Sending { Cmd , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 100011, > [{"CheckHealthCommand":{"wait":50}}] } > 2013-03-09 01:50:09,833 DEBUG [agent.transport.Request] > (AgentManager-Handler-10:null) Seq 1-602734731: Processing: { Ans: , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 10, > [{"CheckHealthAnswer":{"result":true,"details":"resource is > alive","wait":0}}] } > 2013-03-09 01:50:09,834 DEBUG [agent.transport.Request] > (AgentTaskPool-10:null) Seq 1-602734731: Received: { Ans: , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 10, { CheckHealthAnswer } } > 2013-03-09 01:50:09,834 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Details from executing class > com.cloud.agent.api.CheckHealthCommand: resource is alive > 2013-03-09 01:50:09,834 DEBUG [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) agent (1) responded to checkHeathCommand, reporting > that agent is Up > 2013-03-09 01:50:09,834 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) The state determined is Up > 2013-03-09 01:50:09,834 INFO [agent.manager.AgentManagerImpl] > (AgentTaskPool-10:null) Agent is determined to be up and running > 2013-03-09 01:50:09,834 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) > Transition:[Resource state = Enabled, Agent event = Ping, Host id = 1, name = > Rack1Pod1Host18] > 2013-03-09 01:50:09,844 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) > Agent status update: [id = 1; name = Rack1Pod1Host18; old status = Up; event > = Ping; new status = Up; old update count = 86; new update count = 87] > 2013-03-09 01:50:09,996 DEBUG [agent.manager.AgentManagerImpl] > (AgentManager-Handler-11:null) Ping from 1 > 2013-03-09 01:50:10,817 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) > ===START=== 10.101.254.233 -- GET > command=queryAsyncJobResult&jobId=52792ca4-996a-4c56-838e-6dc0859ead30&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754390318 > 2013-03-09 01:50:10,837 DEBUG [cloud.async.AsyncJobManagerImpl] > (catalina-exec-24:null) Async job-27 completed > 2013-03-09 01:50:10,845 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) > ===END=== 10.101.254.233 -- GET > command=queryAsyncJobResult&jobId=52792ca4-996a-4c56-838e-6dc0859ead30&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754390318 > 2013-03-09 01:50:12,910 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) > ===START=== 10.101.254.233 -- GET > command=listVolumes&id=6e92129b-f486-4bba-8f30-0c463ec58a00&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754392416 > 2013-03-09 01:50:12,934 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) > ===END=== 10.101.254.233 -- GET > command=listVolumes&id=6e92129b-f486-4bba-8f30-0c463ec58a00&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754392416 > 2013-03-09 01:50:13,230 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) > ===START=== 10.101.254.233 -- GET > command=listTags&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&resourceId=6e92129b-f486-4bba-8f30-0c463ec58a00&resourceType=Volume&listAll=true&_=1362754392700 > 2013-03-09 01:50:13,244 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) > ===END=== 10.101.254.233 -- GET > command=listTags&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&resourceId=6e92129b-f486-4bba-8f30-0c463ec58a00&resourceType=Volume&listAll=true&_=1362754392700 > 2013-03-09 01:50:14,622 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) > ===START=== 10.101.254.233 -- GET > command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Running&_=1362754394002 > 2013-03-09 01:50:14,639 DEBUG [cloud.user.AccountManagerImpl] > (catalina-exec-6:null) Access granted to Acct[2-admin] to Domain:1/ by > DomainChecker > 2013-03-09 01:50:14,694 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) > ===END=== 10.101.254.233 -- GET > command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Running&_=1362754394002 > 2013-03-09 01:50:14,913 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) > ===START=== 10.101.254.233 -- GET > command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Stopped&_=1362754394414 > 2013-03-09 01:50:14,930 DEBUG [cloud.user.AccountManagerImpl] > (catalina-exec-8:null) Access granted to Acct[2-admin] to Domain:1/ by > DomainChecker > 2013-03-09 01:50:14,940 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) > ===END=== 10.101.254.233 -- GET > command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Stopped&_=1362754394414 > 2013-03-09 01:50:17,504 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) > ===START=== 10.101.254.233 -- GET > command=attachVolume&id=6e92129b-f486-4bba-8f30-0c463ec58a00&virtualMachineId=e51366fa-5423-4132-82f5-31c4230ddaae&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754396885 > 2013-03-09 01:50:17,546 DEBUG [cloud.async.AsyncJobManagerImpl] > (catalina-exec-4:null) submit async job-28, details: AsyncJobVO {id:28, > userId: 2, accountId: 2, sessionKey: null, instanceType: null, instanceId: > 12, cmd: org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, > cmdOriginator: null, cmdInfo: > {"response":"json","id":"6e92129b-f486-4bba-8f30-0c463ec58a00","sessionkey":"iBYcRekcomjfH6jh3i1k2Xi7vwo\u003d","ctxUserId":"2","virtualMachineId":"e51366fa-5423-4132-82f5-31c4230ddaae","_":"1362754396885","ctxAccountId":"2","ctxStartEventId":"34"}, > cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, > processStatus: 0, resultCode: 0, result: null, initMsid: 7614406590488, > completeMsid: null, lastUpdated: null, lastPolled: null, created: null} > 2013-03-09 01:50:17,550 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) > ===END=== 10.101.254.233 -- GET > command=attachVolume&id=6e92129b-f486-4bba-8f30-0c463ec58a00&virtualMachineId=e51366fa-5423-4132-82f5-31c4230ddaae&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754396885 > 2013-03-09 01:50:17,552 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-15:job-28) Executing > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-28 > 2013-03-09 01:50:17,613 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-15:job-28) Checking pool: 201 for volume allocation > [Vol[12|vm=null|DATADISK]], maxSize : 0, totalAllocatedSize : 0, askingSize : > 5368709120, allocated disable threshold: 0.85 > 2013-03-09 01:50:17,614 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-15:job-28) Insufficient un-allocated capacity on: 201 for > volume allocation: [Vol[12|vm=null|DATADISK]] since its allocated percentage: > Infinity has crossed the allocated > pool.storage.allocated.capacity.disablethreshold: 0.85, skipping this pool > 2013-03-09 01:50:17,627 DEBUG [cloud.storage.StorageManagerImpl] > (Job-Executor-15:job-28) Checking pool: 202 for volume allocation > [Vol[12|vm=null|DATADISK]], maxSize : 3518437261312, totalAllocatedSize : 0, > askingSize : 5368709120, allocated disable threshold: 0.85 > 2013-03-09 01:50:17,633 DEBUG [cloud.storage.VolumeManagerImpl] > (Job-Executor-15:job-28) Trying to create > org.apache.cloudstack.storage.volume.VolumeObject@1fa57753 on > org.apache.cloudstack.storage.datastore.DefaultPrimaryDataStore@283cfa60 > 2013-03-09 01:50:17,667 DEBUG [agent.transport.Request] > (Job-Executor-15:job-28) Seq 1-602734732: Sending { Cmd , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 100111, > [{"storage.CreateCommand":{"volId":12,"pool":{"id":202,"uuid":"244b1b07-11cf-3fa2-9ff2-e1a54f183594","host":"10.147.28.8","path":"/vol/dgVol/z","port":2049,"type":"NetworkFilesystem"},"diskCharacteristics":{"size":5368709120,"tags":[],"type":"DATADISK","name":"h","useLocalStorage":false,"recreatable":false,"diskOfferingId":3,"volumeId":12},"wait":0}}] > } > 2013-03-09 01:50:17,747 DEBUG [agent.transport.Request] > (AgentManager-Handler-12:null) Seq 1-602734732: Processing: { Ans: , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 110, > [{"storage.CreateAnswer":{"volume":{"id":12,"name":"/vol/dgVol/z","mountPoint":"731be6dd-272e-41b8-a2c7-6d4a0695f14b","path":"731be6dd-272e-41b8-a2c7-6d4a0695f14b","size":5368709120,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"244b1b07-11cf-3fa2-9ff2-e1a54f183594","deviceId":0},"requestTemplateReload":false,"result":true,"wait":0}}] > } > 2013-03-09 01:50:17,747 DEBUG [agent.transport.Request] > (Job-Executor-15:job-28) Seq 1-602734732: Received: { Ans: , MgmtId: > 7614406590488, via: 1, Ver: v1, Flags: 110, { CreateAnswer } } > 2013-03-09 01:50:17,750 DEBUG [agent.manager.AgentAttache] > (AgentManager-Handler-12:null) Seq 1-602734732: No more commands found > 2013-03-09 01:50:17,777 ERROR [cloud.async.AsyncJobManagerImpl] > (Job-Executor-15:job-28) Unexpected exception while executing > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd > java.lang.NullPointerException > at > com.cloud.storage.VolumeManagerImpl.needMoveVolume(VolumeManagerImpl.java:1444) > at > com.cloud.storage.VolumeManagerImpl.attachVolumeToVM(VolumeManagerImpl.java:1692) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.event.ActionEventInterceptor.AroundAnyMethod(ActionEventInterceptor.java:53) > at sun.reflect.GeneratedMethodAccessor203.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40) > at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) > at $Proxy290.attachVolumeToVM(Unknown Source) > at > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd.execute(AttachVolumeCmd.java:122) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40) > at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) > at > com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-03-09 01:50:17,781 DEBUG [cloud.async.AsyncJobManagerImpl] > (Job-Executor-15:job-28) Complete async job-28, jobStatus: 2, resultCode: > 530, result: Error Code: 530 Error text: null -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira