Srikanteswararao Talluri created CLOUDSTACK-1608: ----------------------------------------------------
Summary: ZWPS: attach volume created on cluster wide primary storage to a VM whose root volume is on ZWPS Key: CLOUDSTACK-1608 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1608 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Volumes Affects Versions: 4.2.0 Environment: KVM, advanced zone Reporter: Srikanteswararao Talluri Priority: Critical Fix For: 4.2.0 Steps to reproduce: ============== 1. add a zone wide primary storage "Z" with tag "z2" 2. add a compute offering "C" with storage tag "z2" 3. deploy a VM "testVM" with compute offering "C". 4. create a volume "V" on disk offering which uses cluster wide primary storage 5. attache volume "V" to VM " testVM". ===START=== 10.101.254.233 -- GET command=createVolume&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&name=h&zoneId=371976d5-d065-4eb6-81d3-a229b7f90ce7&diskOfferingId=30ac6ef3-1a32-4f0d-806c-180f7740ea0f&_=1362754386929 2013-03-09 01:50:07,499 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.101.254.233 -- GET command=queryAsyncJobResult&jobId=91e2f11a-bb8a-4e52-b1f4-502d137afcd0&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754387005 2013-03-09 01:50:07,516 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-20:null) submit async job-27, details: AsyncJobVO {id:27, userId: 2, accountId: 2, sessionKey: null, instanceType: null, instanceId: 12, cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd, cmdOriginator: null, cmdInfo: {"id":"12","response":"json","sessionkey":"iBYcRekcomjfH6jh3i1k2Xi7vwo\u003d","ctxUserId":"2","diskOfferingId":"30ac6ef3-1a32-4f0d-806c-180f7740ea0f","name":"h","_":"1362754386929","ctxAccountId":"2","ctxStartEventId":"33","zoneId":"371976d5-d065-4eb6-81d3-a229b7f90ce7"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 7614406590488, completeMsid: null, lastUpdated: null, lastPolled: null, created: null} 2013-03-09 01:50:07,520 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.101.254.233 -- GET command=createVolume&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&name=h&zoneId=371976d5-d065-4eb6-81d3-a229b7f90ce7&diskOfferingId=30ac6ef3-1a32-4f0d-806c-180f7740ea0f&_=1362754386929 2013-03-09 01:50:07,523 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-14:job-27) Executing org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-27 2013-03-09 01:50:07,546 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-2:null) Async job-26 completed 2013-03-09 01:50:07,562 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-14:job-27) Complete async job-27, jobStatus: 1, resultCode: 0, result: org.apache.cloudstack.api.response.VolumeResponse@5d9835b5 2013-03-09 01:50:07,567 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.101.254.233 -- GET command=queryAsyncJobResult&jobId=91e2f11a-bb8a-4e52-b1f4-502d137afcd0&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754387005 2013-03-09 01:50:07,573 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-14:job-27) Done executing org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-27 2013-03-09 01:50:07,624 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2013-03-09 01:50:07,723 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy 2013-03-09 01:50:08,061 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 1 routers to update status. 2013-03-09 01:50:08,063 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. 2013-03-09 01:50:08,107 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 1 routers to update status. 2013-03-09 01:50:08,109 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status. 2013-03-09 01:50:09,469 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) Ping from 3 2013-03-09 01:50:09,520 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 4 2013-03-09 01:50:09,818 INFO [agent.manager.AgentMonitor] (Thread-6:null) Found the following agents behind on ping: [1] 2013-03-09 01:50:09,820 DEBUG [cloud.host.Status] (Thread-6:null) Ping timeout for host 1, do invstigation 2013-03-09 01:50:09,824 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) Investigating why host 1 has disconnected with event PingTimeout 2013-03-09 01:50:09,824 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) checking if agent (1) is alive 2013-03-09 01:50:09,830 DEBUG [agent.transport.Request] (AgentTaskPool-10:null) Seq 1-602734731: Sending { Cmd , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 100011, [{"CheckHealthCommand":{"wait":50}}] } 2013-03-09 01:50:09,833 DEBUG [agent.transport.Request] (AgentManager-Handler-10:null) Seq 1-602734731: Processing: { Ans: , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 10, [{"CheckHealthAnswer":{"result":true,"details":"resource is alive","wait":0}}] } 2013-03-09 01:50:09,834 DEBUG [agent.transport.Request] (AgentTaskPool-10:null) Seq 1-602734731: Received: { Ans: , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 10, { CheckHealthAnswer } } 2013-03-09 01:50:09,834 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) Details from executing class com.cloud.agent.api.CheckHealthCommand: resource is alive 2013-03-09 01:50:09,834 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) agent (1) responded to checkHeathCommand, reporting that agent is Up 2013-03-09 01:50:09,834 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) The state determined is Up 2013-03-09 01:50:09,834 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-10:null) Agent is determined to be up and running 2013-03-09 01:50:09,834 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) Transition:[Resource state = Enabled, Agent event = Ping, Host id = 1, name = Rack1Pod1Host18] 2013-03-09 01:50:09,844 DEBUG [cloud.host.Status] (AgentTaskPool-10:null) Agent status update: [id = 1; name = Rack1Pod1Host18; old status = Up; event = Ping; new status = Up; old update count = 86; new update count = 87] 2013-03-09 01:50:09,996 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:null) Ping from 1 2013-03-09 01:50:10,817 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.101.254.233 -- GET command=queryAsyncJobResult&jobId=52792ca4-996a-4c56-838e-6dc0859ead30&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754390318 2013-03-09 01:50:10,837 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-24:null) Async job-27 completed 2013-03-09 01:50:10,845 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.101.254.233 -- GET command=queryAsyncJobResult&jobId=52792ca4-996a-4c56-838e-6dc0859ead30&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754390318 2013-03-09 01:50:12,910 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===START=== 10.101.254.233 -- GET command=listVolumes&id=6e92129b-f486-4bba-8f30-0c463ec58a00&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754392416 2013-03-09 01:50:12,934 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.101.254.233 -- GET command=listVolumes&id=6e92129b-f486-4bba-8f30-0c463ec58a00&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754392416 2013-03-09 01:50:13,230 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.101.254.233 -- GET command=listTags&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&resourceId=6e92129b-f486-4bba-8f30-0c463ec58a00&resourceType=Volume&listAll=true&_=1362754392700 2013-03-09 01:50:13,244 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.101.254.233 -- GET command=listTags&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&resourceId=6e92129b-f486-4bba-8f30-0c463ec58a00&resourceType=Volume&listAll=true&_=1362754392700 2013-03-09 01:50:14,622 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===START=== 10.101.254.233 -- GET command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Running&_=1362754394002 2013-03-09 01:50:14,639 DEBUG [cloud.user.AccountManagerImpl] (catalina-exec-6:null) Access granted to Acct[2-admin] to Domain:1/ by DomainChecker 2013-03-09 01:50:14,694 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===END=== 10.101.254.233 -- GET command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Running&_=1362754394002 2013-03-09 01:50:14,913 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 10.101.254.233 -- GET command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Stopped&_=1362754394414 2013-03-09 01:50:14,930 DEBUG [cloud.user.AccountManagerImpl] (catalina-exec-8:null) Access granted to Acct[2-admin] to Domain:1/ by DomainChecker 2013-03-09 01:50:14,940 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 10.101.254.233 -- GET command=listVirtualMachines&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&zoneid=371976d5-d065-4eb6-81d3-a229b7f90ce7&domainid=3654c6de-87fa-11e2-ae52-06ecde000018&account=admin&state=Stopped&_=1362754394414 2013-03-09 01:50:17,504 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===START=== 10.101.254.233 -- GET command=attachVolume&id=6e92129b-f486-4bba-8f30-0c463ec58a00&virtualMachineId=e51366fa-5423-4132-82f5-31c4230ddaae&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754396885 2013-03-09 01:50:17,546 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-4:null) submit async job-28, details: AsyncJobVO {id:28, userId: 2, accountId: 2, sessionKey: null, instanceType: null, instanceId: 12, cmd: org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, cmdOriginator: null, cmdInfo: {"response":"json","id":"6e92129b-f486-4bba-8f30-0c463ec58a00","sessionkey":"iBYcRekcomjfH6jh3i1k2Xi7vwo\u003d","ctxUserId":"2","virtualMachineId":"e51366fa-5423-4132-82f5-31c4230ddaae","_":"1362754396885","ctxAccountId":"2","ctxStartEventId":"34"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 7614406590488, completeMsid: null, lastUpdated: null, lastPolled: null, created: null} 2013-03-09 01:50:17,550 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===END=== 10.101.254.233 -- GET command=attachVolume&id=6e92129b-f486-4bba-8f30-0c463ec58a00&virtualMachineId=e51366fa-5423-4132-82f5-31c4230ddaae&response=json&sessionkey=iBYcRekcomjfH6jh3i1k2Xi7vwo%3D&_=1362754396885 2013-03-09 01:50:17,552 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-15:job-28) Executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-28 2013-03-09 01:50:17,613 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-15:job-28) Checking pool: 201 for volume allocation [Vol[12|vm=null|DATADISK]], maxSize : 0, totalAllocatedSize : 0, askingSize : 5368709120, allocated disable threshold: 0.85 2013-03-09 01:50:17,614 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-15:job-28) Insufficient un-allocated capacity on: 201 for volume allocation: [Vol[12|vm=null|DATADISK]] since its allocated percentage: Infinity has crossed the allocated pool.storage.allocated.capacity.disablethreshold: 0.85, skipping this pool 2013-03-09 01:50:17,627 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-15:job-28) Checking pool: 202 for volume allocation [Vol[12|vm=null|DATADISK]], maxSize : 3518437261312, totalAllocatedSize : 0, askingSize : 5368709120, allocated disable threshold: 0.85 2013-03-09 01:50:17,633 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-15:job-28) Trying to create org.apache.cloudstack.storage.volume.VolumeObject@1fa57753 on org.apache.cloudstack.storage.datastore.DefaultPrimaryDataStore@283cfa60 2013-03-09 01:50:17,667 DEBUG [agent.transport.Request] (Job-Executor-15:job-28) Seq 1-602734732: Sending { Cmd , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 100111, [{"storage.CreateCommand":{"volId":12,"pool":{"id":202,"uuid":"244b1b07-11cf-3fa2-9ff2-e1a54f183594","host":"10.147.28.8","path":"/vol/dgVol/z","port":2049,"type":"NetworkFilesystem"},"diskCharacteristics":{"size":5368709120,"tags":[],"type":"DATADISK","name":"h","useLocalStorage":false,"recreatable":false,"diskOfferingId":3,"volumeId":12},"wait":0}}] } 2013-03-09 01:50:17,747 DEBUG [agent.transport.Request] (AgentManager-Handler-12:null) Seq 1-602734732: Processing: { Ans: , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 110, [{"storage.CreateAnswer":{"volume":{"id":12,"name":"/vol/dgVol/z","mountPoint":"731be6dd-272e-41b8-a2c7-6d4a0695f14b","path":"731be6dd-272e-41b8-a2c7-6d4a0695f14b","size":5368709120,"type":"DATADISK","storagePoolType":"NetworkFilesystem","storagePoolUuid":"244b1b07-11cf-3fa2-9ff2-e1a54f183594","deviceId":0},"requestTemplateReload":false,"result":true,"wait":0}}] } 2013-03-09 01:50:17,747 DEBUG [agent.transport.Request] (Job-Executor-15:job-28) Seq 1-602734732: Received: { Ans: , MgmtId: 7614406590488, via: 1, Ver: v1, Flags: 110, { CreateAnswer } } 2013-03-09 01:50:17,750 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-12:null) Seq 1-602734732: No more commands found 2013-03-09 01:50:17,777 ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-15:job-28) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd java.lang.NullPointerException at com.cloud.storage.VolumeManagerImpl.needMoveVolume(VolumeManagerImpl.java:1444) at com.cloud.storage.VolumeManagerImpl.attachVolumeToVM(VolumeManagerImpl.java:1692) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.event.ActionEventInterceptor.AroundAnyMethod(ActionEventInterceptor.java:53) at sun.reflect.GeneratedMethodAccessor203.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202) at $Proxy290.attachVolumeToVM(Unknown Source) at org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd.execute(AttachVolumeCmd.java:122) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163) at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2013-03-09 01:50:17,781 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-15:job-28) Complete async job-28, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: null -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira