[ 
https://issues.apache.org/jira/browse/CLOUDSTACK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861929#comment-13861929
 ] 

Sangeetha Hariharan commented on CLOUDSTACK-5736:
-------------------------------------------------

This error seems to happen whenever the job gets cancelled after ~ 1 hour:

Job gets cancelled:
2014-01-02 19:44:28,341 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(AsyncJobMgr-Heartbeat-1:ctx-1bf72fa3) Complete async job-214, jobStatus: 
FAIode: 0, result: Job is cancelled as it has been blocking others for too long

But we see that even after this , the job was around for longer and then 
eventually failed:

2014-01-02 19:34:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-96157a41) Task (job-214) has been pending for 3038 seconds
2014-01-02 19:35:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-9b8ee135) Task (job-214) has been pending for 3098 seconds
2014-01-02 19:36:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-13c0ebc2) Task (job-214) has been pending for 3158 seconds
2014-01-02 19:37:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-6fddcaff) Task (job-214) has been pending for 3218 seconds
2014-01-02 19:38:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-1fadb4cc) Task (job-214) has been pending for 3278 seconds
2014-01-02 19:39:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-2cac840f) Task (job-214) has been pending for 3338 seconds
2014-01-02 19:40:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-73eaa06e) Task (job-214) has been pending for 3398 seconds
2014-01-02 19:41:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-4187e672) Task (job-214) has been pending for 3458 seconds
2014-01-02 19:42:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-974f5d21) Task (job-214) has been pending for 3518 seconds
2014-01-02 19:43:58,522 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-aedd3ca9) Task (job-214) has been pending for 3578 seconds
2014-01-02 19:44:28,341 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(AsyncJobMgr-Heartbeat-1:ctx-1bf72fa3) Complete async job-214, jobStatus: 
FAILED, resultCode: 0, result: Job is cancelled as it has been blocking others 
for too long
2014-01-02 19:44:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-92a3b10f) Task (job-214) has been pending for 3638 seconds
2014-01-02 19:45:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-3e23de06) Task (job-214) has been pending for 3698 seconds
2014-01-02 19:46:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-5d664797) Task (job-214) has been pending for 3758 seconds
2014-01-02 19:47:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-54e1140b) Task (job-214) has been pending for 3818 seconds
2014-01-02 19:48:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-cd636682) Task (job-214) has been pending for 3878 seconds
2014-01-02 19:49:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-dbc197f9) Task (job-214) has been pending for 3938 seconds
2014-01-02 19:50:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-ec666eab) Task (job-214) has been pending for 3998 seconds
2014-01-02 19:51:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-5f0894c9) Task (job-214) has been pending for 4058 seconds
2014-01-02 19:52:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-a9f98971) Task (job-214) has been pending for 4118 seconds
2014-01-02 19:53:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-c7099ffd) Task (job-214) has been pending for 4178 seconds
2014-01-02 19:54:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-cd0c3048) Task (job-214) has been pending for 4238 seconds
2014-01-02 19:55:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-155097fb) Task (job-214) has been pending for 4298 seconds
2014-01-02 19:56:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-077ff3f0) Task (job-214) has been pending for 4358 seconds
2014-01-02 19:57:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-ae41f0ce) Task (job-214) has been pending for 4418 seconds
2014-01-02 19:58:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-0b663a78) Task (job-214) has been pending for 4478 seconds
2014-01-02 19:59:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-1721dd2a) Task (job-214) has been pending for 4538 seconds
2014-01-02 20:00:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-92c506df) Task (job-214) has been pending for 4598 seconds
2014-01-02 20:01:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-46a5f566) Task (job-214) has been pending for 4658 seconds
2014-01-02 20:02:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-8871658a) Task (job-214) has been pending for 4718 seconds
2014-01-02 20:03:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-86364cc4) Task (job-214) has been pending for 4778 seconds
2014-01-02 20:04:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-b5d83c3c) Task (job-214) has been pending for 4838 seconds
2014-01-02 20:05:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-0a269c74) Task (job-214) has been pending for 4898 seconds
2014-01-02 20:06:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-27028d5d) Task (job-214) has been pending for 4958 seconds
2014-01-02 20:07:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-ad2f8d59) Task (job-214) has been pending for 5018 seconds
2014-01-02 20:08:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-742160e7) Task (job-214) has been pending for 5078 seconds
2014-01-02 20:09:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-917457f2) Task (job-214) has been pending for 5138 seconds
2014-01-02 20:10:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-370ca3df) Task (job-214) has been pending for 5198 seconds
2014-01-02 20:11:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-35e6cac6) Task (job-214) has been pending for 5258 seconds
2014-01-02 20:12:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-a7842f26) Task (job-214) has been pending for 5318 seconds
2014-01-02 20:13:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-3c6a3e3f) Task (job-214) has been pending for 5378 seconds
2014-01-02 20:14:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-ba81967d) Task (job-214) has been pending for 5438 seconds
2014-01-02 20:15:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-7c5a73eb) Task (job-214) has been pending for 5498 seconds
2014-01-02 20:16:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-e4671a93) Task (job-214) has been pending for 5558 seconds
2014-01-02 20:17:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-170f650b) Task (job-214) has been pending for 5618 seconds
2014-01-02 20:18:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-b7ac41fc) Task (job-214) has been pending for 5678 seconds
2014-01-02 20:19:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-c7cb9fc7) Task (job-214) has been pending for 5738 seconds
2014-01-02 20:20:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-68c89741) Task (job-214) has been pending for 5798 seconds
2014-01-02 20:21:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-9d4c2055) Task (job-214) has been pending for 5858 seconds
2014-01-02 20:22:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-3c816dd0) Task (job-214) has been pending for 5918 seconds
2014-01-02 20:23:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-213f71b1) Task (job-214) has been pending for 5978 seconds
2014-01-02 20:24:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-63b5faa7) Task (job-214) has been pending for 6038 seconds
2014-01-02 20:25:58,521 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-2f000139) Task (job-214) has been pending for 6098 seconds
2014-01-02 20:26:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-36e3130d) Task (job-214) has been pending for 6158 seconds
2014-01-02 20:27:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-0e07eead) Task (job-214) has been pending for 6218 seconds
2014-01-02 20:28:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-63fe68f9) Task (job-214) has been pending for 6278 seconds
2014-01-02 20:29:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-fa7362dd) Task (job-214) has been pending for 6338 seconds
2014-01-02 20:30:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-65ca988f) Task (job-214) has been pending for 6398 seconds
2014-01-02 20:31:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-f0965207) Task (job-214) has been pending for 6458 seconds
2014-01-02 20:32:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-22345e0a) Task (job-214) has been pending for 6518 seconds
2014-01-02 20:33:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-4833e8e1) Task (job-214) has been pending for 6578 seconds
2014-01-02 20:34:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-f4379489) Task (job-214) has been pending for 6638 seconds
2014-01-02 20:35:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-01978ad7) Task (job-214) has been pending for 6698 seconds
2014-01-02 20:36:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-9763b6bf) Task (job-214) has been pending for 6758 seconds
2014-01-02 20:37:58,520 WARN  [o.a.c.f.j.i.AsyncJobMonitor] 
(Timer-1:ctx-36a55a30) Task (job-214) has been pending for 6818 seconds
2014-01-02 20:38:17,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Complete async job-214, jobStatus: 
SUCCEEDED, resultCode: 0, result: 
rO0ABXNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAABA
2014-01-02 20:38:17,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) job-214 is already completed.
2014-01-02 20:38:17,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-153:ctx-5e9be70b) Done executing 
com.cloud.storage.VmWorkTakeVolumeSnapshot for job-214
2014-01-02 20:38:17,251 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(Job-Executor-153:ctx-5e9be70b) Remove job-214 from job monitoring


It failed with following exception:
2014-01-02 20:38:17,209 DEBUG [c.c.a.t.Request] (Job-Executor-153:ctx-5e9be70b 
ctx-69dc7de8) Seq 2-1651712315: Received:  { Ans: , MgmtId: 82324189320212, 
via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2014-01-02 20:38:17,243 DEBUG [c.c.s.s.SnapshotManagerImpl] 
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) post process snapshot failed
java.lang.NullPointerException
        at 
com.cloud.storage.snapshot.SnapshotManagerImpl.postCreateSnapshot(SnapshotManagerImpl.java:374)
        at 
com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:954)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy160.takeSnapshot(Unknown Source)
        at 
org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1371)
        at 
com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1723)
        at 
com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2478)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy195.handleVmWorkJob(Unknown Source)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
2014-01-02 20:38:17,243 DEBUG [c.c.s.VolumeApiServiceImpl] 
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Done executing 
Take-Volume-Snapshot within VM work job context. vmId: 22, volId: 22, policyId: 
1, quiesceVm: false
2014-01-02 20:38:17,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Complete async job-214, jobStatus: 
SUCCEEDED, resultCode: 0, result: 
rO0ABXNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAABA



> KVM - Recurring Snapshots - Snapshots reported as being in "BackedUp" state 
> even though a Nullpointer exception is seen during post processing of  
> snapshot.
> ------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-5736
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5736
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the 
> default.) 
>          Components: Management Server
>    Affects Versions: 4.3.0
>         Environment: Build from 4.3
>            Reporter: Sangeetha Hariharan
>            Assignee: edison su
>            Priority: Critical
>             Fix For: 4.3.0
>
>         Attachments: kvm.rar
>
>
> Set up:
> Advanced zone set up with 2 KVM (rhel 63) hosts.
> Steps to reproduce the problem:
> Deploy about 17 Vms in both hosts.
> Start "Hourly" snapshot for all the ROOT volumes of these Vms.
> Snapshots were reported as being in "BackedUp" state even though Nullpointer 
> exception is seen during post processing of  snapshot.
> Following exception seen in management server logs:
> 014-01-02 19:57:53,560 DEBUG [c.c.s.s.SnapshotManagerImpl] 
> (Job-Executor-166:ctx-c0f157b4 ctx-2654c4f7) post process snapshot failed
> java.lang.NullPointerException
>         at 
> com.cloud.storage.snapshot.SnapshotManagerImpl.postCreateSnapshot(SnapshotManagerImpl.java:374)
>         at 
> com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:954)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at 
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>         at 
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>         at 
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>         at $Proxy160.takeSnapshot(Unknown Source)
>         at 
> org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1371)
>         at 
> com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1723)
>         at 
> com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2478)
>         at sun.reflect.GeneratedMethodAccessor524.invoke(Unknown Source)
>         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at 
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>         at 
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>         at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>         at 
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>         at $Proxy195.handleVmWorkJob(Unknown Source)
>         at 
> com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
>         at 
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
>         at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>         at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>         at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>         at 
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>         at 
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>         at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:722)
> mysql> select id,volume_id,name,status from snapshots where status="BackedUp";
> +----+-----------+-------------------------------------------------+----------+
> | id | volume_id | name                                            | status   
> |
> +----+-----------+-------------------------------------------------+----------+
> |  4 |        22 | TestVM-tiny-host-0ps-0-6_ROOT-22_20140102234418 | BackedUp 
> |
> |  5 |        21 | TestVM-tiny-host-0ps-0-5_ROOT-21_20140102234418 | BackedUp 
> |
> |  6 |        20 | TestVM-tiny-host-0ps-0-4_ROOT-20_20140102234418 | BackedUp 
> |
> |  7 |        19 | TestVM-tiny-host-0ps-0-3_ROOT-19_20140102234418 | BackedUp 
> |
> |  8 |        18 | TestVM-tiny-host-0ps-0-2_ROOT-18_20140102234418 | BackedUp 
> |
> |  9 |        17 | TestVM-tiny-host-0ps-0-1_ROOT-17_20140102234418 | BackedUp 
> |
> | 10 |        16 | TestVM-tiny-host-0ps-0-0_ROOT-16_20140102234419 | BackedUp 
> |
> | 11 |        14 | TestVM-1_ROOT-14_20140102234419                 | BackedUp 
> |
> | 12 |        31 | TestVM-tiny-host-1ps-0-5_ROOT-31_20140102234419 | BackedUp 
> |
> | 16 |        27 | TestVM-tiny-host-1ps-0-1_ROOT-27_20140102234419 | BackedUp 
> |
> | 17 |        26 | TestVM-tiny-host-1ps-0-0_ROOT-26_20140102234419 | BackedUp 
> |
> | 18 |        25 | TestVM-tiny-host-0ps-0-9_ROOT-25_20140102234419 | BackedUp 
> |
> | 19 |        24 | TestVM-tiny-host-0ps-0-8_ROOT-24_20140102234419 | BackedUp 
> |
> +----+-----------+-------------------------------------------------+----------+
> 14 rows in set (0.00 sec)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to