[
https://issues.apache.org/jira/browse/CLOUDSTACK-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861929#comment-13861929
]
Sangeetha Hariharan commented on CLOUDSTACK-5736:
-------------------------------------------------
This error seems to happen whenever the job gets cancelled after ~ 1 hour:
Job gets cancelled:
2014-01-02 19:44:28,341 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-1bf72fa3) Complete async job-214, jobStatus:
FAIode: 0, result: Job is cancelled as it has been blocking others for too long
But we see that even after this , the job was around for longer and then
eventually failed:
2014-01-02 19:34:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-96157a41) Task (job-214) has been pending for 3038 seconds
2014-01-02 19:35:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-9b8ee135) Task (job-214) has been pending for 3098 seconds
2014-01-02 19:36:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-13c0ebc2) Task (job-214) has been pending for 3158 seconds
2014-01-02 19:37:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-6fddcaff) Task (job-214) has been pending for 3218 seconds
2014-01-02 19:38:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-1fadb4cc) Task (job-214) has been pending for 3278 seconds
2014-01-02 19:39:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-2cac840f) Task (job-214) has been pending for 3338 seconds
2014-01-02 19:40:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-73eaa06e) Task (job-214) has been pending for 3398 seconds
2014-01-02 19:41:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-4187e672) Task (job-214) has been pending for 3458 seconds
2014-01-02 19:42:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-974f5d21) Task (job-214) has been pending for 3518 seconds
2014-01-02 19:43:58,522 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-aedd3ca9) Task (job-214) has been pending for 3578 seconds
2014-01-02 19:44:28,341 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-1bf72fa3) Complete async job-214, jobStatus:
FAILED, resultCode: 0, result: Job is cancelled as it has been blocking others
for too long
2014-01-02 19:44:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-92a3b10f) Task (job-214) has been pending for 3638 seconds
2014-01-02 19:45:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-3e23de06) Task (job-214) has been pending for 3698 seconds
2014-01-02 19:46:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-5d664797) Task (job-214) has been pending for 3758 seconds
2014-01-02 19:47:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-54e1140b) Task (job-214) has been pending for 3818 seconds
2014-01-02 19:48:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-cd636682) Task (job-214) has been pending for 3878 seconds
2014-01-02 19:49:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-dbc197f9) Task (job-214) has been pending for 3938 seconds
2014-01-02 19:50:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-ec666eab) Task (job-214) has been pending for 3998 seconds
2014-01-02 19:51:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-5f0894c9) Task (job-214) has been pending for 4058 seconds
2014-01-02 19:52:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-a9f98971) Task (job-214) has been pending for 4118 seconds
2014-01-02 19:53:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-c7099ffd) Task (job-214) has been pending for 4178 seconds
2014-01-02 19:54:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-cd0c3048) Task (job-214) has been pending for 4238 seconds
2014-01-02 19:55:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-155097fb) Task (job-214) has been pending for 4298 seconds
2014-01-02 19:56:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-077ff3f0) Task (job-214) has been pending for 4358 seconds
2014-01-02 19:57:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-ae41f0ce) Task (job-214) has been pending for 4418 seconds
2014-01-02 19:58:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-0b663a78) Task (job-214) has been pending for 4478 seconds
2014-01-02 19:59:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-1721dd2a) Task (job-214) has been pending for 4538 seconds
2014-01-02 20:00:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-92c506df) Task (job-214) has been pending for 4598 seconds
2014-01-02 20:01:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-46a5f566) Task (job-214) has been pending for 4658 seconds
2014-01-02 20:02:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-8871658a) Task (job-214) has been pending for 4718 seconds
2014-01-02 20:03:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-86364cc4) Task (job-214) has been pending for 4778 seconds
2014-01-02 20:04:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-b5d83c3c) Task (job-214) has been pending for 4838 seconds
2014-01-02 20:05:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-0a269c74) Task (job-214) has been pending for 4898 seconds
2014-01-02 20:06:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-27028d5d) Task (job-214) has been pending for 4958 seconds
2014-01-02 20:07:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-ad2f8d59) Task (job-214) has been pending for 5018 seconds
2014-01-02 20:08:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-742160e7) Task (job-214) has been pending for 5078 seconds
2014-01-02 20:09:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-917457f2) Task (job-214) has been pending for 5138 seconds
2014-01-02 20:10:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-370ca3df) Task (job-214) has been pending for 5198 seconds
2014-01-02 20:11:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-35e6cac6) Task (job-214) has been pending for 5258 seconds
2014-01-02 20:12:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-a7842f26) Task (job-214) has been pending for 5318 seconds
2014-01-02 20:13:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-3c6a3e3f) Task (job-214) has been pending for 5378 seconds
2014-01-02 20:14:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-ba81967d) Task (job-214) has been pending for 5438 seconds
2014-01-02 20:15:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-7c5a73eb) Task (job-214) has been pending for 5498 seconds
2014-01-02 20:16:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-e4671a93) Task (job-214) has been pending for 5558 seconds
2014-01-02 20:17:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-170f650b) Task (job-214) has been pending for 5618 seconds
2014-01-02 20:18:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-b7ac41fc) Task (job-214) has been pending for 5678 seconds
2014-01-02 20:19:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-c7cb9fc7) Task (job-214) has been pending for 5738 seconds
2014-01-02 20:20:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-68c89741) Task (job-214) has been pending for 5798 seconds
2014-01-02 20:21:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-9d4c2055) Task (job-214) has been pending for 5858 seconds
2014-01-02 20:22:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-3c816dd0) Task (job-214) has been pending for 5918 seconds
2014-01-02 20:23:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-213f71b1) Task (job-214) has been pending for 5978 seconds
2014-01-02 20:24:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-63b5faa7) Task (job-214) has been pending for 6038 seconds
2014-01-02 20:25:58,521 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-2f000139) Task (job-214) has been pending for 6098 seconds
2014-01-02 20:26:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-36e3130d) Task (job-214) has been pending for 6158 seconds
2014-01-02 20:27:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-0e07eead) Task (job-214) has been pending for 6218 seconds
2014-01-02 20:28:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-63fe68f9) Task (job-214) has been pending for 6278 seconds
2014-01-02 20:29:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-fa7362dd) Task (job-214) has been pending for 6338 seconds
2014-01-02 20:30:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-65ca988f) Task (job-214) has been pending for 6398 seconds
2014-01-02 20:31:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-f0965207) Task (job-214) has been pending for 6458 seconds
2014-01-02 20:32:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-22345e0a) Task (job-214) has been pending for 6518 seconds
2014-01-02 20:33:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-4833e8e1) Task (job-214) has been pending for 6578 seconds
2014-01-02 20:34:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-f4379489) Task (job-214) has been pending for 6638 seconds
2014-01-02 20:35:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-01978ad7) Task (job-214) has been pending for 6698 seconds
2014-01-02 20:36:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-9763b6bf) Task (job-214) has been pending for 6758 seconds
2014-01-02 20:37:58,520 WARN [o.a.c.f.j.i.AsyncJobMonitor]
(Timer-1:ctx-36a55a30) Task (job-214) has been pending for 6818 seconds
2014-01-02 20:38:17,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Complete async job-214, jobStatus:
SUCCEEDED, resultCode: 0, result:
rO0ABXNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAABA
2014-01-02 20:38:17,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) job-214 is already completed.
2014-01-02 20:38:17,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-153:ctx-5e9be70b) Done executing
com.cloud.storage.VmWorkTakeVolumeSnapshot for job-214
2014-01-02 20:38:17,251 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-153:ctx-5e9be70b) Remove job-214 from job monitoring
It failed with following exception:
2014-01-02 20:38:17,209 DEBUG [c.c.a.t.Request] (Job-Executor-153:ctx-5e9be70b
ctx-69dc7de8) Seq 2-1651712315: Received: { Ans: , MgmtId: 82324189320212,
via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2014-01-02 20:38:17,243 DEBUG [c.c.s.s.SnapshotManagerImpl]
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) post process snapshot failed
java.lang.NullPointerException
at
com.cloud.storage.snapshot.SnapshotManagerImpl.postCreateSnapshot(SnapshotManagerImpl.java:374)
at
com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:954)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy160.takeSnapshot(Unknown Source)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1371)
at
com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1723)
at
com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2478)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy195.handleVmWorkJob(Unknown Source)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2014-01-02 20:38:17,243 DEBUG [c.c.s.VolumeApiServiceImpl]
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Done executing
Take-Volume-Snapshot within VM work job context. vmId: 22, volId: 22, policyId:
1, quiesceVm: false
2014-01-02 20:38:17,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-153:ctx-5e9be70b ctx-69dc7de8) Complete async job-214, jobStatus:
SUCCEEDED, resultCode: 0, result:
rO0ABXNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAABA
> KVM - Recurring Snapshots - Snapshots reported as being in "BackedUp" state
> even though a Nullpointer exception is seen during post processing of
> snapshot.
> ------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-5736
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5736
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.3.0
> Environment: Build from 4.3
> Reporter: Sangeetha Hariharan
> Assignee: edison su
> Priority: Critical
> Fix For: 4.3.0
>
> Attachments: kvm.rar
>
>
> Set up:
> Advanced zone set up with 2 KVM (rhel 63) hosts.
> Steps to reproduce the problem:
> Deploy about 17 Vms in both hosts.
> Start "Hourly" snapshot for all the ROOT volumes of these Vms.
> Snapshots were reported as being in "BackedUp" state even though Nullpointer
> exception is seen during post processing of snapshot.
> Following exception seen in management server logs:
> 014-01-02 19:57:53,560 DEBUG [c.c.s.s.SnapshotManagerImpl]
> (Job-Executor-166:ctx-c0f157b4 ctx-2654c4f7) post process snapshot failed
> java.lang.NullPointerException
> at
> com.cloud.storage.snapshot.SnapshotManagerImpl.postCreateSnapshot(SnapshotManagerImpl.java:374)
> at
> com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:954)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at $Proxy160.takeSnapshot(Unknown Source)
> at
> org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1371)
> at
> com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1723)
> at
> com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2478)
> at sun.reflect.GeneratedMethodAccessor524.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at $Proxy195.handleVmWorkJob(Unknown Source)
> at
> com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
> at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:522)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> mysql> select id,volume_id,name,status from snapshots where status="BackedUp";
> +----+-----------+-------------------------------------------------+----------+
> | id | volume_id | name | status
> |
> +----+-----------+-------------------------------------------------+----------+
> | 4 | 22 | TestVM-tiny-host-0ps-0-6_ROOT-22_20140102234418 | BackedUp
> |
> | 5 | 21 | TestVM-tiny-host-0ps-0-5_ROOT-21_20140102234418 | BackedUp
> |
> | 6 | 20 | TestVM-tiny-host-0ps-0-4_ROOT-20_20140102234418 | BackedUp
> |
> | 7 | 19 | TestVM-tiny-host-0ps-0-3_ROOT-19_20140102234418 | BackedUp
> |
> | 8 | 18 | TestVM-tiny-host-0ps-0-2_ROOT-18_20140102234418 | BackedUp
> |
> | 9 | 17 | TestVM-tiny-host-0ps-0-1_ROOT-17_20140102234418 | BackedUp
> |
> | 10 | 16 | TestVM-tiny-host-0ps-0-0_ROOT-16_20140102234419 | BackedUp
> |
> | 11 | 14 | TestVM-1_ROOT-14_20140102234419 | BackedUp
> |
> | 12 | 31 | TestVM-tiny-host-1ps-0-5_ROOT-31_20140102234419 | BackedUp
> |
> | 16 | 27 | TestVM-tiny-host-1ps-0-1_ROOT-27_20140102234419 | BackedUp
> |
> | 17 | 26 | TestVM-tiny-host-1ps-0-0_ROOT-26_20140102234419 | BackedUp
> |
> | 18 | 25 | TestVM-tiny-host-0ps-0-9_ROOT-25_20140102234419 | BackedUp
> |
> | 19 | 24 | TestVM-tiny-host-0ps-0-8_ROOT-24_20140102234419 | BackedUp
> |
> +----+-----------+-------------------------------------------------+----------+
> 14 rows in set (0.00 sec)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)