[
https://issues.apache.org/jira/browse/CLOUDSTACK-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860097#comment-13860097
]
Sateesh Chodapuneedi commented on CLOUDSTACK-5447:
--------------------------------------------------
Issue reported in this defect is fixed. From the logs it is evident that
MigrateVolumeCommand execution was successful. That means volume was
successfully migrated. Without fix for the below issue, MigrateVolumeCommand
would fail with NullPointerException.
Issue is NullPointerException encounter when vmware resource is trying to
execute MigrateVolumeCommand send by agent manager. Injection of
VolumeOrchestrationService is failing yielding _volMgr as NULL. Due to this,
the following snippet is failing with NullPointerException.
final String vmName = volMgr.getVmNameFromVolumeId(cmd.getVolumeId());
Latest logs are indicating 2 issues,
1. 2014-01-01 21:39:22,502 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-93:ctx-b606242c) Done executing
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-4761
2014-01-01 21:39:22,505 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-56:ctx-bb7ebc62) Complete async job-4761, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed
to migrate volume"}
This bug is already reported - CLOUDSTACK-5660
2. 2014-01-01 21:39:22,468 INFO [c.c.h.v.r.VmwareResource]
(DirectAgent-56:ctx-dff965fd 10.223.250.130) Executing resource DestroyCommand
to evict template from storage pool:
{"volume":{"id":9,"mountPoint":"/export/home/automation/SC-CLOUD-QA03/primary2","path":"26af4375b1d13ff69a51cbbac2347bb8","size":0,"storagePoolType":"NetworkFilesystem","storagePoolUuid":"16c8ee2e-3f26-3062-8878-b7d6c53c5797","deviceId":0},"wait":0}
2014-01-01 21:39:23,036 ERROR [c.c.h.v.r.VmwareResource]
(DirectAgent-56:ctx-dff965fd 10.223.250.130) DestroyCommand failed due to
Exception: java.lang.RuntimeException
Message: Invalid configuration for device '0'.
DestroyCommand executed by StorageManager-Scavenger thread failed due to some
issue. This has to be reported as a separate bug. This is a different thread
and is not relevant to volume migration job.
> [Automation] Volume migration failing with NullPointerException in vmware and
> KVM
> ---------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-5447
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5447
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: KVM, VMware, Volumes
> Affects Versions: 4.3.0
> Environment: vmware 5.0
> branch 4.3
> Reporter: Rayees Namathponnan
> Assignee: Sateesh Chodapuneedi
> Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: management-server.rar, management-server.rar
>
>
> Steps to reproduce
> Step 1 : Deploy advanced zone in vm ware with two primary storage in a cluster
> Step 2 : Deploy VM vm1
> Step 3 : migrate volume of vm to second primary storage
> Actual result
> Migration failed with below error
> 2013-12-10 11:39:20,642 DEBUG [c.c.a.t.Request]
> (DirectAgent-320:ctx-47dcbdc1) Seq 2-34478645: Executing: { Cmd , MgmtId:
> 90928106758026, via: 2(10.223.250.130), Ver: v1, Flags: 100111,
> [{"com.cloud.agent.api.storage.MigrateVolumeCommand":{"volumeId":374,"volumePath":"ROOT-324","pool":{"id":1,"uuid":"6cfb1cb3-1909-3295-a4d3-8920e5cf0b00","host":"10.223.240.164","path":"/home/common/automation/SC-CLOUD-QA03/primary1","port":2049,"type":"NetworkFilesystem"},"wait":0}}]
> }
> 2013-12-10 11:39:20,643 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-75:ctx-5c8b7163) Seq 2-34478645: Executing request
> 2013-12-10 11:39:20,643 INFO [c.c.h.v.r.VmwareResource]
> (DirectAgent-75:ctx-5c8b7163 10.223.250.130) Executing resource
> MigrateVolumeCommand:
> {"volumeId":374,"volumePath":"ROOT-324","pool":{"id":1,"uuid":"6cfb1cb3-1909-3295-a4d3-8920e5cf0b00","host":"10.223.240.164","path":"/home/common/automation/SC-CLOUD-QA03/primary1","port":2049,"type":"NetworkFilesystem"},"wait":0}
> 2013-12-10 11:39:20,643 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgent-75:ctx-5c8b7163) Seq 2-34478645: Exception Caught while
> executing command
> java.lang.NullPointerException
> at
> com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4347)
> at
> com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:457)
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> 2013-12-10 11:39:20,643 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-75:ctx-5c8b7163) Seq 2-34478645: Response Received:
> 2013-12-10 11:39:20,643 DEBUG [c.c.a.t.Request] (DirectAgent-75:ctx-5c8b7163)
> Seq 2-34478645: Processing: { Ans: , MgmtId: 90928106758026, via: 2, Ver:
> v1, Flags: 110,
> [{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.NullPointerException","wait":0}}]
> }
> 2013-12-10 11:39:20,643 DEBUG [c.c.a.t.Request]
> (Job-Executor-142:ctx-1d4fa953 ctx-f2be2981) Seq 2-34478645: Received: {
> Ans: , MgmtId: 90928106758026, via: 2, Ver: v1, Flags: 110, { Answer } }
> 2013-12-10 11:39:20,644 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> (Job-Executor-142:ctx-1d4fa953 ctx-f2be2981) copy failed
> com.cloud.utils.exception.CloudRuntimeException: Failed to migrate volume
> org.apache.cloudstack.storage.volume.VolumeObject@16ed3557 to storage pool
> org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@2f48ee83
> at
> org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.migrateVolumeToPool(AncientDataMotionStrategy.java:381)
> at
> org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:416)
> at
> org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:70)
> at
> org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVolume(VolumeServiceImpl.java:910)
> at
> com.cloud.storage.VolumeApiServiceImpl.liveMigrateVolume(VolumeApiServiceImpl.java:1452)
> at
> com.cloud.storage.VolumeApiServiceImpl.migrateVolume(VolumeApiServiceImpl.java:1438)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy233.migrateVolume(Unknown Source)
> at
> org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd.execute(MigrateVolumeCmd.java:103)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
> at
> com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
