Srikanteswararao Talluri created CLOUDSTACK-4041:
----------------------------------------------------
Summary: [ZWPSFailed to migrate a ROOT volume created on zone
wide primary storage
Key: CLOUDSTACK-4041
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4041
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Volumes
Affects Versions: 4.2.0
Environment: vmware
Reporter: Srikanteswararao Talluri
Priority: Critical
Fix For: 4.2.0
Steps to reproduce:
==============
1. migrate a root volume from one zone wide primary storage to another zone
wide primary storage on VMware deployment.
===START=== 10.101.255.7 -- GET
command=migrateVolume&livemigrate=true&storageid=2e7044d5-9b23-3db2-b3d6-124d7c7a3325&volumeid=c604dd82-d26a-4d9b-8474-dc08a582dc83&response=json&sessionkey=XHSduNJO%2FhezokzsdNB9FLhgBEc%3D&_=1375442573980
2013-08-02 22:17:26,546 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-1:null) submit async job-27 = [
05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ], details: AsyncJobVO {id:27, userId: 2,
accountId: 2, sessionKey: null, instanceType: None, instanceId: null, cmd:
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd, cmdOriginator:
null, cmdInfo:
{"response":"json","sessionkey":"XHSduNJO/hezokzsdNB9FLhgBEc\u003d","cmdEventType":"VOLUME.MIGRATE","ctxUserId":"2","storageid":"2e7044d5-9b23-3db2-b3d6-124d7c7a3325","livemigrate":"true","httpmethod":"GET","_":"1375442573980","volumeid":"c604dd82-d26a-4d9b-8474-dc08a582dc83","ctxAccountId":"2","ctxStartEventId":"87"},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 7363452993625,
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-08-02 22:17:26,550 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null)
===END=== 10.101.255.7 -- GET
command=migrateVolume&livemigrate=true&storageid=2e7044d5-9b23-3db2-b3d6-124d7c7a3325&volumeid=c604dd82-d26a-4d9b-8474-dc08a582dc83&response=json&sessionkey=XHSduNJO%2FhezokzsdNB9FLhgBEc%3D&_=1375442573980
2013-08-02 22:17:26,554 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-14:job-27 = [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) Executing
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd for job-27 = [
05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]
2013-08-02 22:17:26,626 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-14:job-27 = [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) copyAsync
inspecting src type VOLUME copyAsync inspecting dest type VOLUME
2013-08-02 22:17:26,650 DEBUG [agent.transport.Request] (Job-Executor-14:job-27
= [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) Seq 1-1566113890: Sending { Cmd ,
MgmtId: 7363452993625, via: 1, Ver: v1, Flags: 100111,
[{"com.cloud.agent.api.storage.MigrateVolumeCommand":{"volumeId":13,"volumePath":"ROOT-11-13","pool":{"id":1,"uuid":"2e7044d5-9b23-3db2-b3d6-124d7c7a3325","host":"10.147.28.7","path":"/export/home/talluri/vmware.campo/zwps","port":2049,"type":"NetworkFilesystem"},"wait":0}}]
}
2013-08-02 22:17:26,651 DEBUG [agent.transport.Request] (Job-Executor-14:job-27
= [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) Seq 1-1566113890: Executing: { Cmd
, MgmtId: 7363452993625, via: 1, Ver: v1, Flags: 100111,
[{"com.cloud.agent.api.storage.MigrateVolumeCommand":{"volumeId":13,"volumePath":"ROOT-11-13","pool":{"id":1,"uuid":"2e7044d5-9b23-3db2-b3d6-124d7c7a3325","host":"10.147.28.7","path":"/export/home/talluri/vmware.campo/zwps","port":2049,"type":"NetworkFilesystem"},"wait":0}}]
}
2013-08-02 22:17:26,651 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-6:null) Seq 1-1566113890: Executing request
2013-08-02 22:17:26,652 INFO [vmware.resource.VmwareResource]
(DirectAgent-6:10.147.40.30) Executing resource MigrateVolumeCommand:
{"volumeId":13,"volumePath":"ROOT-11-13","pool":{"id":1,"uuid":"2e7044d5-9b23-3db2-b3d6-124d7c7a3325","host":"10.147.28.7","path":"/export/home/talluri/vmware.campo/zwps","port":2049,"type":"NetworkFilesystem"},"wait":0}
2013-08-02 22:17:26,745 ERROR [vmware.resource.VmwareResource]
(DirectAgent-6:10.147.40.30) VM i-2-11-VM does not exist in VMware datacenter
datacenter-3268
2013-08-02 22:17:26,750 ERROR [vmware.resource.VmwareResource]
(DirectAgent-6:10.147.40.30) Catch Exception java.lang.Exception due to
java.lang.Exception: VM i-2-11-VM does not exist in VMware datacenter
datacenter-3268
java.lang.Exception: VM i-2-11-VM does not exist in VMware datacenter
datacenter-3268
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4024)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:466)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-02 22:17:26,753 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-6:null) Seq 1-1566113890: Response Received:
2013-08-02 22:17:26,753 DEBUG [agent.transport.Request] (DirectAgent-6:null)
Seq 1-1566113890: Processing: { Ans: , MgmtId: 7363452993625, via: 1, Ver: v1,
Flags: 110,
[{"com.cloud.agent.api.storage.MigrateVolumeAnswer":{"result":false,"details":"Catch
Exception java.lang.Exception due to java.lang.Exception: VM i-2-11-VM does
not exist in VMware datacenter datacenter-3268","wait":0}}] }
2013-08-02 22:17:26,757 DEBUG [agent.transport.Request] (Job-Executor-14:job-27
= [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) Seq 1-1566113890: Received: { Ans:
, MgmtId: 7363452993625, via: 1, Ver: v1, Flags: 110, { MigrateVolumeAnswer } }
2013-08-02 22:17:26,758 DEBUG [storage.motion.AncientDataMotionStrategy]
(Job-Executor-14:job-27 = [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) copy failed
com.cloud.utils.exception.CloudRuntimeException: Failed to migrate volume
org.apache.cloudstack.storage.volume.VolumeObject@769cfc66 to storage pool
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@3c7ec960
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.migrateVolumeToPool(AncientDataMotionStrategy.java:344)
at
org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrategy.java:379)
at
org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:55)
at
org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVolume(VolumeServiceImpl.java:866)
at
com.cloud.storage.VolumeManagerImpl.liveMigrateVolume(VolumeManagerImpl.java:2212)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.storage.VolumeManagerImpl.migrateVolume(VolumeManagerImpl.java:2182)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.volume.MigrateVolumeCmd.execute(MigrateVolumeCmd.java:102)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-02 22:17:26,763 DEBUG [agent.manager.AgentAttache] (DirectAgent-6:null)
Seq 1-1566113890: No more commands found
2013-08-02 22:17:26,774 WARN [storage.datastore.ObjectInDataStoreManagerImpl]
(Job-Executor-14:job-27 = [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) Unsupported
data object (VOLUME,
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@3737740c)
2013-08-02 22:17:26,779 DEBUG [cloud.storage.VolumeManagerImpl]
(Job-Executor-14:job-27 = [ 05c5e4f0-ce50-427c-9547-ad1fa3a14ec9 ]) migrate
volume failed:com.cloud.utils.exception.CloudRuntimeException: Failed to
migrate volume org.apache.cloudstack.storage.volume.VolumeObject@769cfc66 to
storage pool
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@3c7ec960
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira