Hello,
We have two clusters, the environment is as follows:
? CS Mgmt server 4.3 on CentOS 6.5
? Hypervisors Xen Server 6.2 SP1.
? One Zone, Two clusters with different two primary storage servers.
? Primary & Secondary storage are NFS based.
When attempting to move a VM from one cluster to another, we succeed only the
first time, the VM and its files are moved to a new hypervisor and new storage
server in the new cluster, however when attempting to migrate the VM to the
original cluster, host, and original storage, the migration fails, so it is
only one time migration.
The logs are as follows, we would appreciate if someone has faced this issue
before, it is very helpful feature in cloud stack to migrate across clusters
and storage servers, but it seems it is not working, cause we simulated the
environment on CS 4.3 from scratch installation and the behaviour is the same.
/mnt/DATA/VM-SEC-01/volumes/2/1071 is not being created.
2014-08-21 11:37:40,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(catalina-exec-21:ctx-da934e40 ctx-fb603895) submit async job-10947, details:
AsyncJobVO {id:10947, userId: 2, accountId:
2, instanceType: None, instanceId: null, cmd:
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd, cmdInfo:
{"response":"json","sessionkey":"w6C9EF9N9Xi0AhEXZ3Cdc9nQNkI\u003d","virtu
almachineid":"ae028abb-4181-49fb-913f-bda34f77d792","cmdEventType":"VM.MIGRATE","ctxUserId":"2","storageid":"098d4f7a-a040-3462-add1-d618d6ec53c1","httpmethod":"GET","_":"1408592259844",
"ctxAccountId":"2","ctxStartEventId":"1088984"}, cmdVersion: 0, status:
IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid:
53350633438879, completeMsid: null, lastUpda
ted: null, lastPolled: null, created: null}
2014-08-21 11:37:40,671 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-14:ctx-57b36727) Add job-10947 into job monitoring
2014-08-21 11:37:40,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-14:ctx-57b36727) Executing AsyncJobVO {id:10947, userId: 2,
accountId: 2, instanceType: None, instanceId: nu
ll, cmd: org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd, cmdInfo:
{"response":"json","sessionkey":"w6C9EF9N9Xi0AhEXZ3Cdc9nQNkI\u003d","virtualmachineid":"ae028abb-4181-49fb-913f
-bda34f77d792","cmdEventType":"VM.MIGRATE","ctxUserId":"2","storageid":"098d4f7a-a040-3462-add1-d618d6ec53c1","httpmethod":"GET","_":"1408592259844","ctxAccountId":"2","ctxStartEventId":
"1088984"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
0, result: null, initMsid: 53350633438879, completeMsid: null, lastUpdated:
null, lastPolled: null, created:
null}
2014-08-21 11:37:40,672 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-da934e40
ctx-fb603895) ===END=== 103.4.132.4 -- GET
command=migrateVirtualMachine&storageid=098d4f7a-a040-3462-ad
d1-d618d6ec53c1&virtualmachineid=ae028abb-4181-49fb-913f-bda34f77d792&response=json&sessionkey=w6C9EF9N9Xi0AhEXZ3Cdc9nQNkI%3D&_=1408592259844
2014-08-21 11:37:40,738 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-14:ctx-57b36727 ctx-fb603895) VM state transitted from :Stopped
to Migrating with event: StorageMigrationRequested
vm's original host id: 73 new host id: null host id before state transition:
null
2014-08-21 11:37:40,943 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
(Job-Executor-14:ctx-57b36727 ctx-fb603895) copyAsync inspecting src type
VOLUME copyAsync inspecting dest type VOLUME
2014-08-21 11:37:40,946 DEBUG [o.a.c.s.c.a.StorageCacheRandomAllocator]
(Job-Executor-14:ctx-57b36727 ctx-fb603895) Can't find staging storage in zone:
1
2014-08-21 11:37:41,092 DEBUG [c.c.a.t.Request] (Job-Executor-14:ctx-57b36727
ctx-fb603895) Seq 73-1469252089: Sending { Cmd , MgmtId: 53350633438879, via:
73(XEN-08), Ver: v1, Flags: 1
00011,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"86417b6e-3fda-476e-b4d1-3bc77a67be89","volumeType":"ROOT
","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"1a07254a-c9d4-3ae0-8090-461e6597d818","id":221,"poolType":"NetworkFilesystem","host":"10.8.1.40","path":"/mn
t/DRIVE/DATA","port":2049,"url":"NetworkFilesystem://10.8.1.40//mnt/DRIVE/DATA/?ROLE=Primary&STOREUUID=1a07254a-c9d4-3ae0-8090-461e6597d818"}},"name":"ROOT-710","size":42949672960,"path"
:"c0669da9-1f91-4bdf-85aa-1d90bd9dc966","volumeId":1071,"vmName":"i-2-710-VM","accountId":2,"format":"VHD","id":1071,"deviceId":0,"hypervisorType":"XenServer"}},"destTO":{"org.apache.clo
udstack.storage.to.VolumeObjectTO":{"uuid":"86417b6e-3fda-476e-b4d1-3bc77a67be89","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.8.1.30/mnt/DATA/VM-SEC
-01","_role":"Image"}},"name":"ROOT-710","size":42949672960,"path":"volumes/2/1071","volumeId":1071,"vmName":"i-2-710-VM","accountId":2,"format":"VHD","id":1071,"deviceId":0,"hypervisorT
ype":"XenServer"}},"executeInSequence":false,"options":{},"wait":21600}}] }
2014-08-21 11:37:41,092 DEBUG [c.c.a.t.Request] (Job-Executor-14:ctx-57b36727
ctx-fb603895) Seq 73-1469252089: Executing: { Cmd , MgmtId: 53350633438879,
via: 73(XEN-08), Ver: v1, Flags
: 100011,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"86417b6e-3fda-476e-b4d1-3bc77a67be89","volumeType":"R
OOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"1a07254a-c9d4-3ae0-8090-461e6597d818","id":221,"poolType":"NetworkFilesystem","host":"10.8.1.40","path":"/mnt/DRIVE/DATA","port":2049,"url":"NetworkFilesystem://10.8.1.40//mnt/DRIVE/DATA/?ROLE=Primary&STOREUUID=1a07254a-c9d4-3ae0-8090-461e6597d818"}},"name":"ROOT-710","size":42949672960,"path":"c0669da9-1f91-4bdf-85aa-1d90bd9dc966","volumeId":1071,"vmName":"i-2-710-VM","accountId":2,"format":"VHD","id":1071,"deviceId":0,"hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"86417b6e-3fda-476e-b4d1-3bc77a67be89","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.8.1.30/mnt/DATA/VM-SEC-01","_role":"Image"}},"name":"ROOT-710","size":42949672960,"path":"volumes/2/1071","volumeId":1071,"vmName":"i-2-710-VM","accountId":2,"format":"VHD","id":1071,"deviceId":0,"hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":21600}}]
}
2014-08-21 11:37:41,092 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-166:ctx-1c81dd64) Seq 73-1469252089: Executing request
2014-08-21 11:37:41,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-166:ctx-1c81dd64) Creating a not shared SR for
nfs://10.8.1.30/mnt/DATA/VM-SEC-01/volumes/2/1071
2014-08-21 11:37:42,439 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-166:ctx-1c81dd64) Checking 40025c0c-d50a-3b20-b5b2-4e78fb977548 or
SR b82c8275-be3d-b768-7c2b-544b3e4d07e0 on
XS[d58748d8-f57b-4464-8293-fb87904b36e7-10.8.1.17]
2014-08-21 11:37:42,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-166:ctx-1c81dd64) Host 10.8.1.17
OpaqueRef:26f49fe4-458d-d356-78e1-1800372e7969: Created a SR; UUID is
b82c8275-be3d-b768-7c2b-544b3e4d07e0 device config is
{serverpath=/mnt/DATA/VM-SEC-01/volumes/2/1071, server=10.8.1.30}
Cheers
