Hello Folks We are seeing some errors consistently while migrating vm's from one node another node but still not able to find out the root cause of it. Can anyone please let me know what might be causing the issue? The vm's are migrated successfully though
This issue happens when I try to migrate the vm either from cloudmonkey command or through UI. Management server: $ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 12.04.3 LTS Release: 12.04 Codename: precise Error logs from management server: Aug 10 12:35:48 node13 sh[50956]: 2018-08-10 12:35:48,243{GMT} INFO [ resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-5:) Waiting for migration of i-884-15037-VM to complete, waited 3000ms Aug 10 12:35:48 node13 sh[50956]: 2018-08-10 12:35:48,486{GMT} INFO [ resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-1:) Waiting for migration of i-884-14365-VM to complete, waited 10000ms Aug 10 12:35:49 node13 sh[50956]: libvirt: QEMU Driver error : internal error: unable to execute QEMU command 'migrate-set-capabilities': There's a migration process in progressAug 10 12:35:49 node13 sh[50956]: 2018-08-10 12:35:49,087{GMT} INFO [resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-1:) Migration thread for i-884-14365-VM is done Aug 10 12:35:49 node13 sh[50956]: 2018-08-10 12:35:49,087{GMT} DEBUG [resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-1:) Failed to execute while migrating domain: org.libvirt.LibvirtException: internal error: unable to execute QEMU command 'migrate-set-capabilities': There's a migration process in progress Aug 10 12:35:49 node13 sh[50956]: 2018-08-10 12:35:49,087{GMT} DEBUG [kvm. resource.LibvirtComputingResource] (agentRequest-Handler-1:) Restoring the metadata of vm snapshots of vm i-884-14365-VM Aug 10 12:35:49 node13 sh[50956]: 2018-08-10 12:35:49,088{GMT} DEBUG [cloud. agent.Agent] (agentRequest-Handler-1:) Seq 367-5848768541070742315: { Ans: , MgmtId: 48674822042491, via: 367, Ver: v1, Flags: 10, [{ "com.cloud.agent.api.MigrateAnswer":{"result":false,"details":"org.libvirt.LibvirtException: internal error: unable to execute QEMU command 'migrate-set-capabilities': There's a migration process in progress","wait":0}}] } Agent: # lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 16.04.3 LTS Release: 16.04 Codename: xenial Error logs from agent: 2018-08-10 12:17:26,030 DEBUG [resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-4:null) Failed to execute while migrating domain: org.libvirt.LibvirtException: internal error: unable to execute QEMU command 'migrate-set-capabilities': There's a migration process in progress 2018-08-10 12:17:26,030 DEBUG [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-4:null) Restoring the metadata of vm snapshots of vm i-884-14365-VM 2018-08-10 12:17:26,031 DEBUG [cloud.agent.Agent] (agentRequest-Handler-4:null) Seq 367-5848768541070742169: { Ans: , MgmtId: 48674822042491, via: 367, Ver: v1, Flags: 10, [{"com.cloud.agent.api.MigrateAnswer":{"result":false,"details":"org.libvirt.LibvirtException: internal error: unable to execute QEMU command 'migrate-set-capabilities': There's a migration process in progress","wait":0}}] } 2018-08-10 12:17:26,564 INFO [resource.wrapper.LibvirtMigrateCommandWrapper] (agentRequest-Handler-4:null) Live migration of instance i-884-14365-VM initiated -- Thanks and regards Rakesh venkatesh