[ovirt-users] Live storage migration is failing in 4.2.8
Hello, we have recently updated few ovirts from 4.2.5 to 4.2.8 version
(actually 9 ovirt engine nodes), where the live storage migration
stopped to work, and leave auto-generated snapshot behind.
If we power the guest VM down, the migration works as expected. Is there
a known bug for this? Shall we open a new one?
Setup:
ovirt - Dell PowerEdge R630
- CentOS Linux release 7.6.1810 (Core)
- ovirt-engine-4.2.8.2-1.el7.noarch
- kernel-3.10.0-957.10.1.el7.x86_64
hypervisors - Dell PowerEdge R640
- CentOS Linux release 7.6.1810 (Core)
- kernel-3.10.0-957.10.1.el7.x86_64
- vdsm-4.20.46-1.el7.x86_64
- libvirt-5.0.0-1.el7.x86_64
- qemu-kvm-ev-2.12.0-18.el7_6.3.1.x86_64
storage domain - netapp NFS share
logs are attached
--
Ladislav Humenik
System administrator
2019-04-12 10:39:25,503+0200 INFO (jsonrpc/0) [api.virt] START
diskReplicateStart(srcDisk={'device': 'disk', 'poolID':
'b1a475aa-c084-46e5-b65a-bf4a47143c88', 'volumeID':
'5c2738a4-4279-4cc3-a0de-6af1095f8879', 'domainID':
'e5bb3e8a-a9c6-4581-8c6a-67d4ee7609f5', 'imageID':
'9a66bf0f-1333-4931-ad58-f6f1aa1143be'}, dstDisk={'device': 'disk', 'poolID':
'b1a475aa-c084-46e5-b65a-bf4a47143c88', 'volumeID':
'5c2738a4-4279-4cc3-a0de-6af1095f8879', 'domainID':
'244dfdfb-2662-4103-9d39-2b13153f2047', 'imageID':
'9a66bf0f-1333-4931-ad58-f6f1aa1143be'}) from=:::10.76.98.4,57566,
flow_id=97b620d9-6e65-4573-9fdf-5b119764fbb7,
vmId=71f27df0-f54f-4a2e-a51c-e61aa26b370d (api:46)
2019-04-12 10:39:25,513+0200 INFO (jsonrpc/0) [vdsm.api] START
prepareImage(sdUUID='244dfdfb-2662-4103-9d39-2b13153f2047',
spUUID='b1a475aa-c084-46e5-b65a-bf4a47143c88',
imgUUID='9a66bf0f-1333-4931-ad58-f6f1aa1143be',
leafUUID='5c2738a4-4279-4cc3-a0de-6af1095f8879', allowIllegal=False)
from=:::10.76.98.4,57566, flow_id=97b620d9-6e65-4573-9fdf-5b119764fbb7,
task_id=78dde3c9-74fb-4588-8cfa-117f0bbe2d2d (api:46)
2019-04-12 10:39:25,630+0200 INFO (jsonrpc/0) [storage.StorageDomain] Fixing
permissions on
/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/cbe93bfe-9df0-4f12-a44e-9e8fa6ec24f2
(fileSD:623)
2019-04-12 10:39:25,631+0200 INFO (jsonrpc/0) [storage.StorageDomain] Fixing
permissions on
/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/5c2738a4-4279-4cc3-a0de-6af1095f8879
(fileSD:623)
2019-04-12 10:39:25,632+0200 INFO (jsonrpc/0) [storage.StorageDomain] Creating
domain run directory
u'/var/run/vdsm/storage/244dfdfb-2662-4103-9d39-2b13153f2047' (fileSD:577)
2019-04-12 10:39:25,632+0200 INFO (jsonrpc/0) [storage.fileUtils] Creating
directory: /var/run/vdsm/storage/244dfdfb-2662-4103-9d39-2b13153f2047 mode:
None (fileUtils:197)
2019-04-12 10:39:25,632+0200 INFO (jsonrpc/0) [storage.StorageDomain] Creating
symlink from
/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be
to
/var/run/vdsm/storage/244dfdfb-2662-4103-9d39-2b13153f2047/9a66bf0f-1333-4931-ad58-f6f1aa1143be
(fileSD:580)
2019-04-12 10:39:25,637+0200 INFO (jsonrpc/0) [vdsm.api] FINISH prepareImage
return={'info': {'path':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/5c2738a4-4279-4cc3-a0de-6af1095f8879',
'type': 'file'}, 'path':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/5c2738a4-4279-4cc3-a0de-6af1095f8879',
'imgVolumesInfo': [{'domainID': '244dfdfb-2662-4103-9d39-2b13153f2047',
'leaseOffset': 0, 'path':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/cbe93bfe-9df0-4f12-a44e-9e8fa6ec24f2',
'volumeID': u'cbe93bfe-9df0-4f12-a44e-9e8fa6ec24f2', 'leasePath':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/cbe93bfe-9df0-4f12-a44e-9e8fa6ec24f2.lease',
'imageID': '9a66bf0f-1333-4931-ad58-f6f1aa1143be'}, {'domainID':
'244dfdfb-2662-4103-9d39-2b13153f2047', 'leaseOffset': 0, 'path':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/5c2738a4-4279-4cc3-a0de-6af1095f8879',
'volumeID': u'5c2738a4-4279-4cc3-a0de-6af1095f8879', 'leasePath':
u'/rhev/data-center/mnt/removed-IP-address:_bs01aF1C1v1/244dfdfb-2662-4103-9d39-2b13153f2047/images/9a66bf0f-1333-4931-ad58-f6f1aa1143be/5c2738a4-4279-4cc3-a0de-6af1095f8879.lease',
'imageID': '9a66bf0f-1333-4931-ad58-f6f1aa1143be'}]}
from=:::10.76.98.4,57566, flow_id=97b620d9-6e65-4573-9fdf-5b119764fbb7,
task_id=78dde3c9-74fb-4588-8cfa-117f0bbe2d2d (api:52)
2019-04-12 10:39:25,637+0200
[ovirt-users] Live storage migration?
Hi list! I need to move my vm:s from one datacenter to another. The problem is that i don't have shared storage between those datacenters. How can i move my vm:s without stopping them? I know in vmware that is possible thru vmotion /C ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage Migration
> Von: Greg Padgett [gpadg...@redhat.com] > Gesendet: Samstag, 19. September 2015 02:19 > An: Markus Stockhausen > Cc: Users@ovirt.org > Betreff: Re: [ovirt-users] Live Storage Migration > > On 09/14/2015 05:20 AM, Markus Stockhausen wrote: > > Hi, > > > > somehow I got lost about the possibility to do a live storage migration. > > We are using OVirt 3.5.4 + FC20 Nodes (virt-preview - qemu 2.1.3) > > > > From the WebUI I have the following possibilites: > > > > 1) disk without snapshot: VMs tab -> Disks -> Move: Button is active > > but it does not allow to do a migration. No selectable storage domain > > although we have 2 NFS systems. Gives warning hints about > > "you are doing live migration, bla bla, ..." > > > > 2) disk with snapshot: VMs tab -> Disk -> Move: Button greyed out > > > > 3) BUT! Disks tab -> Move: Works! No hints about "live migration" > > I do not dare to click go ... > > > > While 1/2 might be consistent they do not match to 3. Maybe someone > > can give a hint what should work, what not and where me might have > > an error. > > Hi Markus, > > Is this still relevant? If so... > > Live storage migration requires the following (from the code that > determines if the "Move" buttons in 1/2 above are greyed or not): > > - cluster and dc version must be at least 3.2 > - vm must be stateful and up or paused > - disk to migrate must be the active layer (ie not a snapshot) > - disk images must be 'OK' > > Is it possible one of these changed for the VM(s) in question? Hi Greg, thanks for your response. In between I was able to get into it. Situation is as follows: - Move button is grayed out during VM start (3 green arrows up) As I have a refresh interval of 60 secondes, it can stay gray for a long time. - Disks can be migrated with or without snapshots. - For the different dialogue behaviour I opened bug https://bugzilla.redhat.com/show_bug.cgi?id=1264643 Markus > Thanks, > Greg > Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Ãber das Internet versandte E-Mails können unter fremden Namen erstellt oder manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine rechtsverbindliche Willenserklärung. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln Vorstand: Kadir Akin Dr. Michael Höhnerbach Vorsitzender des Aufsichtsrates: Hans Kristian Langva Registergericht: Amtsgericht Köln Registernummer: HRB 52 497 This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. e-mails sent over the internet may have been written under a wrong name or been manipulated. That is why this message sent as an e-mail is not a legally binding declaration of intention. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln executive board: Kadir Akin Dr. Michael Höhnerbach President of the supervisory board: Hans Kristian Langva Registry office: district court Cologne Register number: HRB 52 497 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage Migration
On 09/14/2015 05:20 AM, Markus Stockhausen wrote: Hi, somehow I got lost about the possibility to do a live storage migration. We are using OVirt 3.5.4 + FC20 Nodes (virt-preview - qemu 2.1.3) From the WebUI I have the following possibilites: 1) disk without snapshot: VMs tab -> Disks -> Move: Button is active but it does not allow to do a migration. No selectable storage domain although we have 2 NFS systems. Gives warning hints about "you are doing live migration, bla bla, ..." 2) disk with snapshot: VMs tab -> Disk -> Move: Button greyed out 3) BUT! Disks tab -> Move: Works! No hints about "live migration" I do not dare to click go ... While 1/2 might be consistent they do not match to 3. Maybe someone can give a hint what should work, what not and where me might have an error. Hi Markus, Is this still relevant? If so... Live storage migration requires the following (from the code that determines if the "Move" buttons in 1/2 above are greyed or not): - cluster and dc version must be at least 3.2 - vm must be stateful and up or paused - disk to migrate must be the active layer (ie not a snapshot) - disk images must be 'OK' Is it possible one of these changed for the VM(s) in question? Thanks, Greg Thanks. Markus ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Live Storage Migration
Hi, somehow I got lost about the possibility to do a live storage migration. We are using OVirt 3.5.4 + FC20 Nodes (virt-preview - qemu 2.1.3) >From the WebUI I have the following possibilites: 1) disk without snapshot: VMs tab -> Disks -> Move: Button is active but it does not allow to do a migration. No selectable storage domain although we have 2 NFS systems. Gives warning hints about "you are doing live migration, bla bla, ..." 2) disk with snapshot: VMs tab -> Disk -> Move: Button greyed out 3) BUT! Disks tab -> Move: Works! No hints about "live migration" I do not dare to click go ... While 1/2 might be consistent they do not match to 3. Maybe someone can give a hint what should work, what not and where me might have an error. Thanks. Markus Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Ãber das Internet versandte E-Mails können unter fremden Namen erstellt oder manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine rechtsverbindliche Willenserklärung. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln Vorstand: Kadir Akin Dr. Michael Höhnerbach Vorsitzender des Aufsichtsrates: Hans Kristian Langva Registergericht: Amtsgericht Köln Registernummer: HRB 52 497 This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. e-mails sent over the internet may have been written under a wrong name or been manipulated. That is why this message sent as an e-mail is not a legally binding declaration of intention. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln executive board: Kadir Akin Dr. Michael Höhnerbach President of the supervisory board: Hans Kristian Langva Registry office: district court Cologne Register number: HRB 52 497 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Live Storage migration doesn't work
Hi, I'm trying to move a disk of a virtual machine administration (that is online) to a different nfs storage, but despite the success of the task Creating VM Snapshot Auto-generated for Live Storage Migration for VM administration in the web page of ovirt engine, it doesn't move the disk to the new storage. This is the log in engine.log http://ur1.ca/hrcvt How can i resolve this? Best regards, -- André Freitas André Freitas System Network Administrator | (+351) 234 484 466 ISO 9001 CMMI Level 2 Ubiwhere Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage migration doesn't work
If you havent already done so, replace your qemu-* packages with the ones listed at the jekins site http://jenkins.ovirt.org/job/qemu-kvm-rhev_create-rpms_el6/ws/rpms/ - Original Message - From: André Freitas afrei...@ubiwhere.com To: users@ovirt.org Sent: Tuesday, July 15, 2014 6:13:03 AM Subject: [ovirt-users] Live Storage migration doesn't work Hi, I'm trying to move a disk of a virtual machine administration (that is online) to a different nfs storage, but despite the success of the task Creating VM Snapshot Auto-generated for Live Storage Migration for VM administration in the web page of ovirt engine, it doesn't move the disk to the new storage. This is the log in engine.log http://ur1.ca/hrcvt How can i resolve this? Best regards, -- André Freitas System Network Administrator | (+351) 234 484 466 Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage migration doesn't work
When i try to install this packages i get $ sudo yum localinstall *.rpm Examining qemu-img-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-img-0.12.1.2-2.415.el6_5.10.x86_64 qemu-img-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. Examining qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64 qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. Examining qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64 qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. -- André Freitas André Freitas System Network Administrator | (+351) 234 484 466 ISO 9001 CMMI Level 2 Ubiwhere Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. -Original Message- From: Maurice James mja...@media-node.com To: André Freitas afrei...@ubiwhere.com Cc: users@ovirt.org Subject: Re: [ovirt-users] Live Storage migration doesn't work Date: Tue, 15 Jul 2014 07:39:53 -0400 (EDT) If you havent already done so, replace your qemu-* packages with the ones listed at the jekins site http://jenkins.ovirt.org/job/qemu-kvm-rhev_create-rpms_el6/ws/rpms/ From: André Freitas afrei...@ubiwhere.com To: users@ovirt.org Sent: Tuesday, July 15, 2014 6:13:03 AM Subject: [ovirt-users] Live Storage migration doesn't work Hi, I'm trying to move a disk of a virtual machine administration (that is online) to a different nfs storage, but despite the success of the task Creating VM Snapshot Auto-generated for Live Storage Migration for VM administration in the web page of ovirt engine, it doesn't move the disk to the new storage. This is the log in engine.log http://ur1.ca/hrcvt How can i resolve this? Best regards, -- André Freitas André Freitas System Network Administrator | (+351) 234 484 466 ISO 9001 CMMI Level 2 Ubiwhere Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage migration doesn't work
you have to use the rpm command with the --force option - Original Message - From: André Freitas afrei...@ubiwhere.com To: users@ovirt.org Sent: Tuesday, July 15, 2014 9:13:41 AM Subject: Re: [ovirt-users] Live Storage migration doesn't work When i try to install this packages i get $ sudo yum localinstall *.rpm Examining qemu-img-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-img-0.12.1.2-2.415.el6_5.10.x86_64 qemu-img-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. Examining qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64 qemu-kvm-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. Examining qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64.rpm: 2:qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64 qemu-kvm-tools-0.12.1.2-2.415.el6_5.10.x86_64.rpm: does not update installed package. -- André Freitas System Network Administrator | (+351) 234 484 466 Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. -Original Message- From : Maurice James mja...@media-node.com To : André Freitas afrei...@ubiwhere.com Cc : users@ovirt.org Subject : Re: [ovirt-users] Live Storage migration doesn't work Date : Tue, 15 Jul 2014 07:39:53 -0400 (EDT) If you havent already done so, replace your qemu-* packages with the ones listed at the jekins site http://jenkins.ovirt.org/job/qemu-kvm-rhev_create-rpms_el6/ws/rpms/ From: André Freitas afrei...@ubiwhere.com To: users@ovirt.org Sent: Tuesday, July 15, 2014 6:13:03 AM Subject: [ovirt-users] Live Storage migration doesn't work Hi, I'm trying to move a disk of a virtual machine administration (that is online) to a different nfs storage, but despite the success of the task Creating VM Snapshot Auto-generated for Live Storage Migration for VM administration in the web page of ovirt engine, it doesn't move the disk to the new storage. This is the log in engine.log http://ur1.ca/hrcvt How can i resolve this? Best regards, -- André Freitas System Network Administrator | (+351) 234 484 466 Copyright © Ubiwhere. 2014. All rights reserved. Content for exclusive use of their rightful recipients. Dissemination, copy or use of information by third parties is prohibited. If you are not an authorised recipient and received this message, please notify the sender and then delete it without copying the text and attachments nor distributing or disclosing its contents. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Live Storage migration doesn't work
On 15-7-2014 15:19, Maurice James wrote: you have to use the rpm command with the --force option yum reinstall will also work. Joop ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
