[ovirt-users] cannot migrate hosted engine to sandybridge hypervisor
Hi I am unable to migrate to hypervisor that's sandy bridge CPU. The cluster supports CPUs that old. This is the message on host when migration fails: Aug 23 20:40:14 lyon vdsm[9648]: WARN Worker blocked: at 0x7f2f8054b350> timeout=15, duration=15 at 0x7f2f8048d290> task#=79 at 0x7f2f80540490>, traceback:#012File: "/usr/lib64/python2.7/threading.py", line 785, in __bootstrap#012 self.__bootstrap_inner()#012File: "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner#012 self.run()#012File: "/usr/lib64/python2.7/threading.py", line 765, in run#012 self.__target(*self.__args, **self.__kwargs)#012File: "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 194, in run#012 ret = func(*args, **kwargs)#012File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 301, in _run#012 self._execute_task()#012File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 315, in _execute_task#012 task()#012File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 391, in __call__#012 self._callable()#012File: "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 220, in __call__#012 self._func()#012File: "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line 580, in __call__#012 stats = hostapi.get_stats(self._cif, self._samples.stats())#012File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 77, in get_stats#012 ret['haStats'] = _getHaInfo()#012File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 182, in _getHaInfo#012 stats = instance.get_all_stats()#012File: "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 94, in get_all_stats#012 stats = broker.get_stats_from_storage()#012File: "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 135, in get_stats_from_storage#012 result = self._proxy.get_stats()#012File: "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__#012 return self.__send(self.__name, args)#012File: "/usr/lib64/python2.7/xmlrpclib.py", line 1591, in __request#012 verbose=self.__verbose#012File: "/usr/lib64/python2.7/xmlrpclib.py", line 1273, in request#012 return self.single_request(host, handler, request_body, verbose)#012File: "/usr/lib64/python2.7/xmlrpclib.py", line 1303, in single_request#012 response = h.getresponse(buffering=True)#012File: "/usr/lib64/python2.7/httplib.py", line 1113, in getresponse#012 response.begin()#012File: "/usr/lib64/python2.7/httplib.py", line 444, in begin#012 version, status, reason = self._read_status()#012File: "/usr/lib64/python2.7/httplib.py", line 400, in _read_status#012 line = self.fp.readline(_MAXLINE + 1)#012File: "/usr/lib64/python2.7/socket.py", line 476, in readline#012 data = self._sock.recv(self._rbufsize) Aug 23 20:43:45 lyon vdsm[9648]: WARN ping was deprecated in favor of ping2 and confirmConnectivity Aug 23 20:43:45 lyon vdsm[9648]: WARN Attempting to add an existing net user: ovirtmgmt/adf14389-1563-4b1a-9af6-4b40370a825b Aug 23 20:43:46 lyon lldpad: recvfrom(Event interface): No buffer space available Aug 23 20:43:46 lyon kernel: ovirtmgmt: port 2(vnet0) entered blocking state Aug 23 20:43:46 lyon kernel: ovirtmgmt: port 2(vnet0) entered disabled state Aug 23 20:43:46 lyon kernel: device vnet0 entered promiscuous mode Aug 23 20:43:46 lyon kernel: ovirtmgmt: port 2(vnet0) entered blocking state Aug 23 20:43:46 lyon kernel: ovirtmgmt: port 2(vnet0) entered forwarding state Aug 23 20:43:46 lyon NetworkManager[1658]: [1535071426.4326] manager: (vnet0): new Tun device (/org/freedesktop/NetworkManager/Devices/57) Aug 23 20:43:46 lyon NetworkManager[1658]: [1535071426.4336] device (vnet0): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'external') Aug 23 20:43:46 lyon NetworkManager[1658]: [1535071426.4341] device (vnet0): state change: unavailable -> disconnected (reason 'none', sys-iface-state: 'external') Aug 23 20:43:46 lyon dbus[1396]: [system] Activating via systemd: service name='org.freedesktop.machine1' unit='dbus-org.freedesktop.machine1.service' Aug 23 20:43:46 lyon systemd: Cannot add dependency job for unit lvm2-lvmetad.socket, ignoring: Unit is masked. Aug 23 20:43:46 lyon systemd: Starting Virtual Machine and Container Registration Service... Aug 23 20:43:46 lyon dbus[1396]: [system] Successfully activated service 'org.freedesktop.machine1' Aug 23 20:43:46 lyon systemd: Started Virtual Machine and Container Registration Service. Aug 23 20:43:46 lyon systemd-machined: New machine qemu-2-HostedEngine. Aug 23 20:43:46 lyon systemd: Started Virtual Machine qemu-2-HostedEngine. Aug 23 20:43:46 lyon systemd: Starting Virtual Machine qemu-2-HostedEngine. Aug 23 20:43:46 lyon kvm: 1 guest now active Aug 23 20:43:46 lyon libvirtd: 2018-08-24 00:43:46.940+: 9195: error : *virCPUx86UpdateLive:2742 : operation failed: guest CPU doesn't match specification: missing features: fma,movbe,f16c,rdrand,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,m
Re: [ovirt-users] Cannot Migrate Hosted Engine
On Thu, Nov 17, 2016 at 8:28 AM, Michal Skrivanek <
michal.skriva...@redhat.com> wrote:
>
> On 27 Oct 2016, at 15:54, knarra wrote:
>
> Hi,
>
> I have installed latest upstream master on RHEL7.2. When i try to put
> a host in maintenance which runs HE vm i see that vm does not get migrated
> to another host and host is stuck in "preparing for maintenace" state. I
> see the following errors in the vdsm.log . Can you please help me
> understand why this error is seen?
>
>
> seems to be caused by OVS hook issue
> update to latest and try again, if it’s still not working remove the ovs
> hook(s)
>
This VM was created in a version that was missing the graphics parameter,
so I do not think an upgrade will help.
Maybe shutting down the VM after the system upgrade may help, but that is
not always practical.
The patch that aimed to fix this is this: https://gerrit.ovirt.org/#/c/64300
Unfortunately it is stuck on review.
>
>1. 2016-10-27 16:40:22,742 ERROR (Thread-3293) [virt.vm]
>(vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Hook script execution
>failed: internal error: Child process (LC_ALL=C PAT
>2. H=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
>/etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit
>status 1: Traceback (most recent call last):
>3. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
>4. _process_domxml(tree)
>5. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in
>_process_domxml
>6. _set_graphics(devices, target_vm_conf)
>7. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in
>_set_graphics
>8. target_display_network, target_display_ip =
>_vmconf_display(target_vm_conf)
>9. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in
>_vmconf_display
>10. raise VmMigrationHookError('VM conf graphics not detected')
>11. VmMigrationHookError: VM conf graphics not detected
>12. Traceback (most recent call last):
>13. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
>
>14. main(*sys.argv[1:])
>15. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
>16. _process_domxml(tree)
>17. File "/usr/libexec/vdsm/vm_migrate_hoo (migration:261)
>18. 2016-10-27 16:40:22,757 ERROR (Thread-3293) [virt.vm]
>(vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Failed to migrate
>(migration:390)
>19. Traceback (most recent call last):
>20. File "/usr/share/vdsm/virt/migration.py", line 372, in run
>21. self._startUnderlyingMigration(time.time())
>22. File "/usr/share/vdsm/virt/migration.py", line 447, in
>_startUnderlyingMigration
>23. self._perform_with_downtime_thread(duri, muri)
>24. File "/usr/share/vdsm/virt/migration.py", line 498, in
>_perform_with_downtime_thread
>25. self._perform_migration(duri, muri)
>26. File "/usr/share/vdsm/virt/migration.py", line 485, in
>_perform_migration
>27. self._vm._dom.migrateToURI3(duri, params, flags)
>28. File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py",
>line 69, in f
>29. ret = attr(*args, **kwargs)
>30. File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py",
>line 123, in wrapper
>31. ret = f(*args, **kwargs)
>32. File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 899,
>in wrapper
>33. return func(inst, *args, **kwargs)
>34. File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836,
>in migrateToURI3
>35. :
>36. if ret == -1: raise libvirtError ('virDomainMigrateToURI3()
>failed', dom=self)
>37. libvirtError: Hook script execution failed: internal error: Child
>process (LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
>/etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit
>status 1: Traceback (most recent call last):
>38. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
>39. _process_domxml(tree)
>40. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in
>_process_domxml
>41. _set_graphics(devices, target_vm_conf)
>42. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in
>_set_graphics
>43. target_display_network, target_display_ip =
>_vmconf_display(target_vm_conf)
>44. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in
>_vmconf_display
>45. raise VmMigrationHookError('VM conf graphics not detected')
>46. VmMigrationHookError: VM conf graphics not detected
>47. Traceback (most recent call last):
>48. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
>
>49. main(*sys.argv[1:])
>50. File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
>51. _process_domxml(tree)
>52. File "/usr/libexec/vdsm/vm_migrate_hoo
>
> Thanks
>
> kasturi.
>
Re: [ovirt-users] Cannot Migrate Hosted Engine
> On 27 Oct 2016, at 15:54, knarra wrote:
>
> Hi,
>
> I have installed latest upstream master on RHEL7.2. When i try to put a
> host in maintenance which runs HE vm i see that vm does not get migrated to
> another host and host is stuck in "preparing for maintenace" state. I see the
> following errors in the vdsm.log . Can you please help me understand why this
> error is seen?
>
seems to be caused by OVS hook issue
update to latest and try again, if it’s still not working remove the ovs hook(s)
> 2016-10-27 16:40:22,742 ERROR (Thread-3293) [virt.vm]
> (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Hook script execution failed:
> internal error: Child process (LC_ALL=C PAT
> H=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin /etc/libvirt/hooks/qemu
> HostedEngine migrate begin -) unexpected exit status 1: Traceback (most
> recent call last):
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
> _process_domxml(tree)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml
> _set_graphics(devices, target_vm_conf)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics
> target_display_network, target_display_ip =
> _vmconf_display(target_vm_conf)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display
> raise VmMigrationHookError('VM conf graphics not detected')
> VmMigrationHookError: VM conf graphics not detected
> Traceback (most recent call last):
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
> main(*sys.argv[1:])
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
> _process_domxml(tree)
> File "/usr/libexec/vdsm/vm_migrate_hoo (migration:261)
> 2016-10-27 16:40:22,757 ERROR (Thread-3293) [virt.vm]
> (vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Failed to migrate
> (migration:390)
> Traceback (most recent call last):
> File "/usr/share/vdsm/virt/migration.py", line 372, in run
> self._startUnderlyingMigration(time.time())
> File "/usr/share/vdsm/virt/migration.py", line 447, in
> _startUnderlyingMigration
> self._perform_with_downtime_thread(duri, muri)
> File "/usr/share/vdsm/virt/migration.py", line 498, in
> _perform_with_downtime_thread
> self._perform_migration(duri, muri)
> File "/usr/share/vdsm/virt/migration.py", line 485, in _perform_migration
> self._vm._dom.migrateToURI3(duri, params, flags)
> File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 69, in
> f
> ret = attr(*args, **kwargs)
> File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line
> 123, in wrapper
> ret = f(*args, **kwargs)
> File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 899, in wrapper
> return func(inst, *args, **kwargs)
> File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836, in
> migrateToURI3
> :
> if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed',
> dom=self)
> libvirtError: Hook script execution failed: internal error: Child process
> (LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
> /etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected exit status
> 1: Traceback (most recent call last):
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
> _process_domxml(tree)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in _process_domxml
> _set_graphics(devices, target_vm_conf)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in _set_graphics
> target_display_network, target_display_ip =
> _vmconf_display(target_vm_conf)
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in _vmconf_display
> raise VmMigrationHookError('VM conf graphics not detected')
> VmMigrationHookError: VM conf graphics not detected
> Traceback (most recent call last):
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
> main(*sys.argv[1:])
> File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
> _process_domxml(tree)
> File "/usr/libexec/vdsm/vm_migrate_hoo
> Thanks
>
> kasturi.
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Cannot Migrate Hosted Engine
Hi,
I have installed latest upstream master on RHEL7.2. When i try to
put a host in maintenance which runs HE vm i see that vm does not get
migrated to another host and host is stuck in "preparing for maintenace"
state. I see the following errors in the vdsm.log . Can you please help
me understand why this error is seen?
1.
2016-10-27 16:40:22,742 ERROR (Thread-3293) [virt.vm]
(vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Hook script execution
failed: internal error: Child process (LC_ALL=C PAT
2.
H=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
/etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected
exit status 1: Traceback (most recent call last):
3.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
4.
_process_domxml(tree)
5.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in
_process_domxml
6.
_set_graphics(devices, target_vm_conf)
7.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in
_set_graphics
8.
target_display_network, target_display_ip =
_vmconf_display(target_vm_conf)
9.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in
_vmconf_display
10.
raise VmMigrationHookError('VM conf graphics not detected')
11.
VmMigrationHookError: VM conf graphics not detected
12.
Traceback (most recent call last):
13.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
14.
main(*sys.argv[1:])
15.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
16.
_process_domxml(tree)
17.
File "/usr/libexec/vdsm/vm_migrate_hoo (migration:261)
18.
2016-10-27 16:40:22,757 ERROR (Thread-3293) [virt.vm]
(vmId='21e0e248-19bf-47b3-b72f-6a3740d9ff43') Failed to migrate
(migration:390)
19.
Traceback (most recent call last):
20.
File "/usr/share/vdsm/virt/migration.py", line 372, in run
21.
self._startUnderlyingMigration(time.time())
22.
File "/usr/share/vdsm/virt/migration.py", line 447, in
_startUnderlyingMigration
23.
self._perform_with_downtime_thread(duri, muri)
24.
File "/usr/share/vdsm/virt/migration.py", line 498, in
_perform_with_downtime_thread
25.
self._perform_migration(duri, muri)
26.
File "/usr/share/vdsm/virt/migration.py", line 485, in
_perform_migration
27.
self._vm._dom.migrateToURI3(duri, params, flags)
28.
File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py",
line 69, in f
29.
ret = attr(*args, **kwargs)
30.
File
"/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line
123, in wrapper
31.
ret = f(*args, **kwargs)
32.
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 899,
in wrapper
33.
return func(inst, *args, **kwargs)
34.
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836,
in migrateToURI3
35.
:
36.
if ret == -1: raise libvirtError ('virDomainMigrateToURI3()
failed', dom=self)
37.
libvirtError: Hook script execution failed: internal error: Child
process (LC_ALL=C
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
/etc/libvirt/hooks/qemu HostedEngine migrate begin -) unexpected
exit status 1: Traceback (most recent call last):
38.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
39.
_process_domxml(tree)
40.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 80, in
_process_domxml
41.
_set_graphics(devices, target_vm_conf)
42.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 156, in
_set_graphics
43.
target_display_network, target_display_ip =
_vmconf_display(target_vm_conf)
44.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 177, in
_vmconf_display
45.
raise VmMigrationHookError('VM conf graphics not detected')
46.
VmMigrationHookError: VM conf graphics not detected
47.
Traceback (most recent call last):
48.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 201, in
49.
main(*sys.argv[1:])
50.
File "/usr/libexec/vdsm/vm_migrate_hook.py", line 51, in main
51.
_process_domxml(tree)
52.
File "/usr/libexec/vdsm/vm_migrate_hoo
Thanks
kasturi.
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
