Re: [ovirt-users] Hosted-Engine Fails to Start
On Wed, Dec 14, 2016 at 6:30 PM, Nate T. Llaneza wrote: > Hey Simone, > > > > Here is the output you requested. > > > > [root@cits002 ~]# ls -l /rhev/data-center/mnt/backup.citsnc.com > \:_export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids > > -rwxr-xr-x 1 vdsm kvm 1048576 Dec 13 06:29 /rhev/data-center/mnt/backup. > citsnc.com:_export_Hosted-Engine/45aaa81e-4047-4209- > ae4c-8504a243d16e/dom_md/ids > Thanks, I think you have just to run sanlock client renewal -s 45aaa81e-4047-4209-ae4c-8504a243d16e:2:/rhev/data-center/mnt/backup.citsnc.com: _export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids:0 to manually force a renew of the sanlock lease > > > > *From: *Simone Tiraboschi > *Sent: *Wednesday, December 14, 2016 11:57 AM > *To: *Nate T. Llaneza > *Cc: *users > *Subject: *Re: Re[2]: [ovirt-users] Hosted-Engine Fails to Start > > > > > On Wed, Dec 14, 2016 at 5:09 PM, Nate T. Llaneza > wrote: > >> Hey Simone, >> >> Thanks for looking at it! I am attaching the requested sanlock log file. >> I see alot of errors in the past two days. >> > > Could you please paste the output of: > ls -l /rhev/data-center/mnt/backup.citsnc.com:_export_ > Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids > > >> >> Regards, >> >> Nate >> >> >> -- Original Message -- >> From: "Simone Tiraboschi" >> To: "Nate T. Llaneza" >> Cc: "users" >> Sent: 12/14/2016 10:54:20 AM >> Subject: Re: [ovirt-users] Hosted-Engine Fails to Start >> >> hi Nate, >> your issue is here: >> Thread-1300::ERROR::2016-12-14 >> 08:35:43,818::vm::773::virt.vm::(_startUnderlyingVm) >> vmId=`ef7b601b-1ae6-4adf-bde6-1455bdb03f52`::The vm start process failed >> Traceback (most recent call last): >> File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm >> self._run() >> File "/usr/share/vdsm/virt/vm.py", line 2026, in _run >> self._connection.createXML(domxml, flags), >> File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", >> line 123, in wrapper >> ret = f(*args, **kwargs) >> File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 917, in >> wrapper >> return func(inst, *args, **kwargs) >> File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in >> createXML >> if ret is None:raise libvirtError('virDomainCreateXML() failed', >> conn=self) >> libvirtError: Failed to acquire lock: No space left on device >> >> Could you please attach the output of >> sanlock client status >> >> >> >> On Wed, Dec 14, 2016 at 2:55 PM, Nate T. Llaneza >> wrote: >> >>> Hey Guys, >>> >>> I just performed the update to ovirt-4.0.6-pre on my hosted engine >>> hypervisor (making sure to pull from the baseurl and not the mirrorlist). >>> This cleaned up the Glib error message I sent earlier. Awesome! The >>> downside is that the hosted-engine is still not starting. I'm not sure >>> where to look, so I am attaching the vdsm log and Hosted-Engine log. Let me >>> know if there is anything else you need. Thanks for y'alls help. >>> >>> Regards, >>> >>> Nathan >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.phx.ovirt.org/mailman/listinfo/users >>> >>> >> > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted-Engine Fails to Start
Hey Simone, Here is the output you requested. [root@cits002 ~]# ls -l /rhev/data-center/mnt/backup.citsnc.com\:_export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids -rwxr-xr-x 1 vdsm kvm 1048576 Dec 13 06:29 /rhev/data-center/mnt/backup.citsnc.com:_export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids From: Simone Tiraboschi<mailto:stira...@redhat.com> Sent: Wednesday, December 14, 2016 11:57 AM To: Nate T. Llaneza<mailto:nllan...@citsnc.com> Cc: users<mailto:users@ovirt.org> Subject: Re: Re[2]: [ovirt-users] Hosted-Engine Fails to Start On Wed, Dec 14, 2016 at 5:09 PM, Nate T. Llaneza mailto:nllan...@citsnc.com>> wrote: Hey Simone, Thanks for looking at it! I am attaching the requested sanlock log file. I see alot of errors in the past two days. Could you please paste the output of: ls -l /rhev/data-center/mnt/backup.citsnc.com:_export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids Regards, Nate -- Original Message -- From: "Simone Tiraboschi" mailto:stira...@redhat.com>> To: "Nate T. Llaneza" mailto:nllan...@citsnc.com>> Cc: "users" mailto:users@ovirt.org>> Sent: 12/14/2016 10:54:20 AM Subject: Re: [ovirt-users] Hosted-Engine Fails to Start hi Nate, your issue is here: Thread-1300::ERROR::2016-12-14 08:35:43,818::vm::773::virt.vm::(_startUnderlyingVm) vmId=`ef7b601b-1ae6-4adf-bde6-1455bdb03f52`::The vm start process failed Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 2026, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 917, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: Failed to acquire lock: No space left on device Could you please attach the output of sanlock client status On Wed, Dec 14, 2016 at 2:55 PM, Nate T. Llaneza mailto:nllan...@citsnc.com>> wrote: Hey Guys, I just performed the update to ovirt-4.0.6-pre on my hosted engine hypervisor (making sure to pull from the baseurl and not the mirrorlist). This cleaned up the Glib error message I sent earlier. Awesome! The downside is that the hosted-engine is still not starting. I'm not sure where to look, so I am attaching the vdsm log and Hosted-Engine log. Let me know if there is anything else you need. Thanks for y'alls help. Regards, Nathan ___ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.phx.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted-Engine Fails to Start
On Wed, Dec 14, 2016 at 5:09 PM, Nate T. Llaneza wrote: > Hey Simone, > > Thanks for looking at it! I am attaching the requested sanlock log file. I > see alot of errors in the past two days. > Could you please paste the output of: ls -l /rhev/data-center/mnt/backup.citsnc.com: _export_Hosted-Engine/45aaa81e-4047-4209-ae4c-8504a243d16e/dom_md/ids > > Regards, > > Nate > > > -- Original Message -- > From: "Simone Tiraboschi" > To: "Nate T. Llaneza" > Cc: "users" > Sent: 12/14/2016 10:54:20 AM > Subject: Re: [ovirt-users] Hosted-Engine Fails to Start > > hi Nate, > your issue is here: > Thread-1300::ERROR::2016-12-14 > 08:35:43,818::vm::773::virt.vm::(_startUnderlyingVm) > vmId=`ef7b601b-1ae6-4adf-bde6-1455bdb03f52`::The vm start process failed > Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm > self._run() > File "/usr/share/vdsm/virt/vm.py", line 2026, in _run > self._connection.createXML(domxml, flags), > File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line > 123, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 917, in > wrapper > return func(inst, *args, **kwargs) > File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in > createXML > if ret is None:raise libvirtError('virDomainCreateXML() failed', > conn=self) > libvirtError: Failed to acquire lock: No space left on device > > Could you please attach the output of > sanlock client status > > > > On Wed, Dec 14, 2016 at 2:55 PM, Nate T. Llaneza > wrote: > >> Hey Guys, >> >> I just performed the update to ovirt-4.0.6-pre on my hosted engine >> hypervisor (making sure to pull from the baseurl and not the mirrorlist). >> This cleaned up the Glib error message I sent earlier. Awesome! The >> downside is that the hosted-engine is still not starting. I'm not sure >> where to look, so I am attaching the vdsm log and Hosted-Engine log. Let me >> know if there is anything else you need. Thanks for y'alls help. >> >> Regards, >> >> Nathan >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.phx.ovirt.org/mailman/listinfo/users >> >> > ___ Users mailing list Users@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted-Engine Fails to Start
hi Nate, your issue is here: Thread-1300::ERROR::2016-12-14 08:35:43,818::vm::773::virt.vm::(_startUnderlyingVm) vmId=`ef7b601b-1ae6-4adf-bde6-1455bdb03f52`::The vm start process failed Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 2026, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 917, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: Failed to acquire lock: No space left on device Could you please attach the output of sanlock client status On Wed, Dec 14, 2016 at 2:55 PM, Nate T. Llaneza wrote: > Hey Guys, > > I just performed the update to ovirt-4.0.6-pre on my hosted engine > hypervisor (making sure to pull from the baseurl and not the mirrorlist). > This cleaned up the Glib error message I sent earlier. Awesome! The > downside is that the hosted-engine is still not starting. I'm not sure > where to look, so I am attaching the vdsm log and Hosted-Engine log. Let me > know if there is anything else you need. Thanks for y'alls help. > > Regards, > > Nathan > > ___ > Users mailing list > Users@ovirt.org > http://lists.phx.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/users
[ovirt-users] Hosted-Engine Fails to Start
Hey Guys, I am running into a little problem. I shutdown today to run updates and when I went to power back up the cannot get the hosted engine to come back online. I am running CentOS 7 for my hypervisors. I did notice that CentOS has released the 7.3 updates. I want to say I have narrowed it down to this error in /var/log/libvirt/qemu/Hosted-Engine.log: GLib-WARNING **: gmem.c:482: custom memory allocation vtable not supported It seems like this was suppose to be fixed? https://bugzilla.redhat.com/show_bug.cgi?id=1360137 I am attaching the Hosted Engine log file. Just for fun I did try updating the qemu-kvm version to 2.6 from the ovirt-master-snapshot-static... It did not seem to help. Thanks for looking into this! Regards, Nathan HostedEngine.log Description: HostedEngine.log ___ Users mailing list Users@ovirt.org http://lists.phx.ovirt.org/mailman/listinfo/users