[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
“bootstrap VMs for some reasons fails to get an address from DHCP over libvirt
default natted network”.
I respectfully disagree. Line 1784 of the most recent log I sent you is:
2018-10-24 14:12:26,524+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-24
14:12:25.437958', u'stdout': u'192.168.124.175', u'cmd': u"virsh -r
net-dhcp-leases default | grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut
-f1 -d'/'", 'failed': False, 'attempts': 2, u'stderr': u'', u'rc': 0, u'delta':
u'0:00:00.070076', 'stdout_lines': [u'192.168.124.175'], u'start': u'2018-10-24
14:12:25.367882'}
I am able to ping the natted IP.
Also I wrote after an earlier attempt: “ovirt-engine.example.com resolves to a
natted IP: 192.168.124.51”.
(https://www.mail-archive.com/users@ovirt.org/msg51515.html).
The process fails as the bootstrap VM is moved to the final engine VM on the
shared storage. I still think if I solve the DHCP problem on my network, the
engine VM will be successfully created. Are you able to confirm the Node VM
(https://www.ovirt.org/node/) has DHCP enabled? If so, then since this has the
same DHCP problem as the engine VM (I have to type “dhclient” each boot to get
an IP), I can use Node to troubleshoot.
Many thanks,
Brendan
From: Simone Tiraboschi
Sent: 26 October 2018 08:39
To: B Holmes
Cc: users
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Thu, Oct 25, 2018 at 4:29 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
“The issue here is that it seams that your VM never got an address from libvirt
default network DHCP” – but aren’t I obviating DHCP by using parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
? VM should receive a static IP instead.
Perhaps there is a bug in hosted-engine setup that forces it to require DHCP.
No, this is expected.
The deploy process will launch a bootstrap local VM that will get a temporary
address via DHCP over libvirt default natted network.
The engine running on that VM will be used to configure the environment and
create a VM on the shared storage.
Only at the end, the local VM will be shutdown and its disk moved over the disk
of the VM created by the engine on the shared storage.
In your case it seams that the bootstrap VMs for some reasons fails to get an
address from DHCP over libvirt default natted network.
I'd suggest to try connecting to that VM via VNC to see what's going on there.
If you have no more suggestions, I will buy a new router with different DHCP
server.
Many thanks,
Brendan
From: Brendan Holmes mailto:m...@brendanh.com> >
Sent: 24 October 2018 16:48
To: 'Simone Tiraboschi' mailto:stira...@redhat.com> >
Cc: 'users' mailto:users@ovirt.org> >
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC addressProtocol IP address
HostnameClient ID or DUID
---
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a
bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 24 October 2018 16:11
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from
install of ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file
from package ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean
using command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP
option) and the usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt
default network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-24
15:36:13.196641', u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'", 'failed':
False, u'delta': u'0:00:00.054641', u'stderr': u'', u'rc': 0, 'stdout_lines':
[], u'start': u'2018-10-24 15:3
[ovirt-users] Re: Diary of hosted engine install woes
“The issue here is that it seams that your VM never got an address from libvirt
default network DHCP” – but aren’t I obviating DHCP by using parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
? VM should receive a static IP instead.
Perhaps there is a bug in hosted-engine setup that forces it to require DHCP.
If you have no more suggestions, I will buy a new router with different DHCP
server.
Many thanks,
Brendan
From: Brendan Holmes
Sent: 24 October 2018 16:48
To: 'Simone Tiraboschi'
Cc: 'users'
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC addressProtocol IP address
HostnameClient ID or DUID
---
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a
bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 24 October 2018 16:11
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from
install of ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file
from package ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean
using command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP
option) and the usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt
default network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-24
15:36:13.196641', u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'", 'failed':
False, u'delta': u'0:00:00.054641', u'stderr': u'', u'rc': 0, 'stdout_lines':
[], u'start': u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 24 October 2018 08:44
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifacts-el7-x86_64/157/artifact/exported-artifacts/ovirt-hosted-engine-setup-2.2.29-1.el7.noarch.rpm
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt
using answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heapplianceflow/
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the
engine VM or to variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t
work. Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is
networked. Which port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
[root@host ~]# virsh -r net-dhcp-leases default
Expiry Time MAC addressProtocol IP address
HostnameClient ID or DUID
---
[root@host ~]#
No, node is running on bare-metal. Node was installed by plugging in a
bootable USB.
Many thanks,
Brendan
From: Simone Tiraboschi
Sent: 24 October 2018 16:11
To: B Holmes
Cc: users
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Wed, Oct 24, 2018 at 4:56 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
My attempt to install the RPM output hundreds of lines similar to:
/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/__init__.pyc from
install of ovirt-hosted-engine-setup-2.2.29-1.el7.noarch conflicts with file
from package ovirt-hosted-engine-setup-2.2.26-1.el7.noarch
Do I need to install the matching version of ovirt node?
“using it interactively without manually filing an answerfile” – if you mean
using command: hosted-engine –deploy
and then manually typing each value, I tried this (choosing the static IP
option) and the usual error occurs. I attach the log from this attempt.
The issue here is that it seams that your VM never got an address from libvirt
default network DHCP:
2018-10-24 15:36:14,370+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-24
15:36:13.196641', u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:3d:13:d8 | awk '{ print $5 }' | cut -f1 -d'/'", 'failed':
False, u'delta': u'0:00:00.054641', u'stderr': u'', u'rc': 0, 'stdout_lines':
[], u'start': u'2018-10-24 15:36:13.142000'}
Can you please share the output of
virsh -r net-dhcp-leases default
Are you running nested on a different hypervisor?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 24 October 2018 08:44
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
Can you please retry installing
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_4.2_build-artifacts-el7-x86_64/157/artifact/exported-artifacts/ovirt-hosted-engine-setup-2.2.29-1.el7.noarch.rpm
and using it interactively without manually filing an answerfile?
On Tue, Oct 23, 2018 at 11:19 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
I attempted to use a fixed IP address instead of DHCP. I attach an attempt
using answer-file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
which is in accordance with this example on your website:
https://ovirt.org/develop/release-management/features/integration/heapplianceflow/
However, instead of this, you will notice that the log has:
OVEHOSTED_VM/cloudinitVMStaticCIDR=bool:'False'
The same error as usual occurred. Is this:
1. The wrong syntax\format for specifying a “cloudinitVMStaticCIDR” IP?
2. ovirt setup is ignoring it: either failing to assign the IP to the
engine VM or to variable “local_vm_ip.stdout_lines”?
3. Something else?
“You can also connect to that VM with VNC to check what's going on.” – Doesn’t
work. Port querying 10.0.0.109 on 5800\5900 fails, so I don’t think the VM is
networked. Which port does engine VNC use?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 23 October 2018 09:09
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is not
being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
I accidentally ran this using DHCP, which I know is problematic on my network.
I had previously run it using answer file parameter:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:
The same error occurred last time, but I’ll do so again and resend the full log.
Many thanks,
Brendan
From: Simone Tiraboschi
Sent: 23 October 2018 09:09
To: B Holmes
Cc: users
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
OK,
according to this log file, the target engine VM didn't got an IPv4 address:
2018-10-22 21:22:23,360+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
engine_vm_ip_vdsm:
2018-10-22 21:22:24,062+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Fail if the Engine has no IP address]
2018-10-22 21:22:24,763+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
{u'msg': u'Engine VM has no IP address. Please check your network
configuration', u'changed': False, u'_ansible_no_log': False}
2018-10-22 21:22:24,863+0100 ERROR
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:98
fatal: [localhost]: FAILED! => {"changed": false, "msg": "Engine VM has no IP
address. Please check your network configuration"}
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:180
ansible-playbook rc: 2
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
PLAY RECAP [localhost] : ok: 82 changed: 31 unreachable: 0 skipped: 5 failed: 2
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
PLAY RECAP [ovirt-engine.example.com <http://ovirt-engine.example.com> ] : ok:
11 changed: 6 unreachable: 0 skipped: 0 failed: 0
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:187
ansible-playbook stdout:
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 to
retry, use: --limit
@/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.retry
2018-10-22 21:22:25,365+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190
ansible-playbook stderr:
2018-10-22 21:22:25,366+0100 DEBUG otopi.context context._executeMethod:143
method exception
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in
_executeMethod
method['method']()
File
"/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/gr-he-ansiblesetup/core/target_vm.py",
line 214, in _closeup
r = ah.run()
File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_setup/ansible_utils.py",
line 194, in run
raise RuntimeError(_('Failed executing ansible-playbook'))
RuntimeError: Failed executing ansible-playbook
2018-10-22 21:22:25,367+0100 ERROR otopi.context context._executeMethod:152
Failed to execute stage 'Closing up': Failed executing ansible-playbook
Are you sure that your DHCP server is properly working?
You can also connect to that VM with VNC to check what's going on.
On Mon, Oct 22, 2018 at 10:37 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Pls see attached the log without any of my variable-enumeration changes.
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 22 October 2018 13:33
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is not
being populated.
Hi,
according to your log file the deployment was successful:
at this point I can only suggest again to simply run the vanilla code without
any custom patch.
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\nchanged_when: True\n -
name: Clean /etc/hosts on the host\n^ here\n"}
I think that this is just an error in the clean up on
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
I had exactly the same error in the run prior, which is why I added simple
non-function-changing debug code. I’ll send you the log from a run without
this. It won’t be any different except won’t contain some extra info.
Many thanks,
Brendan
From: Simone Tiraboschi
Sent: 22 October 2018 13:33
To: B Holmes
Cc: users
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Sun, Oct 21, 2018 at 11:50 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Sorry for late response, I’ve been unwell. Attached is the whole log you
requested. I hope it reveals why variable “local_vm_ip.stdout_lines” is not
being populated.
Hi,
according to your log file the deployment was successful:
2018-10-14 13:06:36,316+0100 INFO otopi.plugins.gr_he_common.core.misc
misc._terminate:250 Hosted Engine successfully deployed
But from the logs I see that you introduced custom ansible tasks and you also
removed relevant code parts:
2018-10-14 13:04:31,778+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [Copy local VM disk to shared storage]
2018-10-14 13:04:59,019+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 changed: [localhost]
2018-10-14 13:04:59,721+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [pause]
2018-10-14 13:05:00,422+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:01,124+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
TASK [debug]
2018-10-14 13:05:01,725+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-14
12:58:22.193727', u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut -f1 -d'/'", 'failed':
False, u'delta': u'0:00:00.069294', u'stderr': u'', u'rc': 0, 'stdout_lines':
[], u'start': u'2018-10-14 12:58:22.124433'}
2018-10-14 13:05:02,426+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
TASK [debug]
2018-10-14 13:05:03,127+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip.stdout_lines[0]: VARIABLE IS NOT DEFINED!
2018-10-14 13:05:03,828+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of
local_vm_ip.stdout_lines[0]]
2018-10-14 13:05:04,530+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:05,231+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 TASK [write value of FQDN]
2018-10-14 13:05:05,832+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:100 ok: [localhost]
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:180
ansible-playbook rc: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
PLAY RECAP [localhost] : ok: 89 changed: 24 unreachable: 0 skipped: 3 failed: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
PLAY RECAP [ovirt-engine.example.com <http://ovirt-engine.example.com> ] : ok:
11 changed: 6 unreachable: 0 skipped: 0 failed: 0
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:187
ansible-playbook stdout:
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 [pause]
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:189 Pausing
because next block will fail miserably:
2018-10-14 13:05:06,434+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:190
ansible-playbook stderr:
2018-10-14 13:05:06,435+0100 ERROR
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils.run:192 [WARNING]:
Not waiting for response to prompt as stdin is not interactive
at this point I can only suggest again to simply run the vanilla code without
any custom patch.
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 15 October 2018 04:49
On Sun, Oct 14, 2018 at 6:08 AM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere i
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
Here is the value of local_vm_ip during the bootstrap VM phase:
TASK [Create local VM]
TASK [Get local VM IP]:
2018-10-14 11:50:40,831+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-14
11:50:39.860036', u'stdout': u'192.168.124.16', u'cmd': u"virsh -r
net-dhcp-leases default | grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut
-f1 -d'/'", 'failed': False, 'attempts': 2, u'stderr': u'', u'rc': 0, u'delta':
u'0:00:00.058237', 'stdout_lines': [u'192.168.124.16'], u'start': u'2018-10-14
11:50:39.801799'}
And this is its value at the moment the setup crashes (at the usual place –
“Clean /etc/hosts on the host”):
2018-10-14 12:58:23,373+0100 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94
local_vm_ip: {'stderr_lines': [], u'changed': True, u'end': u'2018-10-14
12:58:22.193727', u'stdout': u'', u'cmd': u"virsh -r net-dhcp-leases default |
grep -i 00:16:3e:31:d3:9e | awk '{ print $5 }' | cut -f1 -d'/'", 'failed':
False, u'delta': u'0:00:00.069294', u'stderr': u'', u'rc': 0, 'stdout_lines':
[], u'start': u'2018-10-14 12:58:22.124433'}
stdout_lines has disappeared.
After the error, I ran command:
[root@host04 ansible]# virsh -r net-dhcp-leases default
Expiry Time MAC addressProtocol IP address
HostnameClient ID or DUID
---
[root@host04 ansible]#
Is the problem that I have assigned a static IP (using cloudinitVMStaticCIDR),
yet the command ansible is running to obtain the IP address (virsh -r
net-dhcp-leases) is only getting IPs obtained by DHCP, not static? Perhaps the
bootstrap VM always obtains an DHCP IP on the natted network, so this command
works at that earlier stage. Your documentation doesn’t mention a net-xxx
command to obtain a list of static IPs.
Not sure if its helpful but here’s the output of a net-dumpxml command:
[root@host04 ansible]# virsh -r net-dumpxml default
default
91fe2eee-c36e-4d08-9928-bff2d036aca5
[root@host04 ansible]#
Many thanks,
Brendan
From: Brendan Holmes
Sent: 13 October 2018 23:09
To: 'Simone Tiraboschi'
Cc: 'users'
Subject: RE: [ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
“restart from scratch deploying with a static IP”. Okay, I have reinstalled
the host using oVirt Node from scratch. I am assigning a static IP using the
attached answers.conf which contains:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
create_target_vm.yml and all other RedHat code is as-shipped. I’m getting the
same error:
[ INFO ] TASK [Copy /etc/hosts back to the Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\nchanged_when: True\n -
name: Clean /etc/hosts on the host\n^ here\n"}
Any ideas? How can I debug this failure to assign an IP (undefined variable)?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 10 October 2018 12:06
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be
assigned.
However perhaps DHCP is not working. I have just changed to a static IP
instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite
possible engine’s DHCP has been failing too. Each time the host boots, I must
type dhclient in order to receive an IP address. Anyway, after changing this
and re-running hosted-engine –deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc
ho
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
“restart from scratch deploying with a static IP”. Okay, I have reinstalled
the host using oVirt Node from scratch. I am assigning a static IP using the
attached answers.conf which contains:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
create_target_vm.yml and all other RedHat code is as-shipped. I’m getting the
same error:
[ INFO ] TASK [Copy /etc/hosts back to the Hosted Engine VM]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\nchanged_when: True\n -
name: Clean /etc/hosts on the host\n^ here\n"}
Any ideas? How can I debug this failure to assign an IP (undefined variable)?
Many thanks,
Brendan
From: Simone Tiraboschi mailto:stira...@redhat.com> >
Sent: 10 October 2018 12:06
To: B Holmes mailto:m...@brendanh.com> >
Cc: users mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 11:50 PM Brendan Holmes mailto:m...@brendanh.com> > wrote:
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be
assigned.
However perhaps DHCP is not working. I have just changed to a static IP
instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24 <http://10.0.0.109/24>
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite
possible engine’s DHCP has been failing too. Each time the host boots, I must
type dhclient in order to receive an IP address. Anyway, after changing this
and re-running hosted-engine –deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc
hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 400,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\ndebug: var=FQDN\n - name:
Clean /etc/hosts on the host\n^ here\n"}
I have just tried deploying using the webui, same error. I suspect the
“undefined variable” is local_vm_ip.std_out_lines[0]. My new debug task that
tries to output this is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest the
value of this is localhost. Localhost is just the machine this task ran on. I
don’t think list local_vm_ip.std_out_lines is defined. Any more ideas?
The issue is on a task that isn't part of the code we are shipping.
I can just suggest to simply reinstall the rpm to get rid of any modification
and restart from scratch deploying with a static IP if your DHCP server is not
properly working.
Many thanks
From: Simone Tiraboschi < <mailto:stira...@redhat.com> stira...@redhat.com>
Sent: 09 October 2018 16:51
To: B Holmes < <mailto:m...@brendanh.com> m...@brendanh.com>
Cc: users < <mailto:users@ovirt.org> users@ovirt.org>
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM mailto:m...@brendanh.com> >
wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com <http://ovirt-engine.example.com> 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you are
using on the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on
10.0.0.171). I trust this is correct and I should not resolve to a natted IP
instead. I notice that regardless of this record, the name
ovirt-engine.example.com <http://ovirt-engine.example.com> resolves to a
natted IP: 192.168.124.51 because the ansible script adds an ent
[ovirt-users] Re: Diary of hosted engine install woes
Hi Simone,
Yes the MAC address in answers.conf: OVEHOSTED_VM/vmMACAddr=
is added as a reservation to the DHCP server, so in theory 10.0.0.109 should be
assigned.
However perhaps DHCP is not working. I have just changed to a static IP
instead:
OVEHOSTED_VM/cloudinitVMStaticCIDR=str:10.0.0.109/24
(let me know if this isn’t the correct way)
My host fails to get an IP automatically from this DHCP server, so it is quite
possible engine’s DHCP has been failing too. Each time the host boots, I must
type dhclient in order to receive an IP address. Anyway, after changing this
and re-running hosted-engine –deploy, failed due to:
[ INFO ] TASK [Copy local VM disk to shared storage]
[ INFO ] changed: [localhost]
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc
hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 400,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\ndebug: var=FQDN\n - name:
Clean /etc/hosts on the host\n^ here\n"}
I have just tried deploying using the webui, same error. I suspect the
“undefined variable” is local_vm_ip.std_out_lines[0]. My new debug task that
tries to output this is:
- name: show local_vm_ip.std_out_lines[0] that will be written to etc hosts
debug: var=local_vm_ip.stdout_lines[0]
You can see the output of this above. I think I was mistaken to suggest the
value of this is localhost. Localhost is just the machine this task ran on. I
don’t think list local_vm_ip.std_out_lines is defined. Any more ideas?
Many thanks
From: Simone Tiraboschi
Sent: 09 October 2018 16:51
To: B Holmes
Cc: users
Subject: Re: [ovirt-users] Re: Diary of hosted engine install woes
On Tue, Oct 9, 2018 at 4:54 PM mailto:m...@brendanh.com> >
wrote:
I'ved added a record to the DNS server here:
ovirt-engine.example.com 10.0.0.109
OK, and how the engine VM will get that address?
Are you using DHCP? do you have a DHCP reservation for the MAC address you are
using on the engine VM?
Are you configuring it with a static IP?
This IP address is on the physical network that the host is on (host is on
10.0.0.171). I trust this is correct and I should not resolve to a natted IP
instead. I notice that regardless of this record, the name
ovirt-engine.example.com resolves to a
natted IP: 192.168.124.51 because the ansible script adds an entry to
/etc/hosts:
192.168.124.51 ovirt-engine.example.com
While the script is running, if I I can successfully ping
ovirt-engine.example.com , it responds on
192.168.124.51. So as you say: "host can correctly resolve the name of the
engine VM", but it's not the DNS record's IP. If I remove the DNS record and
run hosted-engine --deploy, I get error:
[ ERROR ] Host name is not valid: ovirt-engine.example.com
did not resolve into an IP address
Anyway, I added back the DNS record and ran hosted-engine --deploy command, it
failed at:
[ INFO ] TASK [Clean /etc/hosts on the host]
[ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option
with an undefined variable. The error was: list object has no element 0\n\nThe
error appears to have been in
'/usr/share/ovirt-hosted-engine-setup/ansible/create_target_vm.yml': line 396,
column 5, but may\nbe elsewhere in the file depending on the exact syntax
problem.\n\nThe offending line appears to be:\n\nchanged_when: True\n -
name: Clean /etc/hosts on the host\n^ here\n"}
To debug, I added tasks to create_target_vm.yml that output the values of
local_vm_ip.std_out_lines[0] and FQDN that are used in this task, then ran the
usual deploy command again. They are both localhost:
[ INFO ] TASK [show local_vm_ip.std_out_lines[0] that will be written to etc
hosts]
[ INFO ] ok: [localhost]
[ INFO ] TASK [show FQDN]
[ INFO ] ok: [localhost]
This time, it gets past [Clean /etc/hosts on the host], but hangs at [ INFO ]
TASK [Check engine VM health] same as before.
This is fine, the bootstrap local VM runs over a natted network then, once
ready it will be shutdown and moved to the shared storage. At that point it
will be restarted on your management network.
I catted /etc/hosts while it was hanging and it contains:
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
The
[ovirt-users] Re: Unknown CPU model Broadwell-IBRS-SSBD
Bug created (including hosted engine setup logs): https://bugzilla.redhat.com/show_bug.cgi?id=1622240 Many thanks Michal. -Original Message- From: Michal Skrivanek > On 24 Aug 2018, at 14:16, Brendan Holmes wrote: > > Hi, > > Sorry if I overlooked, but was a bug raised for this that I can track? AFAIK no. Please file one, and try to describe the steps you made with as many details as possible please And install logs ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/P3Q2QADCANXF6TZDUAHL2VWUBSWLXVSA/
[ovirt-users] Re: Unknown CPU model Broadwell-IBRS-SSBD
Hi, Sorry if I overlooked, but was a bug raised for this that I can track? I should have included that this problem is occurring on v4.2.6 second release candidate. I use oVirt Node. Many thanks, Brendan -Original Message- From: Michal Skrivanek > On 19 Aug 2018, at 20:47, m...@brendanh.com wrote: > > Hi, > > I've just installed hosted-engine. It proceeds to near the end of the > Ansible script, then pauses at: > "TASK [Check engine VM health]" > then eventually errors: > "Engine VM is not running, please check vdsm logs. The VDSM logs have error: > "libvirtError: internal error: Unknown CPU model Broadwell-IBRS-SSBD” it shouldn’t be send like that. The CPU the VM is supposed to use should be “Broadwell,+spce-ctrl,+ssbd". Simone, how does it end up in configuration like above? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/FV2EW5F2KXOVY6GOBJWTN3INK4FWTYIZ/
