Re: [rdo-dev] Heat problem with containerised undercloud

[Adam Huffman]

HI Alex,

I finally found the parameter for this, which is NeutronPublicInterface.

However, it looks like os-net-config can't cope with alias interfaces
(which are all I have on this test node).

I did try with master, and there was a similar error with a config image
value missing.
Is it worthwhile reporting that?

Best Wishes,
Adam

On 12 April 2018 at 18:30, Alex Schultz  wrote:

> On Thu, Apr 12, 2018 at 10:32 AM, Adam Huffman
>  wrote:
> > The next failure appears to be because os-net-config is looking for the
> > non-existent eth1 interface:
> >
> > TASK [Output for NetworkDeployment]
> > fatal: [192.168.24.1]: FAILED! => {
> > "failed_when_result": true,
> > "msg": [
> > {
> > "stderr": [
> > "[2018-04-12 17:27:17,906] (heat-config) [DEBUG] Running
> > /usr/libexec/heat-config/hooks/script <
> > /var/lib/heat-config/deployed/676fe26a-bbc0-4ba2-9733-
> 42afaf90f3c9.json",
> > "[2018-04-12 17:27:18,443] (heat-config) [INFO]
> > {\"deploy_stdout\": \"\", \"deploy_stderr\": \"+ '[' -n
> > '{\\\"network_config\\\": [{\\\"addresses\\\": [{\\\"ip_netmask\\\":
> > \\\"192.168.24.1/24\\\"}], \\\"dns_servers\\\": [], \\\"members\\\":
> > [{\\\"name\\\": \\\"interface_name\\\", \\\"primary\\\": true,
> \\\"type\\\":
> > \\\"interface\\\"}], \\\"name\\\": \\\"br-ctlplane\\\", \\\"type\\\":
> > \\\"ovs_bridge\\\", \\\"use_dhcp\\\": false}]}' ']'\\n+ '[' -z True
> ']'\\n+
> > mkdir -p /etc/os-net-config\\n+ echo '{\\\"network_config\\\":
> > [{\\\"addresses\\\": [{\\\"ip_netmask\\\": \\\"192.168.24.1/24\\\"}],
> > \\\"dns_servers\\\": [], \\\"members\\\": [{\\\"name\\\":
> > \\\"interface_name\\\", \\\"primary\\\": true, \\\"type\\\":
> > \\\"interface\\\"}], \\\"name\\\": \\\"br-ctlplane\\\", \\\"type\\\":
> > \\\"ovs_bridge\\\", \\\"use_dhcp\\\": false}]}'\\n++ type -t
> > network_config_hook\\n+ '[' '' = function ']'\\n+ sed -i
> > s/bridge_name/br-ex/ /etc/os-net-config/config.json\\n+ sed -i
> > s/interface_name/eth1/ /etc/os-net-config/config.json\\n+ set +e\\n+
> > os-net-config -c /etc/os-net-config/config.json -v
> > --detailed-exit-codes\\n[2018/04/12 05:27:18 PM] [INFO] Using config
> file
> > at: /etc/os-net-config/config.json\\n[2018/04/12 05:27:18 PM] [INFO]
> Ifcfg
> > net config provider created.\\n[2018/04/12 05:27:18 PM] [INFO] Not using
> any
> > mapping file.\\n[2018/04/12 05:27:18 PM] [INFO] Finding active
> > nics\\n[2018/04/12 05:27:18 PM] [INFO] lo is not an active
> nic\\n[2018/04/12
> > 05:27:18 PM] [INFO] em1 is an embedded active nic\\n[2018/04/12 05:27:18
> PM]
> > [INFO] docker0 is not an active nic\\n[2018/04/12 05:27:18 PM] [INFO] No
> > DPDK mapping available in path
> > (/var/lib/os-net-config/dpdk_mapping.yaml)\\n[2018/04/12 05:27:18 PM]
> [INFO]
> > Active nics are ['em1']\\n[2018/04/12 05:27:18 PM] [INFO] nic1 mapped to:
> > em1\\n[2018/04/12 05:27:18 PM] [INFO] adding bridge:
> > br-ctlplane\\n[2018/04/12 05:27:18 PM] [ERROR] Unable to read mac
> address:
> > eth1\\nTraceback (most recent call last):\\n  File
> > \\\"/bin/os-net-config\\\", line 10, in \\n
> sys.exit(main())\\n
> > File \\\"/usr/lib/python2.7/site-packages/os_net_config/cli.py\\\", line
> > 268, in main\\nprovider.add_object(obj)\\n  File
> > \\\"/usr/lib/python2.7/site-packages/os_net_config/__init__.py\\\",
> line 62,
> > in add_object\\nself.add_bridge(obj)\\n  File
> > \\\"/usr/lib/python2.7/site-packages/os_net_config/impl_ifcfg.py\\\",
> line
> > 506, in add_bridge\\ndata = self._add_common(bridge)\\n  File
> > \\\"/usr/lib/python2.7/site-packages/os_net_config/impl_ifcfg.py\\\",
> line
> > 215, in _add_common\\nmac =
> > utils.interface_mac(base_opt.primary_interface_name)\\n  File
> > \\\"/usr/lib/python2.7/site-packages/os_net_config/utils.py\\\", line
> 121,
> > in interface_mac\\nwith open('/sys/class/net/%s/address' % name,
> 'r') as
> > f:\\nIOError: [Errno 2] No such file or directory:
> > '/sys/class/net/eth1/address'\\n+ RETVAL=1\\n+ set -e\\n+ [[ 1 == 2
> ]]\\n+
> > [[ 1 != 0 ]]\\n+ echo 'ERROR: os-net-config configuration
> failed.'\\nERROR:
> > os-net-config configuration failed.\\n+ exit 1\\n\",
> \"deploy_status_code\":
> > 1}",
> >  "[2018-04-12 17:27:18,443] (heat-config) [DEBUG] [2018-04-12
> 17:27:17,929]
> > (heat-config) [INFO] disable_configure_safe_defaults=True",
> > "[2018-04-12 17:27:17,929] (heat-config) [INFO]
> > interface_name=eth1",
> > "[2018-04-12 17:27:17,929] (heat-config) [INFO]
> > bridge_name=br-ex",
> > "[2018-04-12 17:27:17,929] (heat-config) [INFO]
> > deploy_server_id=5afc73d4-5aec-42a9-a1ec-1035da9e164b",
> > "[2018-04-12 17:27:17,929] (heat-config) [INFO]
> > deploy_action=CREATE",
> > "[2018-04-12 17:27:17,930] (heat-config) [INFO]
> > deploy_stack_id=undercloud-Undercloud-jqksadcll2tk-0-wj6kdjy567yh-
> 

Re: [rdo-dev] Heat problem with containerised undercloud

[Alex Schultz]

So it should be noted that we're actively working on the containerized
undercloud deployment process for Rocky and you might want to try the
new way we will be going forward with. You can see the updated
documentation https://review.openstack.org/#/c/558893/. It's much
simpler than the existing docs.

That being said I think you're missing a step around the the container
prep part as  "Property DockerRabbitmqConfigImage not assigned"
usually means the docker information is not being passed during the
deployment.  This information is generated with the:

openstack overcloud container image prepare \
  --output-env-file $HOME/docker_registry.yaml


You then need to add -e $HOME/docker_registry.yaml to your deploy command.

Thanks,
-Alex

On Thu, Apr 12, 2018 at 7:29 AM, Adam Huffman
 wrote:
> Here's the more detailed log:
>
> 2018-04-12 14:25:24.769 2 INFO heat.engine.service
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Creating stack
> undercloud-UndercloudServiceChain-elou4xokwrep-ServiceChain-e6umma7beuwd
> 2018-04-12 14:25:26.368 2 INFO heat.engine.resource
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Validating
> TemplateResource "36"
> 2018-04-12 14:25:26.447 2 INFO heat.engine.resource
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] CREATE:
> ResourceChain "ServiceChain" Stack
> "undercloud-UndercloudServiceChain-elou4xokwrep"
> [3c27ccbf-8653-4519-ad95-79b469dde2e2]
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource Traceback (most
> recent call last):
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in
> _action_recorder
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource yield
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 1026, in
> _do_action
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource yield
> self.action_handler_task(action, args=handler_args)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 329, in
> wrapper
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource step =
> next(subtask)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 971, in
> action_handler_task
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource handler_data =
> handler(*args)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/openstack/heat/resource_chain.py",
> line 110, in handle_create
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource return
> self.create_with_template(self.child_template())
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 338, in create_with_template
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource
> kwargs['template_id'])
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in
> __exit__
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource
> self.force_reraise()
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in
> force_reraise
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource
> six.reraise(self.type_, self.value, self.tb)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 333, in create_with_template
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource **kwargs)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 301, in
> _create_stack
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource version='1.29')
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 88, in call
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource return
> client.call(ctxt, method, **kwargs)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 174,
> in call
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource
> retry=self.retry)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 131, in
> _send
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource
> timeout=timeout, retry=retry)
> 2018-04-12 14:25:26.447 2 ERROR heat.engine.resource   File
> 

Re: [rdo-dev] Heat problem with containerised undercloud

[Adam Huffman]

Thanks, a bit further now:

2018-04-12 13:25:23Z [undercloud.UndercloudServiceChain]:
CREATE_IN_PROGRESS  state changed
2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain]:
CREATE_IN_PROGRESS  Stack CREATE started
2018-04-12 13:25:24Z
[undercloud.UndercloudServiceChain.LoggingConfiguration]:
CREATE_IN_PROGRESS  state changed
2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain.ServiceChain]:
CREATE_IN_PROGRESS  state changed
2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain.ServiceChain]:
CREATE_FAILED  StackValidationFailed: resources.ServiceChain: Property
error: resources[36].properties: Property DockerRabbitmqConfigImage not
assigned
2018-04-12 13:25:26Z
[undercloud.UndercloudServiceChain.LoggingConfiguration]: CREATE_FAILED
CREATE aborted
2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
Resource CREATE failed: StackValidationFailed: resources.ServiceChain:
Property error: ServiceChain.resources[36].properties: Property
DockerRabbitmqConfigImage not assigned
2018-04-12 13:25:27Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
StackValidationFailed:
resources.UndercloudServiceChain.resources.ServiceChain: Property error:
ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
not assigned
2018-04-12 13:25:27Z [undercloud]: CREATE_FAILED  Resource CREATE failed:
StackValidationFailed:
resources.UndercloudServiceChain.resources.ServiceChain: Property error:
ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
not assigned
Exception: Stack create failed
['Traceback (most recent call last):\n', '  File
"/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
line 511, in take_action\nparsed_args.timeout)\n', '  File
"/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
line 346, in _wait_for_heat_complete\nraise Exception(\'Stack create
failed\')\n', 'Exception: Stack create failed\n']
ERROR: Heat log files: /var/tmp/undercloud/undercloud_deploy-KVv2ms



On 12 April 2018 at 13:56, Thomas Herve  wrote:

> On Thu, Apr 12, 2018 at 1:50 PM, Adam Huffman
>  wrote:
> > I've been following the guide at:
> >
> > http://tripleo.org/containers_deployment/undercloud.html
> >
> > to test a containerised deployment.
> >
> > Here's what I have installed:
> >
> > [stack@tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
> > python2-openstackclient openstack-heat-agents docker openvswitch
> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.
> el7.centos.noarch
> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
> > docker-1.13.1-53.git774336d.el7.centos.x86_64
> > openvswitch-2.9.0-3.el7.x86_64
> >
> > [stack@tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
> > python2-openstackclient openstack-heat-agents docker openvswitch
> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.
> el7.centos.noarch
> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
> > docker-1.13.1-53.git774336d.el7.centos.x86_64
> > openvswitch-2.9.0-3.el7.x86_64
> >
> > and here are the configured yum repos:
> >
> > repo id
> > repo name
> > status
> > base/7/x86_64
> > CentOS-7 - Base
> > dell-system-update_dependent/7/x86_64
> > dell-system-update_dependent
> > dell-system-update_independent
> > dell-system-update_independent
> > delorean-queens
> > delorean-openstack-kuryr-kubernetes-c394b695dfbf823de626276a610690
> 89ccdb0aca
> > delorean-queens-testing
> > dlrn-queens-testing
> > extras/7/x86_64
> > CentOS-7 - Extras
> > rdo-qemu-ev/x86_64
> > RDO CentOS-7 - QEMU EV
> > tripleo-centos-ceph-luminous
> > tripleo-centos-ceph-luminous
> > updates/7/x86_64
> > CentOS-7 - Updates
> >
> > Here's the attempted installation:
> >
> > export THT_ROOT=/usr/share/openstack-tripleo-heat-templates/
> > [stack@tripleo000 containers-2018-04-12]$ !40
> > sudo openstack undercloud deploy --templates=$THT_ROOT
> > --local-ip=192.168.24.1 --keep-running   -e
> > $THT_ROOT/environments/services-docker/ironic.yaml   -e
> > $THT_ROOT/environments/services-docker/mistral.yaml   -e
> > $THT_ROOT/environments/services-docker/zaqar.yaml   -e
> > $THT_ROOT/environments/docker.yaml   -e
> > $THT_ROOT/environments/mongodb-nojournal.yaml   -e
> > $HOME/src/containers-2018-04-12/custom.yaml
> >
> > Undercloud deploy is an experimental developer focused feature that does
> not
> > yet replace 'openstack undercloud install'.
> > Configuring puppet modules symlinks ...
> > Exception: list index out of range
> > ['Traceback (most recent call last):\n', '  File
> > "/usr/lib/python2.7/site-packages/tripleoclient/v1/
> undercloud_deploy.py",
> > line 502, in take_action\norchestration_client =
> > self._launch_heat(parsed_args)\n', '  File
> > 

Re: [rdo-dev] Heat problem with containerised undercloud

[Thomas Herve]

On Thu, Apr 12, 2018 at 1:50 PM, Adam Huffman
 wrote:
> I've been following the guide at:
>
> http://tripleo.org/containers_deployment/undercloud.html
>
> to test a containerised deployment.
>
> Here's what I have installed:
>
> [stack@tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
> python2-openstackclient openstack-heat-agents docker openvswitch
> python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
> python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.el7.centos.noarch
> openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
> docker-1.13.1-53.git774336d.el7.centos.x86_64
> openvswitch-2.9.0-3.el7.x86_64
>
> [stack@tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
> python2-openstackclient openstack-heat-agents docker openvswitch
> python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
> python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.el7.centos.noarch
> openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
> docker-1.13.1-53.git774336d.el7.centos.x86_64
> openvswitch-2.9.0-3.el7.x86_64
>
> and here are the configured yum repos:
>
> repo id
> repo name
> status
> base/7/x86_64
> CentOS-7 - Base
> dell-system-update_dependent/7/x86_64
> dell-system-update_dependent
> dell-system-update_independent
> dell-system-update_independent
> delorean-queens
> delorean-openstack-kuryr-kubernetes-c394b695dfbf823de626276a61069089ccdb0aca
> delorean-queens-testing
> dlrn-queens-testing
> extras/7/x86_64
> CentOS-7 - Extras
> rdo-qemu-ev/x86_64
> RDO CentOS-7 - QEMU EV
> tripleo-centos-ceph-luminous
> tripleo-centos-ceph-luminous
> updates/7/x86_64
> CentOS-7 - Updates
>
> Here's the attempted installation:
>
> export THT_ROOT=/usr/share/openstack-tripleo-heat-templates/
> [stack@tripleo000 containers-2018-04-12]$ !40
> sudo openstack undercloud deploy --templates=$THT_ROOT
> --local-ip=192.168.24.1 --keep-running   -e
> $THT_ROOT/environments/services-docker/ironic.yaml   -e
> $THT_ROOT/environments/services-docker/mistral.yaml   -e
> $THT_ROOT/environments/services-docker/zaqar.yaml   -e
> $THT_ROOT/environments/docker.yaml   -e
> $THT_ROOT/environments/mongodb-nojournal.yaml   -e
> $HOME/src/containers-2018-04-12/custom.yaml
>
> Undercloud deploy is an experimental developer focused feature that does not
> yet replace 'openstack undercloud install'.
> Configuring puppet modules symlinks ...
> Exception: list index out of range
> ['Traceback (most recent call last):\n', '  File
> "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
> line 502, in take_action\norchestration_client =
> self._launch_heat(parsed_args)\n', '  File
> "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
> line 187, in _launch_heat\nparsed_args.heat_user)\n', '  File
> "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line 306,
> in __init__\nuser)\n', '  File
> "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line 170,
> in __init__\nuid = int(self.get_heat_uid())\n', '  File
> "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line 318,
> in get_heat_uid\nreturn p.communicate()[0].rstrip().split(\':\')[2]\n',
> 'IndexError: list index out of range\n']
> 'DeployUndercloud' object has no attribute 'heat_launch'

Hi,

I think the guide is missing heat. You need to have it installed as
well prior to the deploy, that's probably what's missing (the
deployment is failing when doing getent passwd heat, it needs the heat
user).

-- 
Thomas
___
dev mailing list
dev@lists.rdoproject.org
http://lists.rdoproject.org/mailman/listinfo/dev

To unsubscribe: dev-unsubscr...@lists.rdoproject.org