Hi Steven, You get this exception when Murano can't connect to the RabbitMQ used to communicate between engine and murano-agent on VM side. You need to configure connection to RabbitMQ twice, in regular way for oslo.messaging, and you need to configure connection to RabbitMQ in [rabbitmq] section.
Please, check RabbitMQ configuration in configuration file (section [rabbitmq]). I would explain below why do we have two places to configure connection to RabbitMQ. Murano uses RabbitMQ for communication between components, specifically between: * API & Engine * Engine & Agent One of the recommended way of OpenStack deployment with Murano is to use two RabbitMQ installations: * OS Rabbit: used by OpenStack & Murano * Murano Rabbit: used only by Murano OS Rabbit is used by Murano for communication between API & Engine and it is same RabbitMQ instance that is used by rest of OpenStack components. Murano Rabbit is used by Murano for communication between Engine & Agent. Murano Rabbit is isolated from the management network, but accessible from VMs. This deployment model is recommended due to security reasons - VMs spawned by Murano with murano-agent enabled use RabbitMQ for communication, and if it's same RabbitMQ instance (with same credentials/vhost) as one used by OpenStack, user may affect/compromise OpenStack cloud itself. On Thu, Feb 5, 2015 at 4:46 AM, Tran, Steven <steven.tr...@hp.com> wrote: > Hi, > > Has anyone seen this exception in the recent revision? I just get the > latest today. > > murano-engine outputs this exception when I deploy an environment. It > fails to create a VM. > > I wonder if it’s my environment or a murano defect. > > > > > > {"packages": [{"class_definitions": ["io.murano.Environment", > "io.murano.resources.Network", "io.murano.Application", > "io.murano.resources.WindowsInstance", > "io.murano.resources.HeatSWConfigInstance", > "io.murano.system.StatusReporter", "io.murano.resources.LinuxInstance", > "io.murano.system.AgentListener", "io.murano.resources.NeutronNetwork", > "io.murano.resources.LinuxMuranoInstance", > "io.murano.resources.HeatSWConfigLinuxInstance", > "io.murano.system.NetworkExplorer", "io.murano.system.Agent", > "io.murano.SharedIp", "io.murano.system.HeatStack", > "io.murano.system.InstanceNotifier", "io.murano.resources.Instance", > "io.murano.system.SecurityGroupManager", "io.murano.StackTrace", > "io.murano.Object", "io.murano.Exception", > "io.murano.resources.LinuxUDInstance", "io.murano.system.Resources"], > "description": "Core MuranoPL library\n", "tags": ["MuranoPL"], "updated": > "2015-02-04T23:03:03", "is_public": true, "categories": [], "name": "Core > library", "author": "murano.io", "created": "2015-02-04T23:03:03", > "enabled": true, "id": "5ebdb96fc6f542dca9a1af766ddbfa94", "supplier": {}, > "fully_qualified_name": "io.murano", "type": "Library", "owner_id": ""}]} > > log_http_response > /opt/stack/python-muranoclient/muranoclient/common/http.py:124 > > 2015-02-04 17:37:50.950 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: Begin execution: > io.murano.system.Resources.string (-7559542279869778927) called from File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml", > line 98:28 in method deploy of class io.murano.resources.Instance > > $.prepareUserData() _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > 2015-02-04 17:37:50.950 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.system.Resources.string (-7559542279869778927) > _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:50.952 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: Begin execution: > io.murano.system.Resources.string (-7559542279869778927) called from File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml", > line 98:28 in method deploy of class io.murano.resources.Instance > > $.prepareUserData() _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > 2015-02-04 17:37:50.952 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.system.Resources.string (-7559542279869778927) > _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:50.953 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: Begin execution: > io.murano.system.AgentListener.queueName (8227276669045428973) called from > File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml", > line 98:28 in method deploy of class io.murano.resources.Instance > > $.prepareUserData() _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > 2015-02-04 17:37:50.953 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.system.AgentListener.queueName (8227276669045428973) > _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:50.954 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: Begin execution: > io.murano.system.Agent.queueName (-5211629396053631386) called from File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml", > line 98:28 in method deploy of class io.murano.resources.Instance > > $.prepareUserData() _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > 2015-02-04 17:37:50.954 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.system.Agent.queueName (-5211629396053631386) > _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:50.956 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.resources.LinuxMuranoInstance.prepareUserData > (-6721861659645843611) _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:50.957 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: Begin execution: > io.murano.system.Agent.prepare (-5222445134521330586) called from File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano.apps.linux.Telnet/Classes/telnet.yaml", > line 32:9 in method deploy of class io.murano.apps.linux.Telnet > > $.instance.deploy() _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > Traceback (most recent call last): > > File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line > 115, in wait > > listener.cb(fileno) > > File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", > line 214, in main > > result = function(*args, **kwargs) > > File "/opt/stack/murano/murano/dsl/executor.py", line 179, in > _invoke_method_implementation_gt > > return body(this, **params) > > File "/opt/stack/murano/murano/engine/system/agent.py", line 68, in > prepare > > with common.create_rmq_client() as client: > > File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 52, in > __enter__ > > self.connect() > > File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 60, in > connect > > self._connection.connect() > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 237, in connect > > return self.connection > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 741, in connection > > self._connection = self._establish_connection() > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 696, in _establish_connection > > conn = self.transport.establish_connection() > > File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", > line 112, in establish_connection > > conn = self.Connection(**opts) > > File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line > 180, in __init__ > > (10, 30), # tune > > File "/usr/local/lib/python2.7/dist-packages/amqp/abstract_channel.py", > line 67, in wait > > self.channel_id, allowed_methods) > > File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line > 240, in _wait_method > > self.method_reader.read_method() > > File "/usr/local/lib/python2.7/dist-packages/amqp/method_framing.py", line > 189, in read_method > > raise m > > MuranoPlException: [exceptions.IOError]: Socket closed > > Removing descriptor: 7 > > 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.system.Agent.prepare (-5222445134521330586) with exception > [exceptions.IOError]: Socket closed _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:156 > > 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.resources.Instance.deploy (-6771477997220427611) with exception > [exceptions.IOError]: Socket closed _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:156 > > 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-] > cad324b38b064c6a92f8bdf55b01ce37: End execution: > io.murano.apps.linux.Telnet.deploy (-3331993352887903899) with exception > [exceptions.IOError]: Socket closed _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:156 > > 2015-02-04 17:37:54.045 28689 DEBUG murano.dsl.executor [-] > 2d99ec6cb8744a418321010e0155d1be: Begin execution: > io.murano.system.AgentListener.stop (8219708049029306173) called from File > <unknown> in method None > > None _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:142 > > 2015-02-04 17:37:54.045 28689 DEBUG murano.dsl.executor [-] > 2d99ec6cb8744a418321010e0155d1be: End execution: > io.murano.system.AgentListener.stop (8219708049029306173) > _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160 > > 2015-02-04 17:37:54.046 28689 DEBUG murano.dsl.executor [-] > 2d99ec6cb8744a418321010e0155d1be: End execution: > io.murano.Environment.deploy (2363767013075233465) with exception > [exceptions.IOError]: Socket closed _invoke_method_implementation > /opt/stack/murano/murano/dsl/executor.py:156 > > 2015-02-04 17:37:54.046 28689 ERROR murano.common.engine [-] > > exceptions.IOError: Socket closed > > Traceback (most recent call last): > > File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/Environment.yaml", > line 68:13 in method deploy of class io.murano.Environment > > $.applications.pselect($.deploy()) > > File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano.apps.linux.Telnet/Classes/telnet.yaml", > line 32:9 in method deploy of class io.murano.apps.linux.Telnet > > $.instance.deploy() > > File > "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml", > line 102:9 in method deploy of class io.murano.resources.Instance > > $.agent.prepare() > > File "/opt/stack/murano/murano/engine/system/agent.py", line 68 in > method prepare > > with common.create_rmq_client() as client: > > File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 52 in > method __enter__ > > self.connect() > > File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 60 in > method connect > > self._connection.connect() > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 237 in method connect > > return self.connection > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 741 in method connection > > self._connection = self._establish_connection() > > File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line > 696 in method _establish_connection > > conn = self.transport.establish_connection() > > File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", > line 112 in method establish_connection > > conn = self.Connection(**opts) > > File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line > 180 in method __init__ > > (10, 30), # tune > > File "/usr/local/lib/python2.7/dist-packages/amqp/abstract_channel.py", > line 67 in method wait > > self.channel_id, allowed_methods) > > File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line > 240 in method _wait_method > > self.method_reader.read_method() > > File "/usr/local/lib/python2.7/dist-packages/amqp/method_framing.py", > line 189 in method read_method > > raise m > > 2015-02-04 17:37:54.047 28689 DEBUG oslo_messaging._drivers.amqp [-] > UNIQUE_ID is 7e43279a013a441eb58a9df6580988ab. _add_unique_id > /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:224 > > 2015-02-04 17:37:54.059 28689 DEBUG oslo_messaging._drivers.amqpdriver [-] > MSG_ID is a6138cbd1245497eaf768f9ba2eb6bf1 _send > /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:378 > > 2015-02-04 17:37:54.060 28689 DEBUG oslo_messaging._drivers.amqp [-] Pool > creating new connection create > /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:68 > > 2015-02-04 17:37:54.060 28689 INFO oslo_messaging._drivers.impl_rabbit [-] > Connecting to AMQP server on 192.168.178.18:5672 > > 2015-02-04 17:37:54.071 28689 INFO oslo_messaging._drivers.impl_rabbit [-] > Connected to AMQP server on 192.168.178.18:5672 > > 2015-02-04 17:37:54.074 28689 DEBUG oslo_messaging._drivers.amqp [-] > UNIQUE_ID is 9edaec379ef24689a77772247baf951c. _add_unique_id > /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:224 > > 2015-02-04 17:37:54.074 28689 DEBUG oslo_messaging._drivers.amqp [-] Pool > creating new connection create > /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:68 > > 2015-02-04 17:37:54.075 28689 INFO oslo_messaging._drivers.impl_rabbit [-] > Connecting to AMQP server on 192.168.178.18:5672 > > 2015-02-04 17:37:54.090 28689 INFO oslo_messaging._drivers.impl_rabbit [-] > Connected to AMQP server on 192.168.178.18:5672 > > > > Thanks, > > -Steven > > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > -- Serg Melikyan, Senior Software Engineer at Mirantis, Inc. http://mirantis.com | smelik...@mirantis.com +7 (495) 640-4904, 0261 +7 (903) 156-0836 __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev