Re: [openstack-dev] [Murano] How to debug a failed deployment?
Vahid, The bug you mentioned was fixed recently: https://review.openstack.org/#/c/255154/ Sincerely yours, Stan Lagun Principal Software Engineer @ Mirantis On Fri, Dec 11, 2015 at 10:46 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Nikolay, > > Is there further information I could provide about the bug? > > Thanks. > --Vahid > > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Nikolay, Is there further information I could provide about the bug? Thanks. --Vahid __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Vahid, Thanks for feedback. We need additional proof that this bug doesn't block engine or deployments. Nikolay Starodubtsev Software Engineer Mirantis Inc. Skype: dark_harlequine1 2015-12-09 3:33 GMT+03:00 Vahid S Hashemian : > Hi Kate, > > You were right. The bug I referred to does not block the engine. > So when I looked at the engine log, this is what I see after trying to > deploy an environment with the HOT package I attached in my earlier message: > http://paste.openstack.org/show/481260/ > > I looked up the error message and realized that the "Core library" package > was missing in my environment. > So I uploaded it and now the deployment seems to work fine. > > Thanks for your help. > > Regards, > --Vahid > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Kate, You were right. The bug I referred to does not block the engine. So when I looked at the engine log, this is what I see after trying to deploy an environment with the HOT package I attached in my earlier message: http://paste.openstack.org/show/481260/ I looked up the error message and realized that the "Core library" package was missing in my environment. So I uploaded it and now the deployment seems to work fine. Thanks for your help. Regards, --Vahid __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Vahid, looks like trace in bug should not block engine run, we are currently investigating it. If you are seeing that trace, then you are able to get engine logs :) Can you start your deployment and attach all engine logs even with the trace? Regards, Kate. On Tue, Dec 8, 2015 at 4:12 AM, Vahid S Hashemian wrote: > Hi Stan, > > Not sure how I can enable murano engine log. > > Anyway, you were right that murano engine was not running. > I started it and am now hitting this bug: > https://bugs.launchpad.net/murano/+bug/1521087 > > I guess I'll have to wait until the fix is released. > > Thanks. > > Regards, > --Vahid > > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Stan, Not sure how I can enable murano engine log. Anyway, you were right that murano engine was not running. I started it and am now hitting this bug: https://bugs.launchpad.net/murano/+bug/1521087 I guess I'll have to wait until the fix is released. Thanks. Regards, --Vahid __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Vahid, The main log file that is missing is murano-engine log. It is murano-engine who does the deployment. There are also no agent logs because agents are on VMs and none of them were created. >From what I see from you screenshots deployment task doesn't even reaches murano-engine. There can be 2 possible reasons for this: 1) murano-engine is not running 2) incorrect configuration of oslo.messaging. Murano API sends tasks to murano-engine through RabbitMQ using oslo.messaging library. Settings in your config file differ from those in mine. For example in my config file rabbit_host is in [DEFAULT] section while in yours it is in [oslo_messaging_rabbit]. Maybe it is okay and my config is outdated. Maybe you use newer version of oslo.messaging that has different config or it can be configured in several ways. I'm not sure. Sincerely yours, Stan Lagun Principal Software Engineer @ Mirantis On Fri, Dec 4, 2015 at 8:54 AM, Vahid S Hashemian wrote: > Dmytro, Kate, Stan, > > Thank you for your responses. I'll try to provide more information about > my environment and the deployment in this note. > Hopefully, this will give you some clue about what the issue is with my > setup. > >1. The murano config file I am using is at >http://paste.openstack.org/show/480855/ >2. The HOT package I am trying to deploy is attached >3. A sample of log entries I see in murano log is at >http://paste.openstack.org/show/480854/ >4. No heat stack is created at all. As I mentioned in my previous >message, it's as if murano cannot talk to heat. >5. Heat engine logs are at http://paste.openstack.org/show/480856/ >6. Heat API logs are at http://paste.openstack.org/show/480857/ >7. Some screen shots are also attached that show the status of >deployment more than 30 minutes after start. Existing heat stacks show that >the template by itself was deployed to heat without an issue. >8. I couldn't find murano agent logs. Please let me know where I can >find them and I'll provide those too. > > > > Regards, > --Vahid > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Vahid, The only reason HOT deployment could last forever is that Heat stack never enters Ready of Failed state. Please check what is the Heat stack status. I guess it is not Murano issue (except for the fact that we don't provide timeout for HOT deployment :) ) Sincerely yours, Stan Lagun Principal Software Engineer @ Mirantis On Thu, Dec 3, 2015 at 11:54 AM, Ekaterina Chernova wrote: > Hi! > > Murano agent doesn't involved in the deployment of hot packages, that's > why this setting doesn't help. > > Please attach agent logs and heat logs also (check if heat stack is > created or not). > > Regards, Kate. > > > Regards, > Kate. > > > On Thu, Dec 3, 2015 at 11:44 AM, Dmytro Dovbii > wrote: > >> Hi Vahid, >> >> Could you provide your logs anyway? Please publish them to >> http://paste.openstack.org/ for example >> >> 2015-12-02 23:08 GMT+02:00 Vahid S Hashemian : >> >>> Hello, >>> >>> I am trying to deploy a hello world HOT package in murano but the >>> deployment runs forever and does not stop (does not succeed or fail). >>> Stan advised me to modify the config setting below to set a timeout: >>> >>> # Time for waiting for a response from murano agent during the >>> # deployment (integer value) >>> agent_timeout = 300 >>> >>> As you see I set the timeout to 300 seconds and restarted murano API, >>> but even after 15 minutes my deployment is still going. >>> I think my environment is not configured correctly for this to happen. >>> >>> I have devstack running on a VM, and my murano development is done on a >>> separate VM. >>> I bring up murano API and UI on my dev VM that successfully connect to >>> my devstack VM. >>> >>> I am able to deploy the HOT yaml using heat without an issue. >>> From what I can see it seems that murano is not able to talk to heat, >>> because I don't see any stack being created as a result of my deployment. >>> >>> I have also enabled murano logging in the config file as below: >>> >>> # (Optional) Name of log file to output to. If no default is set, >>> # logging will go to stdout. (string value) >>> # Deprecated group/name - [DEFAULT]/logfile >>> log_file = /opt/stack/logs/murano.log >>> >>> But no error is reported while the deployment is in progress. >>> >>> Any tips on how to force the timeout, and also on how to resolve the >>> deployment problem is appreciated. >>> >>> Regards, >>> --Vahid >>> >>> >>> __ >>> OpenStack Development Mailing List (not for usage questions) >>> Unsubscribe: >>> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >>> >>> >> >> __ >> OpenStack Development Mailing List (not for usage questions) >> Unsubscribe: >> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >> >> > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi! Murano agent doesn't involved in the deployment of hot packages, that's why this setting doesn't help. Please attach agent logs and heat logs also (check if heat stack is created or not). Regards, Kate. Regards, Kate. On Thu, Dec 3, 2015 at 11:44 AM, Dmytro Dovbii wrote: > Hi Vahid, > > Could you provide your logs anyway? Please publish them to > http://paste.openstack.org/ for example > > 2015-12-02 23:08 GMT+02:00 Vahid S Hashemian : > >> Hello, >> >> I am trying to deploy a hello world HOT package in murano but the >> deployment runs forever and does not stop (does not succeed or fail). >> Stan advised me to modify the config setting below to set a timeout: >> >> # Time for waiting for a response from murano agent during the >> # deployment (integer value) >> agent_timeout = 300 >> >> As you see I set the timeout to 300 seconds and restarted murano API, but >> even after 15 minutes my deployment is still going. >> I think my environment is not configured correctly for this to happen. >> >> I have devstack running on a VM, and my murano development is done on a >> separate VM. >> I bring up murano API and UI on my dev VM that successfully connect to my >> devstack VM. >> >> I am able to deploy the HOT yaml using heat without an issue. >> From what I can see it seems that murano is not able to talk to heat, >> because I don't see any stack being created as a result of my deployment. >> >> I have also enabled murano logging in the config file as below: >> >> # (Optional) Name of log file to output to. If no default is set, >> # logging will go to stdout. (string value) >> # Deprecated group/name - [DEFAULT]/logfile >> log_file = /opt/stack/logs/murano.log >> >> But no error is reported while the deployment is in progress. >> >> Any tips on how to force the timeout, and also on how to resolve the >> deployment problem is appreciated. >> >> Regards, >> --Vahid >> >> __ >> OpenStack Development Mailing List (not for usage questions) >> Unsubscribe: >> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >> >> > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] How to debug a failed deployment?
Hi Vahid, Could you provide your logs anyway? Please publish them to http://paste.openstack.org/ for example 2015-12-02 23:08 GMT+02:00 Vahid S Hashemian : > Hello, > > I am trying to deploy a hello world HOT package in murano but the > deployment runs forever and does not stop (does not succeed or fail). > Stan advised me to modify the config setting below to set a timeout: > > # Time for waiting for a response from murano agent during the > # deployment (integer value) > agent_timeout = 300 > > As you see I set the timeout to 300 seconds and restarted murano API, but > even after 15 minutes my deployment is still going. > I think my environment is not configured correctly for this to happen. > > I have devstack running on a VM, and my murano development is done on a > separate VM. > I bring up murano API and UI on my dev VM that successfully connect to my > devstack VM. > > I am able to deploy the HOT yaml using heat without an issue. > From what I can see it seems that murano is not able to talk to heat, > because I don't see any stack being created as a result of my deployment. > > I have also enabled murano logging in the config file as below: > > # (Optional) Name of log file to output to. If no default is set, > # logging will go to stdout. (string value) > # Deprecated group/name - [DEFAULT]/logfile > log_file = /opt/stack/logs/murano.log > > But no error is reported while the deployment is in progress. > > Any tips on how to force the timeout, and also on how to resolve the > deployment problem is appreciated. > > Regards, > --Vahid > > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Murano] How to debug a failed deployment?
Hello, I am trying to deploy a hello world HOT package in murano but the deployment runs forever and does not stop (does not succeed or fail). Stan advised me to modify the config setting below to set a timeout: # Time for waiting for a response from murano agent during the # deployment (integer value) agent_timeout = 300 As you see I set the timeout to 300 seconds and restarted murano API, but even after 15 minutes my deployment is still going. I think my environment is not configured correctly for this to happen. I have devstack running on a VM, and my murano development is done on a separate VM. I bring up murano API and UI on my dev VM that successfully connect to my devstack VM. I am able to deploy the HOT yaml using heat without an issue. >From what I can see it seems that murano is not able to talk to heat, because I don't see any stack being created as a result of my deployment. I have also enabled murano logging in the config file as below: # (Optional) Name of log file to output to. If no default is set, # logging will go to stdout. (string value) # Deprecated group/name - [DEFAULT]/logfile log_file = /opt/stack/logs/murano.log But no error is reported while the deployment is in progress. Any tips on how to force the timeout, and also on how to resolve the deployment problem is appreciated. Regards, --Vahid __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
