Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-21 Thread Zane Bitter
community who have experience with this problem. cheers, Zane. John Davidge jodav...@cisco.com -- Forwarded message -- From: Thomas Spatzier Date: Wed, Oct 9, 2013 at 12:40 AM Subject: Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows To: OpenSta

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-18 Thread John Davidge -X (jodavidg - AAP3 INC at Cisco)
3 at 12:40 AM >Subject: Re: [openstack-dev] [Heat] HOT Software orchestration >proposal for workflows >To: OpenStack Development Mailing List > > >Excerpts from Clint Byrum's message > >> From: Clint Byrum >> To: openstack-dev , >> Date: 09.10.2013

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-14 Thread Lakshminaraya Renganarayana
Hi Angus, Thanks for detailed reply. I have a few comments that I have written below in the context. Angus Salkeld wrote on 10/13/2013 06:40:01 PM: > > > >- INPUTS: all the attributes that are consumed/used/read by that resource > >(currently, we have Ref, GetAttrs that can give this implicitl

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-14 Thread Thomas Spatzier
Steven Dake wrote on 11.10.2013 21:02:38: > From: Steven Dake > To: OpenStack Development Mailing List , > Date: 11.10.2013 21:04 > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > On 10/11/2013 11:55 AM, Lakshminaraya Renganarayana

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-13 Thread Angus Salkeld
ate: 10/11/2013 12:43 PM Subject: Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows Excerpts from Stan Lagun's message of 2013-10-11 07:22:37 -0700: > Hello, > > Thanks Angus, Clint, I've got your design. > > It seems that Murano can built on

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Stan Lagun
On Fri, Oct 11, 2013 at 8:40 PM, Clint Byrum wrote: > > 2. Ability to provide arbitrary input values for the config > We already have that, there's a free-form json document called "metadata" > attached to every resource. Or maybe I missed what you mean here. The > new capability that is in the

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Steven Dake
On 10/11/2013 11:55 AM, Lakshminaraya Renganarayana wrote: Clint Byrum wrote on 10/11/2013 12:40:19 PM: > From: Clint Byrum > To: openstack-dev > Date: 10/11/2013 12:43 PM > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > &

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Lakshminaraya Renganarayana
Clint Byrum wrote on 10/11/2013 12:40:19 PM: > From: Clint Byrum > To: openstack-dev > Date: 10/11/2013 12:43 PM > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > > 3. Ability to return arbitrary (JSON-compatible) da

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Lakshminaraya Renganarayana
3 PM > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > Excerpts from Stan Lagun's message of 2013-10-11 07:22:37 -0700: > > Hello, > > > > Thanks Angus, Clint, I've got your design. > > > > It seems that Mu

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Caitlin Bestler
On 10/9/2013 12:55 PM, Joshua Harlow wrote: Your example sounds a lot like what taskflow is build for doing. https://github.com/stackforge/taskflow/blob/master/taskflow/examples/calculate_in_parallel.py is a decent example. In that one, tasks are created and input/output dependencies are speci

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Clint Byrum
Excerpts from Stan Lagun's message of 2013-10-11 07:22:37 -0700: > Hello, > > Thanks Angus, Clint, I've got your design. > > It seems that Murano can built on top of that. With service metadata > knowledge Murano can generate HOT templates with set of interdependent > configs. > Here is what will

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-11 Thread Stan Lagun
Hello, Thanks Angus, Clint, I've got your design. It seems that Murano can built on top of that. With service metadata knowledge Murano can generate HOT templates with set of interdependent configs. Here is what will be needed: 1. Ability to implement support for custom software configuration to

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-10 Thread Clint Byrum
Excerpts from Angus Salkeld's message of 2013-10-10 15:27:48 -0700: > On 10/10/13 11:59 +0400, Stan Lagun wrote: > >This rises number of questions: > > > >1. What about conditional dependencies? Like config3 depends on config1 AND > >config2 OR config3. > > We have the AND, but not an OR. To depen

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-10 Thread Angus Salkeld
On 10/10/13 11:59 +0400, Stan Lagun wrote: This rises number of questions: 1. What about conditional dependencies? Like config3 depends on config1 AND config2 OR config3. We have the AND, but not an OR. To depend on two resources you just have 2 references to the 2 resources. 2. How do I pa

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-10 Thread Thomas Spatzier
Hi all, Lakshminaraya Renganarayana wrote on 10.10.2013 01:34:41: > From: Lakshminaraya Renganarayana > To: Joshua Harlow , > Cc: OpenStack Development Mailing List > Date: 10.10.2013 01:37 > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workf

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-10 Thread Stan Lagun
This rises number of questions: 1. What about conditional dependencies? Like config3 depends on config1 AND config2 OR config3. 2. How do I pass values between configs? For example config1 requires value from user input and config2 needs an output value obtained from applying config1 3. How woul

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Angus Salkeld
On 09/10/13 19:31 +0100, Steven Hardy wrote: On Wed, Oct 09, 2013 at 06:59:22PM +0200, Alex Rudenko wrote: Hi everyone, I've read this thread and I'd like to share some thoughts. In my opinion, workflows (which run on VMs) can be integrated with heat templates as follows: 1. workflow defini

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Lakshminaraya Renganarayana
Stan Lagun wrote on 10/09/2013 04:07:33 PM: It seems to me that something is missing in our discussion. > If something depends on something else there must be a definition of > that something. It is clear that it is not the case that one > instance depends on another but one application depend

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Joshua Harlow
hoo-inc.com>> Cc: OpenStack Development Mailing List mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows Hi Joshua, I agree that there is an element of taskflow in what I described. But, I am aiming

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Lakshminaraya Renganarayana
Georgy Okrokvertskhov wrote on 10/09/2013 03:37:01 PM: > From: Georgy Okrokvertskhov > To: OpenStack Development Mailing List > Date: 10/09/2013 03:41 PM > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > Thank you for bring

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Lakshminaraya Renganarayana
tp://paste.openstack.org/show/48157/ > > -Josh > > From: Lakshminaraya Renganarayana > Reply-To: OpenStack Development Mailing List d...@lists.openstack.org> > Date: Wednesday, October 9, 2013 11:31 AM > To: OpenStack Development Mailing List > Subject: Re: [openstack-de

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Caitlin Bestler
On 10/9/2013 12:55 PM, Joshua Harlow wrote: Your example sounds a lot like what taskflow is build for doing. I'm not that familiar with Heat, so I wanted to bounce this off of you before doing a public foot-in-mouth on the mailing list. Is the real issue here the difference between *building*

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Stan Lagun
It seems to me that something is missing in our discussion. If something depends on something else there must be a definition of that something. It is clear that it is not the case that one instance depends on another but one application depends on another application. But there is no such thing a

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Joshua Harlow
nStack Development Mailing List mailto:openstack-dev@lists.openstack.org>> Date: Wednesday, October 9, 2013 11:31 AM To: OpenStack Development Mailing List mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows Steve

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Georgy Okrokvertskhov
Hi Lakshminaraya, Thank you for bringing your use case and your thought here. That is exactly tried to achieve in Murano project. There are important aspects you highlighted. Sometime resource model is two high level to describe deployment process. If you start to use more granular approach to ha

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Steven Hardy
On Wed, Oct 09, 2013 at 06:59:22PM +0200, Alex Rudenko wrote: > Hi everyone, > > I've read this thread and I'd like to share some thoughts. In my opinion, > workflows (which run on VMs) can be integrated with heat templates as > follows: > >1. workflow definitions should be defined separately

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Lakshminaraya Renganarayana
Steven Hardy wrote on 10/09/2013 05:24:38 AM: > > So as has already been mentioned, Heat defines an internal workflow, based > on the declarative model defined in the template. > > The model should define dependencies, and Heat should convert those > dependencies into a workflow internally. IMO

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Clint Byrum
Excerpts from Georgy Okrokvertskhov's message of 2013-10-09 08:37:36 -0700: > Hi, > > In addition I want to add couple words about flexibility and debugging > capabilities. I believe it is quite important for HOT template engine to > control all aspects of deployment process execution including so

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Mike Spreitzer
ko > To: OpenStack Development Mailing List , > Date: 10/09/2013 01:03 PM > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > Hi everyone, > > I've read this thread and I'd like to share some thoughts. In my >

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Alex Rudenko
Hi everyone, I've read this thread and I'd like to share some thoughts. In my opinion, workflows (which run on VMs) can be integrated with heat templates as follows: 1. workflow definitions should be defined separately and processed by stand-alone workflow engines (chef, puppet etc). 2.

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Georgy Okrokvertskhov
Hi, In addition I want to add couple words about flexibility and debugging capabilities. I believe it is quite important for HOT template engine to control all aspects of deployment process execution including software components. Right now I believe Heat lack of control of what is going on the VM

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Stan Lagun
> Thanks, we're certainly interested in Murano, and are keen to discuss your > roadmap, and where requirements and integration opportunities exist Glad to here it. The same is true from Murano side. On sample SQL workflow: that was just an example. I didn't want to bother you with a SQL Server dep

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Steven Hardy
On Wed, Oct 09, 2013 at 12:53:45AM +0400, Stan Lagun wrote: > Hello, > > I’m one of the engineer working on Murano project. Recently we started a > discussion about Murano and Heat Software orchestration and I want to > continue this discussion with more technical details. Thanks, we're certainly

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-09 Thread Thomas Spatzier
Excerpts from Clint Byrum's message > From: Clint Byrum > To: openstack-dev , > Date: 09.10.2013 03:54 > Subject: Re: [openstack-dev] [Heat] HOT Software orchestration > proposal for workflows > > Excerpts from Stan Lagun's message of 2013-10-08 13:53:45 -0700: >

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-08 Thread Clint Byrum
Excerpts from Stan Lagun's message of 2013-10-08 13:53:45 -0700: > Hello, > > I’m one of the engineer working on Murano project. Recently we started a > discussion about Murano and Heat Software orchestration and I want to > continue this discussion with more technical details. > > In our project

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-08 Thread Georgy Okrokvertskhov
Hi Angus, We will have representatives from our Team . Alex Tivelkov and I will be on summit. We definitely will participate in design sessions for these hot topics. Before the summit we will work in etherpads to add necessary technical information to have a solid background for discussions. We a

Re: [openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-08 Thread Angus Salkeld
On 09/10/13 00:53 +0400, Stan Lagun wrote: Hello, I’m one of the engineer working on Murano project. Recently we started a discussion about Murano and Heat Software orchestration and I want to continue this discussion with more technical details. I hope you are going to be at summit, as I expe

[openstack-dev] [Heat] HOT Software orchestration proposal for workflows

2013-10-08 Thread Stan Lagun
Hello, I’m one of the engineer working on Murano project. Recently we started a discussion about Murano and Heat Software orchestration and I want to continue this discussion with more technical details. In our project we do deployment of complex multi-instance Windows services. Those services us