Re: [openstack-dev] [heat] One more lifecycle plug point - in scaling groups

2014-07-01 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 07/01/2014 07:05:15 PM: On 01/07/14 16:30, Mike Spreitzer wrote: Thinking about my favorite use case for lifecycle plug points for cloud providers (i.e., giving something a chance to make a holistic placement decision), it occurs to me that one

Re: [openstack-dev] [DevStack] fails in lxc running ubuntu trusty amd64

2014-06-23 Thread Mike Spreitzer
Jérôme Gallard gallard.jer...@gmail.com wrote on 06/19/2014 03:55:10 AM: We worked with Devstack and LXC and got the same issue ( https:// blueprints.launchpad.net/devstack/+spec/lxc-computes ). That blames open-iscsi, but the problem is now tgt. Cinder seems to have switched from open-iscsi

Re: [openstack-dev] horizon failing on icehouse 100%, currently blocking all patches

2014-06-21 Thread Mike Spreitzer
Since Friday I have been getting this misbehavior: enter username and password, hit login, and it shows you the login page again. Sean Dague --- [openstack-dev] horizon failing on icehouse 100%, currently blocking all patches ---

[openstack-dev] FIXED_RANGE and FLOATING_RANGE for simple localrc for DevStack

2014-06-20 Thread Mike Spreitzer
Suppose I want a simple localrc (e.g., it defaults to using flat DHCP nova networking) to use with DevStack on a machine that has a single NIC and is using IPv4 address 10.10.0.42 and netmask 255.255.0.0, and I know addresses 10.10.1.0--10.10.255.254 are unused. What would be reasonable

Re: [openstack-dev] [heat] agenda for OpenStack Heat meeting 2014-06-18 20:00 UTC - corrections to meeting minutes

2014-06-19 Thread Mike Spreitzer
Mike Spreitzer/Watson/IBM@IBMUS wrote on 06/18/2014 05:00:57 PM: ... http://eavesdrop.openstack.org/meetings/heat/2014/heat.2014-06-18-20.00.html I found two goofups so far. One is that the following was not recorded in the official outline (#agreed only really works for chairs): 20:10:12

[openstack-dev] [DevStack] fails in lxc running ubuntu trusty amd64

2014-06-19 Thread Mike Spreitzer
In my linux containers running Ubuntu 14.04 64-bit, DevStack fails because it can not install the package named tgt. The problem is that the install script invokes the tgt service's start operation, which launches the daemon (tgtd), and the launch fails with troubles with RDMA. Has anybody

Re: [openstack-dev] [DevStack] fails in lxc running ubuntu trusty amd64

2014-06-19 Thread Mike Spreitzer
Sean Dague s...@dague.net wrote on 06/19/2014 06:43:36 AM: On 06/19/2014 03:03 AM, Mike Spreitzer wrote: In my linux containers running Ubuntu 14.04 64-bit, DevStack fails because it can not install the package named tgt. The problem is that the install script invokes the tgt service's

[openstack-dev] [tempest} virtual environment or not?

2014-06-18 Thread Mike Spreitzer
Suppose I have just used DevStack to install and startup OpenStack, and I want to use tempest to check that my shiny new OpenStack is copacetic. Should I use testr directly, or use tox or run_tempest.sh to wrap it in a virtual environment? I see that tempest's README.rst says that I *can*,

Re: [openstack-dev] [heat] agenda for OpenStack Heat meeting 2014-06-18 20:00 UTC

2014-06-18 Thread Mike Spreitzer
A good time was had by all. http://eavesdrop.openstack.org/meetings/heat/2014/heat.2014-06-18-20.00.html ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [nova] nova networking API and CLI are poorly documented and buggy

2014-06-17 Thread Mike Spreitzer
I am not even sure what is the intent, but some of the behavior looks like it is clearly unintended and not useful (i.e., buggy). IMHO, the API and CLI documentation should explain these calls/commands in enough detail that the reader can tell the difference. And the difference should be

[openstack-dev] [heat] agenda for OpenStack Heat meeting 2014-06-18 20:00 UTC

2014-06-17 Thread Mike Spreitzer
https://wiki.openstack.org/wiki/Meetings/HeatAgenda http://www.timeanddate.com/worldclock/fixedtime.html?msg=Heat+Chatiso=20140618T20p1=211ah=1 Agenda (2014-06-18 2000 UTC) Review last meeting's actions Adding items to the agenda Mid-cycle meetup Critical issues sync Regards,

[openstack-dev] DevStack hacks requirements.txt et al

2014-06-17 Thread Mike Spreitzer
I have noticed that lately DevStack has been hacking requirements.txt in most projects and test-requirements.txt in many. Why is this being done? Thanks, Mike___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org

[openstack-dev] nova networking API and CLI are poorly documented and buggy

2014-06-14 Thread Mike Spreitzer
I am not even sure what is the intent, but some of the behavior looks like it is clearly unintended and not useful (a more precise formulation of buggy that is not defeated by the lack of documentation). IMHO, the API and CLI documentation should explain these calls/commands in enough detail

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Mike Spreitzer
John Garbutt j...@johngarbutt.com wrote on 06/04/2014 04:29:36 AM: On 3 June 2014 14:29, Jay Pipes jaypi...@gmail.com wrote: tl;dr = Move CPU and RAM allocation ratio definition out of the Nova scheduler and into the resource tracker. Remove the calculations for overcommit out of

Re: [openstack-dev] [Heat] Short term scaling strategies for large Heat stacks

2014-06-02 Thread Mike Spreitzer
Steve Baker sba...@redhat.com wrote on 06/02/2014 05:37:25 PM: BTW You missed off another strategy that we have discussed in the past, and which I think Steve Baker might(?) be working on: retrying failed calls at the client level. As part of the client-plugins blueprint I'm planning on

Re: [openstack-dev] [Heat] DB schema changes for Convergence [was: Short term scaling strategies for large Heat stacks]

2014-05-31 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 05/29/2014 09:09:18 PM: update-failure-recovery === This is a blueprint I believe Zane is working on to land in Juno. ... It's not just the observed state that you need in the database to resume. You also need the

Re: [openstack-dev] [TripleO] [Ironic] [Heat] Mid-cycle collaborative meetup

2014-05-29 Thread Mike Spreitzer
Devananda van der Veen devananda@gmail.com wrote on 05/29/2014 01:26:12 PM: Hi Jaromir, I agree that the midcycle meetup with TripleO and Ironic was very beneficial last cycle, but this cycle, Ironic is co-locating its sprint with Nova. Our focus needs to be working with them to

Re: [openstack-dev] [Heat] Short term scaling strategies for large Heat stacks

2014-05-29 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 05/29/2014 07:52:07 PM: I am writing to get some brainstorming started on how we might mitigate some of the issues we've seen while deploying large stacks on Heat. I am sending this to the dev list because it may involve landing fixes rather than just

Re: [openstack-dev] [neutron][L3] VM Scheduling v/s Network as input any consideration ?

2014-05-28 Thread Mike Spreitzer
Armando M. arma...@gmail.com wrote on 05/28/2014 07:35:52 PM: From: Armando M. arma...@gmail.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org, Date: 05/28/2014 07:37 PM Subject: Re: [openstack-dev] [neutron][L3] VM Scheduling v/s

Re: [openstack-dev] [neutron] Supporting retries in neutronclient

2014-05-27 Thread Mike Spreitzer
Joe Gordon joe.gord...@gmail.com wrote on 05/27/2014 07:31:16 PM: From: Joe Gordon joe.gord...@gmail.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org, Date: 05/27/2014 07:32 PM Subject: Re: [openstack-dev] [neutron] Supporting retries

Re: [openstack-dev] [Heat] looking to add support for server groups to heat...any comments?

2014-04-30 Thread Mike Spreitzer
Chris Friesen chris.frie...@windriver.com wrote on 04/28/2014 10:44:46 AM: On 04/26/2014 09:41 PM, Jay Lau wrote: ... My idea is that can we add a new field such as PlacemenetPolicy to AutoScalingGroup? If the value is affinity, then when heat engine create the AutoScalingGroup, it will

Re: [openstack-dev] [Heat] looking to add support for server groups to heat...any comments?

2014-04-30 Thread Mike Spreitzer
Chris Friesen chris.frie...@windriver.com wrote on 04/30/2014 06:07:49 PM: If we go with what Zane suggested (using the already-exposed scheduler_hints) then by implementing a single server group resource we basically get support for server groups for free in any resource that exposes

Re: [openstack-dev] [nova] Proposal: remove the server groups feature

2014-04-28 Thread Mike Spreitzer
Steve Gordon sgor...@redhat.com wrote on 04/28/2014 08:58:35 AM: - Original Message - Hi Stackers, Proposal Create two new options to nova boot: --near-tag TAG and --not-near-tag TAG The first would tell the scheduler to place the new VM near other VMs having a

Re: [openstack-dev] [Heat] looking to add support for server groups to heat...any comments?

2014-04-26 Thread Mike Spreitzer
Jay Lau jay.lau@gmail.com wrote on 04/26/2014 11:41:25 PM: Just noticed this email, I have already filed a blueprint related to this topic https://blueprints.launchpad.net/heat/+spec/vm-instance- group-support My idea is that can we add a new field such as PlacemenetPolicy to

Re: [openstack-dev] [nova] Proposal: remove the server groups feature

2014-04-26 Thread Mike Spreitzer
Jay Lau jay.lau@gmail.com wrote on 04/27/2014 12:31:01 AM: I think server group is an important feature especially when working with heat auto scaling group, there is already some discussion for this http://markmail.org/message/jl5wlx3nr3g53ko5 The current server group feature does

Re: [openstack-dev] [Heat] looking to add support for server groups to heat...any comments?

2014-04-25 Thread Mike Spreitzer
Chris Friesen chris.frie...@windriver.com wrote on 04/25/2014 12:23:00 PM: I'm looking to add support for server groups to heat. I've got working code, but I thought I'd post the overall design here in case people had objections. Basically, what I propose is to add a class

Re: [openstack-dev] [Heat] looking to add support for server groups to heat...any comments?

2014-04-25 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 04/25/2014 12:36:00 PM: On 25/04/14 12:23, Chris Friesen wrote: ... The LaunchConfiguration and Instance classes would be extended with an optional ServerGroup property. In the Instance class if the ServerGroup property is set then the group name

Re: [openstack-dev] [nova] Proposal: remove the server groups feature

2014-04-25 Thread Mike Spreitzer
Jay Pipes jaypi...@gmail.com wrote on 04/25/2014 06:28:38 PM: On Fri, 2014-04-25 at 22:00 +, Day, Phil wrote: Hi Jay, I'm going to disagree with you on this one, because: No worries, Phil, I expected some dissention and I completely appreciate your feedback and perspective :) I

Re: [openstack-dev] [Heat] How about managing heat template like flavors in nova?

2014-04-19 Thread Mike Spreitzer
Gouzongmei gouzong...@huawei.com wrote on 04/19/2014 10:37:02 PM: We can supply APIs for getting, putting, adding and deleting current templates in the system, then when creating heat stacks, we just need to specify the name of the template. Look for past discussion of Heat Template

Re: [openstack-dev] [heat] [heat-templates] [qa] [tempest] Questions about images

2014-04-17 Thread Mike Spreitzer
Steven Dake sd...@redhat.com wrote on 04/16/2014 03:31:16 PM: ... Fedora 19 shipped in the Fedora cloud images does *NOT* include heat-cfntools. The heat-cfntools package was added only in Fedora 20 qcow2 images. Fedora 19 must be custom made which those prebuilt-jeos-images are. They

Re: [openstack-dev] [heat] [heat-templates] [qa] [tempest] Questions about images

2014-04-16 Thread Mike Spreitzer
Steven Hardy sha...@redhat.com wrote on 04/16/2014 01:05:14 PM: On Wed, Apr 16, 2014 at 11:39:59AM -0400, Mike Spreitzer wrote: http://fedorapeople.org/groups/heat/prebuilt-jeos-images/F19- x86_64-cfntools.qcow2 seems to be broken; I get failures every time I try to use it. Has

Re: [openstack-dev] [heat] computed package names?

2014-04-15 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 04/15/2014 03:29:03 PM: On 15/04/14 14:31, Mike Spreitzer wrote: It appears that in Fedora 19 and 20 the Wordpress examples need to install different packages than in every other release (see my debugging in https://review.openstack.org/#/c/87065

Re: [openstack-dev] [heat] computed package names?

2014-04-15 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 04/15/2014 05:17:21 PM: Excerpts from Zane Bitter's message of 2014-04-15 13:32:30 -0700: Yes, that _kind_ of thing. But I don't see much point in having an AWS::CloudFormation::Init section that isn't compatible with CloudFormation's definition of

Re: [openstack-dev] [heat] computed package names?

2014-04-15 Thread Mike Spreitzer
Mike Spreitzer/Watson/IBM@IBMUS wrote on 04/15/2014 05:59:50 PM: Yes, I can see how OS::Heat::Init makes sense. But is this just the first thing on a long list? Would it be better to have a static intrinsic that is like Python's dict(iterable of iterable)-dictionary function? .. and I

Re: [openstack-dev] [heat] [nova] How should a holistic scheduler relate to Heat?

2014-04-08 Thread Mike Spreitzer
Let me add one more thing: Now let us consider how to evolve the Nova API so that a server- group can be scheduled holistically. That is, we want to enable the scheduler to look at both the group's policies and its membership, all at once, and make a joint decision about how to place all

Re: [openstack-dev] [heat] [nova] How should a holistic scheduler relate to Heat?

2014-04-04 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 04/03/2014 07:01:16 PM: ... The whole question raises many more questions, and I wonder if there's just something you haven't told us about this use case. :-P Yes, I seem to have made a muddle of things by starting in one corner of a design space. Let

Re: [openstack-dev] [tempest]:Please updated etherpad before adding tempest tests

2014-04-04 Thread Mike Spreitzer
Kekane, Abhishek abhishek.kek...@nttdata.com wrote on 04/04/2014 06:26:58 AM: This is regarding implementation of blueprint https:// blueprints.launchpad.net/tempest/+spec/testcases-expansion-icehouse. As per mentioned in etherpads for this blueprint, please add your name if you are

Re: [openstack-dev] [heat] metadata for a HOT

2014-04-03 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 04/03/2014 01:10:30 PM: Things that affect the stack as a whole really belong in the stack API. That would also put them in the OS::Heat::Stack resource, so the template language already supports that. The OS::Heat::Stack resource is one of several that

Re: [openstack-dev] [heat] metadata for a HOT

2014-04-03 Thread Mike Spreitzer
Keith Bray keith.b...@rackspace.com wrote on 04/03/2014 01:50:28 PM: We proposed another specific piece of template data [3] which I can't remember whether it was met with resistance or we just didn't get to implementing it since we knew we would have to store other data specific to our

[openstack-dev] [heat] metadata for a HOT

2014-04-02 Thread Mike Spreitzer
I would like to suggest that a metadata section be allowed at the top level of a HOT. Note that while resources in a stack can have metadata, there is no way to put metadata on a stack itself. What do you think? Thanks, Mike___ OpenStack-dev mailing

Re: [openstack-dev] [heat] metadata for a HOT

2014-04-02 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 04/02/2014 05:36:43 PM: I think that if you're going to propose a new feature, you should at least give us a clue who you think is going to use it and what for ;) I was not eager to do that yet because I have not found a fully satisfactory answer yet,

Re: [openstack-dev] [nova] avahi-autoipd vs. nova networking (cloud-init)

2014-03-31 Thread Mike Spreitzer
Lars Kellogg-Stedman l...@redhat.com wrote on 03/31/2014 01:31:57 PM: ... you could add an explicit route to the metadata address via your default gateway Yes, and there are other work-arounds possible too. I posted here because I was concerned there may be a bug that needs fixing. Why

[openstack-dev] [nova] avahi-autoipd vs. nova networking (cloud-init)

2014-03-29 Thread Mike Spreitzer
I run into trouble in Ubuntu VMs when avahi-autoipd is installed. This is when I install OpenStack using DevStack with a fairly plain local.conf. For example, make an instance of Ubuntu Server 12.04. You can reboot it, and all is well. Cloud-init continues to be able to read its metadata

Re: [openstack-dev] [Heat] Stack breakpoint

2014-03-17 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 03/17/2014 07:03:25 PM: On 17/03/14 17:03, Ton Ngo wrote: - How to handle resources with timer, e.g. wait condition: pause/resume timer value Handle it by only allowing pauses before and after. In most cases I'm not sure what it would mean to

Re: [openstack-dev] [heat][neutron] OS::Heat::AutoScalingGroup and OS::Neutron::PoolMember?

2014-03-13 Thread Mike Spreitzer
it without code changes as far as I can tell. I think its only a few days of work, but the OpenStack CLA is preventing me from contributing. :/ Thanks, Kevin From: Mike Spreitzer [mspre...@us.ibm.com] Sent: Wednesday, March 12, 2014 11:34 AM To: OpenStack Development Mailing List Subject

[openstack-dev] [neutron][devstack] Working config for Neutron install by DevStack?

2014-03-12 Thread Mike Spreitzer
I want to use DevStack to install and configure OpenStack with Neutron, into a VM in an OpenStack undercloud. I looked at https://wiki.openstack.org/wiki/NeutronDevstack and tried that, and failed. Looking deeper, I see there are very important additional details to pay attention to: flat

[openstack-dev] [heat][neutron] OS::Heat::AutoScalingGroup and OS::Neutron::PoolMember?

2014-03-12 Thread Mike Spreitzer
Has anybody exercised the case of OS::Heat::AutoScalingGroup scaling a nested stack that includes a OS::Neutron::PoolMember? Should I expect this to work? Thanks, Mike___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org

[openstack-dev] How to configure DevStack to use Ceilometer?

2014-02-28 Thread Mike Spreitzer
So far I have found three different sources, and they all say different things. http://techs.enovance.com/5991/autoscaling-with-heat-and-ceilometer http://devstack.org/lib/ceilometer.html http://docs.openstack.org/developer/ceilometer/install/development.html Thanks,

Re: [openstack-dev] How to configure DevStack to use Ceilometer?

2014-02-28 Thread Mike Spreitzer
Swapnil Kulkarni swapnilkulkarni2...@gmail.com wrote on 03/01/2014 12:36:49 AM: I am able to configure devstack with ceilometer adding following to localrc enable_service ceilometer-acompute ceilometer-acentral ceilometer- collector ceilometer-api enable_service ceilometer-alarm-notifier

Re: [openstack-dev] [nova] [glance] [heat] bug 1203680 - fix requires doc

2014-02-26 Thread Mike Spreitzer
Dean Troyer dtro...@gmail.com wrote on 02/26/2014 12:53:31 PM: Thanks for the updates, but I've massaged the project bits and restored/expanded the reasons to consider one or the other option. Thanks for the further updates. I have just one question about those. One way to do both unit

Re: [openstack-dev] [nova] [glance] [heat] bug 1203680 - fix requires doc

2014-02-26 Thread Mike Spreitzer
Dean Troyer dtro...@gmail.com wrote on 02/26/2014 03:28:04 PM: On Wed, Feb 26, 2014 at 1:09 PM, Mike Spreitzer mspre...@us.ibm.com wrote: Thanks for the further updates. I have just one question about those. One way to do both unit testing and system (integration) testing is to: git

Re: [openstack-dev] [nova] [glance] [heat] bug 1203680 - fix requires doc

2014-02-25 Thread Mike Spreitzer
(I added some tags in the subject line, probably should have been there from the start.) Thanks guys, for an informative discussion. I have updated https://wiki.openstack.org/wiki/Gerrit_Workflow and https://wiki.openstack.org/wiki/Testing to incorporate what I have learned. Like Ben I know

Re: [openstack-dev] [Heat][docs] Need more sample HOT templates for users

2014-02-21 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 02/21/2014 12:23:05 PM: Yeah, we are overloading the term 'developer' here, since that section contains both information that is only useful to developers working on Heat itself, and information useful to users developing templates. At the highest

[openstack-dev] bug 1203680 - fix requires doc

2014-02-21 Thread Mike Spreitzer
https://bugs.launchpad.net/devstack/+bug/1203680 is literally about Glance but Nova has the same problem. There is a fix released, but just merging that fix accomplishes nothing --- we need people who run DevStack to set the new variable (INSTALL_TESTONLY_PACKAGES). This is something that

Re: [openstack-dev] supported dependency versioning and testing

2014-02-21 Thread Mike Spreitzer
Sean Dague s...@dague.net wrote on 02/20/2014 02:45:03 PM: ... That being said, we also need to be a little bit careful about taking such a hard line about supported vs. not based on only what's in the gate. Because if we did the following things would be listed as unsupported (in increasing

Re: [openstack-dev] bug 1203680 - fix requires doc

2014-02-21 Thread Mike Spreitzer
Sean Dague s...@dague.net wrote on 02/21/2014 06:09:18 PM: On 02/21/2014 05:28 PM, Clark Boylan wrote: ... I would be wary of relying on devstack to configure your unittest environments. Just like it takes over the node you run it on, devstack takes full ownership of the repos it clones

[openstack-dev] tox in Ubuntu 13.04 (raring) or earlier?

2014-02-19 Thread Mike Spreitzer
I just installed DevStack into raring, and that appeared to work. So I went on to try `tox` in /opt/stack/nova. My invocation of tox created a virtual environment using /usr/lib/python2.7/dist-packages/virtualenv.py. In raring the latest virtualenv is version 1.9.1, which installs pip

[openstack-dev] Unit Testing Nova

2014-02-18 Thread Mike Spreitzer
I am trying to figure out how I should be doing unit testing, and documenting it in https://wiki.openstack.org/wiki/Gerrit_Workflow Oddly, the situation for Nova seems reversed: run_tests.sh works and tox does not. See http://paste.openstack.org/show/66969/ for my experiences with each. Am I

Re: [openstack-dev] Unit Testing Nova

2014-02-18 Thread Mike Spreitzer
Boris Pavlovic bpavlo...@mirantis.com wrote on 02/18/2014 12:55:26 PM: What version of tox do you use? That was using version 1.6.1 (as a workaround to https://bugs.launchpad.net/openstack-ci/+bug/1274135). Also, this was a fresh DevStack install (done about an hour or two before I posted to

Re: [openstack-dev] Unit Testing Nova

2014-02-18 Thread Mike Spreitzer
Mike Spreitzer/Watson/IBM@IBMUS wrote on 02/18/2014 01:22:33 PM: That was using version 1.6.1 (as a workaround to https:// bugs.launchpad.net/openstack-ci/+bug/1274135). Also, this was a fresh DevStack install (done about an hour or two before I posted to the list), with a pretty plain

Re: [openstack-dev] Change in openstack-dev/devstack[master]: Remove limitation to 12.04 release because the problematic 1...

2014-02-18 Thread Mike Spreitzer
Dean Troyer (Code Review) rev...@openstack.org wrote on 02/18/2014 05:53:03 PM: I'm curious why we haven't seen this before now? I've run on bare raring and saucy systems a number of times...need to try again I suppose... Yes, I have previously done lots of DevStack installs on

Re: [openstack-dev] heat run_tests.sh fails with one huge line of output

2014-02-16 Thread Mike Spreitzer
Robert Collins robe...@robertcollins.net wrote on 02/16/2014 05:26:50 PM: I would have expected run_tests.sh to tox which creates a venv, but heat seems different. So you'll need to install testrepository via your system tox, not one from a venv. I don't think I have a system tox. `pip list

Re: [openstack-dev] Gamification and on-boarding ...

2014-02-13 Thread Mike Spreitzer
From: Sean Dague s...@dague.net ... Realistically, the biggest issue I see with on-boarding is mentoring time. Especially with folks completely new to our structure, there is a lot of confusing things going on. And OpenStack is a ton to absorb. I get pinged a lot on IRC, answer when I can,

Re: [openstack-dev] [heat] non-trivial example - IBM Connections [and Murano]

2014-02-08 Thread Mike Spreitzer
From: Georgy Okrokvertskhov gokrokvertsk...@mirantis.com ... Thank you for sharing this. It looks pretty impressive. Could you, please some details about DSL syntax, if it is possible? I will respond briefly, and pass your request along to the people working on that. In the Weaver language

Re: [openstack-dev] [heat] Sofware Config progress

2014-02-05 Thread Mike Spreitzer
From: Steven Dake sd...@redhat.com ... The crux of the problem is how do you obtain critical mass for custom one-off solutions? Lets assume two possible solutions to this problem that these vendors could take. If there are more, please feel free to explain them: 1) Implement a ReST

Re: [openstack-dev] [heat] Sofware Config progress [for appliances]

2014-02-05 Thread Mike Spreitzer
From: Prasad Vellanki prasad.vella...@oneconvergence.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org, Date: 01/21/2014 02:16 AM Subject: Re: [openstack-dev] [heat] Sofware Config progress Steve Clint That should work. We will

Re: [openstack-dev] [Nova][Scheduler] Policy Based Scheduler and Solver Scheduler

2014-02-04 Thread Mike Spreitzer
From: Khanh-Toan Tran khanh-toan.t...@cloudwatt.com ... There is an unexpected line break in the middle of the link, so I post it again: https://docs.google.com/document/d/1RfP7jRsw1mXMjd7in72ARjK0fTrsQv1bqolOri IQB2Y The mailing list software keeps inserting that line break. I

Re: [openstack-dev] Next steps for Whole Host allocation / Pclouds

2014-01-22 Thread Mike Spreitzer
From: Sylvain Bauza sylvain.ba...@bull.net Le 22/01/2014 02:50, Jay Pipes a écrit : Yup, agreed. It's difficult to guess what the capacity implications would be without having solid numbers on customer demands for this functionality, including hard data on how long such instances would

Re: [openstack-dev] Next steps for Whole Host allocation / Pclouds

2014-01-21 Thread Mike Spreitzer
I want to explore the linkage between the proposed exclusive use filter and scheduling a little more. At the Icehouse summit I heard the concern that without advance preparation, there may well be zero hosts that are acceptable. Why is that not a concern now? What does the Nova scheduler do

[openstack-dev] [nova][documentation][devstack] Confused about how to set up a Nova development environment

2014-01-09 Thread Mike Spreitzer
I am trying to become a bit less of a newbie, and having a bit of difficulty with basics. Following are some questions, and reviews of the relevant documentation that I have been able to find (I am trying to contribute to documentation as well as solve my setup problems). My driving question

Re: [openstack-dev] [nova][documentation][devstack] Confused about how to set up a Nova development environment

2014-01-09 Thread Mike Spreitzer
Brant Knudson b...@acm.org wrote on 01/09/2014 10:07:27 AM: When I was starting out, I ran devstack ( http://devstack.org/ ) on an Ubuntu VM. You wind up with a system where you've got a basic running OpenStack so you can try things out with the command-line utilities, and also do

[openstack-dev] [nova] Change I005e752c: Whitelist external netaddr requirement, for bug 1266513, ineffective for me

2014-01-06 Thread Mike Spreitzer
I am suffering from bug 1266513, when trying to work on nova. For example, on MacOS 10.8.5, I clone nova and then (following the instructions at https://wiki.openstack.org/wiki/DependsOnOSX) run `cd nova; python tools/install_venv.py`. It fails due to PyPI lacking a sufficiently advanced

Re: [openstack-dev] [Trove][Savanna][Murano][Heat] Unified Agent proposal discussion at Summit

2013-11-25 Thread Mike Spreitzer
I am sorry I missed that session, but am interested in the topic. This is very relevant to Heat, where we are working on software configuration in general. I desire that Heat's ability to configure software will meet the needs of Trove, Savanna, and Murano. At IBM we worked several Hadoop

Re: [openstack-dev] [Nova][Schduler] Volunteers wanted for a modest proposal for an external scheduler in our lifetime

2013-11-22 Thread Mike Spreitzer
I'm still a newbie here, so can not claim my Nova skills are even modest. But I'd like to track this, if nothing more. Thanks, Mike___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org

Re: [openstack-dev] [nova] future fate of nova-network?

2013-11-22 Thread Mike Spreitzer
Daniel P. Berrange berra...@redhat.com wrote on 11/22/2013 11:32:59 AM: A good example is the current discussion around a new scheduling service. There have been lots of big ideas around this. Robert Collins just started a thread about a proposal to start this project but with a very

Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions

2013-11-21 Thread Mike Spreitzer
Thomas Spatzier thomas.spatz...@de.ibm.com wrote on 11/21/2013 02:48:14 AM: ... Now thinking more about update scenarios (which we can leave for an iteration after the initial deployment is working), I recommend thinking about UPDATE from the start. We should have an implementation in which

Re: [openstack-dev] [Heat] Continue discussing multi-region orchestration

2013-11-20 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 11/15/2013 05:59:06 PM: On 15/11/13 22:17, Keith Bray wrote: The way I view 2 vs. 4 is that 2 is more complicated and you don't gain any benefit of availability. If, in 2, your global heat endpoint is down, you can't update the whole stack. You

Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions

2013-11-20 Thread Mike Spreitzer
Steve Baker sba...@redhat.com wrote on 11/19/2013 03:40:54 PM: ... How to define and deliver this agent is the challenge. Some options are: 1) install it as part of the image customization/bootstrapping (golden images or cloud-init) 2) define a (mustache?) template in the SoftwareConfig which

Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions

2013-11-20 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 11/19/2013 04:28:31 PM: From: Clint Byrum cl...@fewbar.com To: openstack-dev openstack-dev@lists.openstack.org, Date: 11/19/2013 04:30 PM Subject: Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions Excerpts

Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions

2013-11-20 Thread Mike Spreitzer
Regarding my previous email: Steve Baker sba...@redhat.com wrote on 11/19/2013 03:40:54 PM: ... How to define and deliver this agent is the challenge. Some options are: 1) install it as part of the image customization/bootstrapping (golden images or cloud-init) 2) define a

[openstack-dev] [Nova] Does Nova really need an SQL database?

2013-11-18 Thread Mike Spreitzer
There were some concerns expressed at the summit about scheduler scalability in Nova, and a little recollection of Boris' proposal to keep the needed state in memory. I also heard one guy say that he thinks Nova does not really need a general SQL database, that a NOSQL database with a bit of

Re: [openstack-dev] [Heat] rough draft of Heat autoscaling API

2013-11-15 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 11/14/2013 12:56:22 PM: ... My 2c: the way I designed the Heat API was such that extant stacks can be addressed uniquely by name. Humans are pretty good with names, not so much with 128 bit numbers. The consequences of this for the design were: -

Re: [openstack-dev] [Heat] HOT software configuration refined after design summit discussions

2013-11-14 Thread Mike Spreitzer
It seems to me we have been discussing a proposal whose write-up intertwines two ideas: (1) making software components look like resources, and (2) using nested stacks and environments to achieve the pattern of definitions and uses. The ideas are separable, and I think the discussion has sort

Re: [openstack-dev] [Nova] question about DB migration difficulty

2013-11-14 Thread Mike Spreitzer
Michael Still mi...@stillhq.com wrote on 11/13/2013 04:27:17 PM: ... This was actually discussed in the session as an example of how other projects handle these problems. Our concerns (IIRC) were that it would take even more patches to land, and each of those patches is quite hard to land in

[openstack-dev] [Nova] question about DB migration difficulty

2013-11-13 Thread Mike Spreitzer
This is a follow-up to the design summit discussion about DB migrations. There was concern about the undo-ability of some migrations. The specific example cited was removal of a column. Could that be done with the following three migrations, each undo-able? First, change the code to keep

Re: [openstack-dev] [OpenStack-dev][Nova][Discussion]Blueprint : Auto VM Discovery in OpenStack for existing workload

2013-10-30 Thread Mike Spreitzer
Swapnil Kulkarni swapnilkulkarni2...@gmail.com wrote on 10/30/2013 02:36:37 AM: I had a discussion with russellb regarding this for yesterday, I would like to discuss this with the team regarding the blueprint mentioned in subject.

Re: [openstack-dev] [OpenStack-dev][Nova][Discussion]Blueprint : Auto VM Discovery in OpenStack for existing workload

2013-10-30 Thread Mike Spreitzer
Daniel P. Berrange berra...@redhat.com wrote on 10/30/2013 12:38:21 PM: ... This avoids any need to deal with the hard problems of adopting arbitrary VMs. Sorry, my writing was unclear. I did not mean another use case for adopting VMs; I mean another use case for VM discovery. Regards,

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-30 Thread Mike Spreitzer
Alex Glikson glik...@il.ibm.com wrote on 10/30/2013 02:26:08 AM: Mike Spreitzer mspre...@us.ibm.com wrote on 30/10/2013 06:11:04 AM: Date: 30/10/2013 06:12 AM Alex also wrote: ``I wonder whether it is possible to find an approach that takes into account cross-resource placement

Re: [openstack-dev] [Heat] Locking and ZooKeeper - a space oddysey

2013-10-30 Thread Mike Spreitzer
Clint Byrum cl...@fewbar.com wrote on 10/30/2013 01:42:53 PM: ... The engine should store _all_ of its state in a distributed data store of some kind. Any engine should be aware of what is already happening with the stack from this state and act accordingly. That includes the engine

Re: [openstack-dev] [Heat] Comments on Steve Baker's Proposal on HOT Software Config

2013-10-30 Thread Mike Spreitzer
Lakshminaraya Renganarayana/Watson/IBM@IBMUS wrote on 10/30/2013 03:35:32 PM: Zane Bitter zbit...@redhat.com wrote on 10/29/2013 08:46:21 AM: ... In this method (i.e. option (2) above) shouldn't we be building the dependency graph in Heat rather than running through them sequentially

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-29 Thread Mike Spreitzer
Alex Glikson glik...@il.ibm.com wrote on 10/29/2013 03:37:41 AM: 1. I assume that the motivation for rack-level anti-affinity is to survive a rack failure. Is this indeed the case? This is a very interesting and important scenario, but I am curious about your assumptions regarding all the

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-29 Thread Mike Spreitzer
Khanh-Toan Tran khanh-toan.t...@cloudwatt.com wrote on 10/29/2013 09:10:00 AM: ... 1) Member of a group is recursive. A member can be group or an instance. In this case there are two different declaration formats for members, as with http-server-group-1 (name, policy, edge) and

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-29 Thread Mike Spreitzer
John Garbutt j...@johngarbutt.com wrote on 10/29/2013 07:29:19 AM: ... Its looking good, but I was thinking about a slightly different approach: * I would like to see instance groups be used to describe all scheduler hints (including, please run on cell X, or please run on hypervisor Y) I

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-29 Thread Mike Spreitzer
I should clarify my comment about invoking Heat to do the orchestration. I think we have a choice between designing a 1-stage API vs a 2-stage API. The 2-stage API goes like this: first the client defines the top-level group and everything inside it, then the client makes more calls to create

Re: [openstack-dev] [nova][scheduler] Instance Group Model and APIs - Updated document with an example request payload

2013-10-29 Thread Mike Spreitzer
Following is my reaction to the last few hours of discussion. Russell Bryant wrote Nova calling heat to orchestrate Nova seems fundamentally wrong. I am not totally happy about this either, but would you be OK with Nova orchestrating Nova? To me, that seems worse --- duplicating

Re: [openstack-dev] [Heat] Network topologies [and more]

2013-10-28 Thread Mike Spreitzer
Zane Bitter zbit...@redhat.com wrote on 10/28/2013 06:47:50 AM: On 27/10/13 16:37, Edgar Magana wrote: Heat Developers, I am one of the core developers for Neutron who is lately working on the concept of Network Topologies. I want to discuss with you if the following blueprint will

Re: [openstack-dev] [Heat] Comments on Steve Baker's Proposal on HOT Software Config

2013-10-28 Thread Mike Spreitzer
Steve Baker sba...@redhat.com wrote on 10/28/2013 04:24:30 PM: On 10/29/2013 02:53 AM, Steven Hardy wrote: ... Can anyone provide me with a clear argument for what the fundamental differences actually are? ... Since writing those proposals my thinking has evolved too. I'm currently

Re: [openstack-dev] [scheduler] APIs for Smart Resource Placement - Updated Instance Group Model and API extension model - WIP Draft

2013-10-22 Thread Mike Spreitzer
Yathiraj Udupi (yudupi) yud...@cisco.com wrote on 10/15/2013 03:08:32 AM: I have made some edits to the document: https://docs.google.com/ document/d/17OIiBoIavih-1y4zzK0oXyI66529f-7JTCVj-BcXURA/edit?pli=1# ... One other minor thing to discuss in the modeling is metadata. I am not eager

Re: [openstack-dev] [Heat] HOT Software configuration proposal

2013-10-21 Thread Mike Spreitzer
Steve Baker sba...@redhat.com wrote on 10/15/2013 06:48:53 PM: I've just written some proposals to address Heat's HOT software configuration needs, and I'd like to use this thread to get some feedback: https://wiki.openstack.org/wiki/Heat/Blueprints/hot-software-config

Re: [openstack-dev] [Heat] HOT Software configuration proposal

2013-10-19 Thread Mike Spreitzer
(I really do not understand how the archive is ordered. In the by-thread view, in which all messages with this subject are equally indented, the last message listed is not the chronologically last.) I see that components have parameters. In some uses (invocations) of components, parameters

<    1   2   3   >