Re: [Openstack] Which nova scheduler for different hardware sizes?

2011-11-01 Thread Sandy Walsh
I'm hoping to land this branch asap. https://review.openstack.org/#change,1192 It replaces all the kind of alike schedulers with a single DistributedScheduler. -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net

Re: [Openstack] +1, All services should have WADLs

2011-10-27 Thread Sandy Walsh
...@mnot.net] Sent: Thursday, October 27, 2011 10:38 AM To: Sandy Walsh Cc: Mellquist, Peter; Joseph Heck; openstack@lists.launchpad.net Subject: Re: [Openstack] +1, All services should have WADLs I'm totally on board with having the interface being machine-consumable at runtime -- see the previous

Re: [Openstack] describing APIs for OpenStack consumers

2011-10-27 Thread Sandy Walsh
, it is indeed possible to generate the WADL by introspecting code. (with a few decorators/annotations assisting) This is what Sandy Walsh is suggesting, and I highly, highly recommend this approach. Otherwise you have to either generate code from an external WADL, which makes the code

Re: [Openstack] Push vs Polling (from Versioning Thread)

2011-10-27 Thread Sandy Walsh
+1 Dragon From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf of Monsyne Dragon [mdra...@rackspace.com] Sent: Thursday, October 27, 2011 4:14 PM To: George

Re: [Openstack] +1, All services should have WADLs

2011-10-26 Thread Sandy Walsh
As discussed at the summit, I agree there should be some form of IDL (WADL being the likely candidate for REST), I think manually crafting/maintaining a WADL (or XML in general) is a fools errand. This stuff is made for machine consumption and should be machine generated. Whatever solution we

[Openstack] Welcome to Nova Orchestration ...

2011-10-20 Thread Sandy Walsh
For those of you not on the Orchestration team mailing list, you can sign up here: https://launchpad.net/~nova-orchestration Cheers, Sandy Sent: Thursday, October 20, 2011 8:46 AM To: nova-orchestrat...@lists.launchpad.net Subject: [Nova-orchestration]

Re: [Openstack] Developer conference documentation

2011-10-11 Thread Sandy Walsh
Just added slides for Orchestration and Advanced Scheduling to wiki. (sparse etherpad URL's on title slides) -Sandy From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf

Re: [Openstack] Problem when Scheduling across zones

2011-10-03 Thread Sandy Walsh
You seem to doing things correctly. Can you paste the output from 'nova zone-list' in the parent zone please? -Sandy From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net]

Re: [Openstack] dashaboard+keystone+nova+glance work well´╝č

2011-09-29 Thread Sandy Walsh
perhaps unrelated, but I added a branch to novaclient a while ago that allows you to reuse a token, so you don't have to re-auth. This is, of course, library only ... not cmdline. From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net

Re: [Openstack] Community metrics, developers' engagement

2011-09-28 Thread Sandy Walsh
Great video on the topic: http://blip.tv/djangocon/keynote-david-eaves-5571777 -S This email may include confidential information. If you received it in error, please delete it. ___ Mailing list: https://launchpad.net/~openstack Post to :

Re: [Openstack] Nova DB Connection Pooling

2011-09-27 Thread Sandy Walsh
/MultiClusterZones -S From: Joshua Harlow [harlo...@yahoo-inc.com] Sent: Tuesday, September 27, 2011 12:14 AM To: Sandy Walsh; Devin Carlen; Soren Hansen Cc: openstack Subject: Re: [Openstack] Nova DB Connection Pooling It seems like it would be good to talk about this during

Re: [Openstack] Nova DB Connection Pooling

2011-09-27 Thread Sandy Walsh
POST .../zone/boot has been removed and integrated into POST .../servers/boot now, so there isn't really anything that shouldn't be public now. zone/select is still required for bursting scenarios. From:

Re: [Openstack] Nova Notification System Configuration?

2011-09-26 Thread Sandy Walsh
Try getting started with the Yagi Readme https://github.com/Cerberus98/yagi If you get stuck from there, just ping us again. Hope it helps! -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net

Re: [Openstack] Nova DB Connection Pooling

2011-09-26 Thread Sandy Walsh
Connection Pooling We really need to hear from Sandy Walsh on this thread so he can elaborate on how the distributed scheduling works (with multiple mysql databases). Devin On Sep 26, 2011, at 6:41 AM, Soren Hansen wrote: 2011/9/26 Pitucha, Stanislaw Izaak stanislaw.pitu...@hp.com: The pain

Re: [Openstack] Nova Gerrit Move

2011-09-23 Thread Sandy Walsh
Thanks Mark, that's a great reference. I had two things really trip me up yesterday. All my own fault of course, but perhaps an area we can improve upon? 1. After making changes to my gerrit branch I fell back on old habits and did a 'git commit -a' vs. 'git commit -a --amend' which caused a

Re: [Openstack] Proposal to add Chris Behrens to nova-core

2011-09-15 Thread Sandy Walsh
Pff, I want to know how he escaped for so long?! +1 From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf of Brian Waldon [brian.wal...@rackspace.com] Sent:

Re: [Openstack] novaclient+keystone problem AttributeError: 'unicode' object has no attribute 'items'

2011-09-14 Thread Sandy Walsh
Hi Roman, I ran into this too and have it fixed in this commit: https://github.com/SandyWalsh/python-novaclient/commit/cfab90bddf2325915fb93af63e9efd31793cd55d But it's part of a larger branch. If you are unable to patch, let me know and I'll break this out as a solo branch. -S

Re: [Openstack] Integration tests

2011-09-13 Thread Sandy Walsh
@lists.launchpad.net Subject: Re: [Openstack] Integration tests Matt Dietz wrote: Ditto On 9/12/11 2:10 PM, Sandy Walsh sandy.wa...@rackspace.com wrote: From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 Someone should file

[Openstack] Screencasts ...

2011-09-12 Thread Sandy Walsh
Here's a wiki page of some screencasts I put together of recent Nova changes I've been working on. Please feel free to add your own. http://wiki.openstack.org/DemoVideos -S This email may include confidential information. If you received it in error, please delete it.

Re: [Openstack] Integration tests

2011-09-12 Thread Sandy Walsh
From: Jay Pipes [jaypi...@gmail.com] Can we discuss pulling novaclient into Nova's source tree at the design summit? +1 This email may include confidential information. If you received it in error, please delete it.

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-08 Thread Sandy Walsh
ugh ... this whole conversation has moved into the absurd (and not due to your suggestion Vish :) I agree with Soren, let's move on to more important issues. I apologize for taking us off course. -S From:

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-07 Thread Sandy Walsh
=rackspace@lists.launchpad.net] on behalf of Stefano Maffulli [smaffu...@gmail.com] *Sent:* Monday, September 05, 2011 12:35 PM *To:* openstack@lists.launchpad.net *Subject:* Re: [Openstack] A possible alternative to Gerrit ... 2011/9/5 Sandy Walsh sandy.wa...@rackspace.com mailto:sandy.wa

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-07 Thread Sandy Walsh
to decide between growing our own (in any form) and simply using LP, I'd vote LP. -S From: Soren Hansen [so...@linux2go.dk] Sent: Wednesday, September 07, 2011 8:54 AM To: Sandy Walsh Cc: Monty Taylor; openstack@lists.launchpad.net Subject: Re: [Openstack

Re: [Openstack] Standardizing External APIs

2011-09-07 Thread Sandy Walsh
+1 From: George Reese [george.re...@enstratus.com] This should fall under the more general push notifications API. This email may include confidential information. If you received it in error, please delete it.

Re: [Openstack] Standardizing External APIs

2011-09-07 Thread Sandy Walsh
From: George Reese [george.re...@enstratus.com] Sent: Wednesday, September 07, 2011 10:41 AM To: Sandy Walsh Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Standardizing External APIs See: http://broadcast.oreilly.com/2011/04/proposal-for-cloud-state-notifications.html and http

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-07 Thread Sandy Walsh
... perhaps just lgtm (no !) heh -S PS Notice the funky new stylings thanks to Jake Dahn! From: Josh Kearney [j...@jk0.org] Sent: Wednesday, September 07, 2011 12:05 PM To: Soren Hansen Cc: Sandy Walsh; openstack@lists.launchpad.net Subject: Re: [Openstack] A possible

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-07 Thread Sandy Walsh
of. -S From: Jay Pipes [jaypi...@gmail.com] Sent: Wednesday, September 07, 2011 12:24 PM To: Sandy Walsh Cc: Josh Kearney; Soren Hansen; openstack@lists.launchpad.net Subject: Re: [Openstack] A possible alternative to Gerrit ... On Wed, Sep 7, 2011 at 11:18

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-05 Thread Sandy Walsh
I don't think there's any proposal to stop gated trunk nor to bypass initial approval from CI. The intention of integrating hubcap and roundabout is to provide these two critical pieces of functionality, but simply remove gerrit from the equation. That said, whether we use roundabout or use

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-05 Thread Sandy Walsh
[smaffu...@gmail.com] Sent: Monday, September 05, 2011 12:35 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] A possible alternative to Gerrit ... 2011/9/5 Sandy Walsh sandy.wa...@rackspace.commailto:sandy.wa...@rackspace.com That said, whether we use roundabout or use the code

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-04 Thread Sandy Walsh
The coarse status granularity of GitHub's pull request is a non-starter for automated patch queue management and a gated trunk. Period. Solutions such as roundabout and hubcap must use hacks such as looking in review comments for one or more lgtms to determine if a commit is approved to be

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-03 Thread Sandy Walsh
Thanks Jay, I was messing around with my website last night (adding django) ... so the new url of the mockup is http://www.darksecretsoftware.com/static/hubcap.html -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net

Re: [Openstack] A possible alternative to Gerrit ...

2011-09-02 Thread Sandy Walsh
Subject: Re: [Openstack] A possible alternative to Gerrit ... Sandy Walsh wrote: Last night I did some hacking on HubCap. HubCap is a simple script that monitors Pull Requests in GitHub. It spits out a static HTML page of the requests workflow status. [...] I won't speak on behalf of Monty Taylor

[Openstack] A possible alternative to Gerrit ...

2011-09-01 Thread Sandy Walsh
Hey! Last night I did some hacking on HubCap. HubCap is a simple script that monitors Pull Requests in GitHub. It spits out a static HTML page of the requests workflow status. It infers workflow status by looking for keywords in the comments. It's so simple it's stupid. The last keyword from

Re: [Openstack] New nova service proposal

2011-08-29 Thread Sandy Walsh
I also considered making it part of the existing scheduler service, but wasn't sure how to add a time-delayed message to the scheduler queue for the follow-up. If that's possible, then there would not need to be a separate service; the scheduler can simply follow up itself. Unless

Re: [Openstack] Why are we using github again?

2011-08-26 Thread Sandy Walsh
How is this: http://wiki.openstack.org/GerritWorkflow Better than this: http://wiki.openstack.org/LifeWithBzrAndLaunchpad At the last summit, we said it wasn't a bzr vs git issue but, rather, a workflow issue. People hated LP and loved github. But now it seems we're only using github for git.

Re: [Openstack] Why are we using github again?

2011-08-26 Thread Sandy Walsh
A man with one watch knows what time it is. A man with two is never sure. - Some guy From: Jesse Andrews [anotherje...@gmail.com] Sent: Friday, August 26, 2011 9:54 PM To: Sandy Walsh Cc: Josh Kearney; Johannes Erdfelt; openstack@lists.launchpad.net

Re: [Openstack] Improving test coverage and how you can help out!

2011-08-18 Thread Sandy Walsh
Soren, that's an awesome utility to have. I'll certainly be using to shore up some coverage. Nice work! -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-11 Thread Sandy Walsh
Ugh, sorry, burned again by outlook web. Let me continue ... I'm still stewing on this but at first blush this seems like an artificial abstraction. What do we really gain from having another layer above the service api's? Can't they just live at the service api? For example:

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-11 Thread Sandy Walsh
+1 I think the work really lives with formalizing the contracts at the nova.[service].api level and pushing the discrepancies into the respective public API's. -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-11 Thread Sandy Walsh
Won't an IPv6 address do that by it's very nature? -S From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf of Chris Behrens [chris.behr...@rackspace.com] Sent:

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-09 Thread Sandy Walsh
From: Jorge Williams Sent: Saturday, July 09, 2011 2:28 AM To: Sandy Walsh Cc: Soren Hansen; openstack@lists.launchpad.net Subject: Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort? On Jul 8, 2011, at 10:44 PM, Sandy Walsh wrote: Wow, really? Is EC2 really

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-08 Thread Sandy Walsh
+1 to Soren's argument that ec2 is the 1000lb gorilla and should be central to nova. We definitely need to support it with as close to 100% compatibility as we can. Sounds like the only option is to embrace and extend it. Do everything it can do, and layer on what we need provided it doesn't

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-08 Thread Sandy Walsh
Ugh ... ... but at first blush, it doesn't seem like such a *bad* thing? This email may include confidential information. If you received it in error, please delete it. ___ Mailing list: https://launchpad.net/~openstack Post to :

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-08 Thread Sandy Walsh
I don't think this is a technical issue, it's a business issue. If we want adoption, we have to reduce switching friction. Sadly, this means EC2 bugs/nuances and all. The better a job we do of this, the easier it will be for users to transition from EC2 to OpenStack and benefit from all the

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-08 Thread Sandy Walsh
Isn't there a concern of leaking internal Zone information to the outside world (particularly in the Service Provider model)? If so, we're back to the mapping table. And, when multi-instance boot commands are more common (provision me 10 servers vs. 1), then more people will be searching by

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-08 Thread Sandy Walsh
From: Jorge Williams [jorge.willi...@rackspace.com] What you are proposing that we try to achieve with EC2 what the Wine folks want to achieve with the Windows API. It's a different problem. It's a much harder problem because it involves reverse

Re: [Openstack] Cross-zone instance identifiers in EC2 API - Is it worth the effort?

2011-07-06 Thread Sandy Walsh
Agreed. That's the downside of not having control of an API. Unless we do the Embrace and Extend thing, but that just seems fraught with problems if Amazon should zig when we zag. That said, top-level Zones may still operate using EC2 API, but all child-zones may be OS-API. We'd only need

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-25 Thread Sandy Walsh
and definitely one that deserves more consideration. Thanks! -S From: Soren Hansen [so...@linux2go.dk] Sent: Tuesday, May 24, 2011 4:56 PM To: Sandy Walsh Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] OpenStack API, Reservation ID's and Num

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-25 Thread Sandy Walsh
# Flavors * # Stripes queues, but queues are lightweight anyway. Still stewing on the ramifications of all this. -S From: Vishvananda Ishaya [vishvana...@gmail.com] Sent: Wednesday, May 25, 2011 3:42 PM To: Sandy Walsh Cc: Soren Hansen; openstack@lists.launchpad.net

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-24 Thread Sandy Walsh
From: Brian Lamar [brian.la...@rackspace.com] Sent: Tuesday, May 24, 2011 11:30 AM To: Sandy Walsh Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ... Only a small scream on PUT /zones/server/ PUT would

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-24 Thread Sandy Walsh
Hmm, not sure I like changing the return type based on the input type. Return types should be consistent. From: Ed Leafe If we are going to add an optional parameter to specify the number of instances, would it be acceptable to specify that when

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-24 Thread Sandy Walsh
POST isn't an issue for me. I honestly don't know why I wrote PUT ... I blame the Canadian holiday. From: Ed Leafe On May 24, 2011, at 11:05 AM, Sandy Walsh wrote: Hmm, not sure I like changing the return type based on the input type. Return

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-24 Thread Sandy Walsh
Yup ... agreed. I'll press on in this direction (POST with zone generated ID's) -S From: Todd Willey [t...@ansolabs.com] Sent: Tuesday, May 24, 2011 12:13 PM To: Sandy Walsh Cc: Brian Lamar; openstack@lists.launchpad.net Subject: Re: [Openstack

[Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-23 Thread Sandy Walsh
Hi everyone, We're deep into the Zone / Distributed Scheduler merges and stumbling onto an interesting problem. EC2 API has two important concepts that I don't see in OS API (1.0 or 1.1): - Reservation ID - Number of Instances to create Typical use case: Create 1000 instances. The API

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-23 Thread Sandy Walsh
Cool, I think you all understand the concerns here: 1. We can't treat the InstanceID as a ReservationID since they do two different things. InstanceID's are unique per instance and ReservationID's might span N instances. I don't like the idea of overloading these concepts. How is the caller

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-23 Thread Sandy Walsh
From: Jorge Williams So this is 2.0 API stuff -- right. Well, we need it now ... so we have to find a short term solution. Why not simply have a request on the server list with the reservation id as a parameter. This can easily be supported as an extension. So GET

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-23 Thread Sandy Walsh
code! Sandy Walsh sandy.wa...@rackspace.com said: ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp Cool, I

Re: [Openstack] OpenStack API, Reservation ID's and Num Instances ...

2011-05-23 Thread Sandy Walsh
Thanks to all for the input. I don't think we've really come to any conclusions for the near term. Unless someone screams, we will be proceeding along the following lines: 1. Adding PUT /zones/server/ to create an instance that will return a Reservation ID (a UUID). It will also accept a

Re: [Openstack] python-novaclient vs. python-openstack.compute

2011-05-18 Thread Sandy Walsh
I agree with all of your points. Having to maintain a client library wasn't on our list of fun things to do. The only thing I can see in Jacobian's python-openstack.compute branch that differs from his old Rackspace API library is the addition of the auth URL and a rebranding. We added that

Re: [Openstack] python-novaclient vs. python-openstack.compute

2011-05-18 Thread Sandy Walsh
From: Sandy Walsh Sent: Wednesday, May 18, 2011 9:07 AM To: Soren Hansen; openstack@lists.launchpad.net Subject: RE: [Openstack] python-novaclient vs. python-openstack.compute I agree with all of your points. Having to maintain a client library wasn't on our list of fun things

Re: [Openstack] python-novaclient vs. python-openstack.compute

2011-05-18 Thread Sandy Walsh
Thanks Dan, I wasn't so much worried about the technical details but rather if your group plans on making a new client or contributing to python-novaclient (or something)? Cheers, -Sandy ___ Mailing list: https://launchpad.net/~openstack Post to

Re: [Openstack] python-novaclient vs. python-openstack.compute

2011-05-18 Thread Sandy Walsh
, May 18, 2011 10:03am, Sandy Walsh sandy.wa...@rackspace.com said: Thanks Dan, I wasn't so much worried about the technical details but rather if your group plans on making a new client or contributing to python-novaclient (or something)? Cheers, -Sandy

Re: [Openstack] dist-scheduler-1 merge

2011-05-13 Thread Sandy Walsh
The HostFilter stuff is going on in here: https://code.launchpad.net/~sandy-walsh/nova/dist-sched-2a I see your point about making it easy for the user to request an instance based on a pre-defined type. I don't know how the process would go for determining what goes in the db and what stayed

Re: [Openstack] Zones / distributed scheduler question

2011-05-11 Thread Sandy Walsh
Hi Lorin, Zones can have multiple parents. Child Zones don't know their parents ... parents only know about children. Sharing services across Zones isn't permitted (since they would need to share a DB and AMQP). You could solve the problem by using the Capabilities to determine where

Re: [Openstack] Zones / distributed scheduler question

2011-05-11 Thread Sandy Walsh
-props in. Expect to see the first to land, hopefully, tomorrow. This will give you a good idea of the capabilities functionality and the extension points. You can have a sneak peak at lp:~sandy-walsh/nova/dist-sched-1 Cheers, -S From: Lorin Hochstein [lo...@isi.edu

Re: [Openstack] Zones / distributed scheduler question

2011-05-11 Thread Sandy Walsh
...@isi.edu] Sent: Thursday, May 12, 2011 12:26 AM To: Sandy Walsh Cc: Openstack; do...@pandora.east.isi.edu Subject: Re: [Openstack] Zones / distributed scheduler question Sandy: I took a quick look at see how capabilities are represented and how the information flows from the ComputeManager

Re: [Openstack] Separation of IRC Channels

2011-05-04 Thread Sandy Walsh
Yup, seems to work for Django. From: Josh Kearney [j...@jk0.org] I like this approach. On Wed, May 4, 2011 at 1:19 PM, Ant Messerli amess...@rackspace.commailto:amess...@rackspace.com wrote: So it sounds like the better path would be to just keep two channels

Re: [Openstack] Discussion on October Design Summit Locations

2011-05-04 Thread Sandy Walsh
+1 Orlando is where people go to die ... but don't. PLEASE FOR THE LOVE OF ALL THAT IS HOLY DO NOT MAKE ME GO TO ORLANDO FOR ANOTHER CONFERENCE. kthxbye Monty Confidentiality Notice: This e-mail message (including any attached or embedded documents) is intended for the exclusive and

Re: [Openstack] Proposing an Identity Service in OpenStack (a.k.a. Auth)

2011-04-18 Thread Sandy Walsh
Excellent ... timely and much needed! For completeness here is the link to Zone AuthZ requirements: http://wiki.openstack.org/FederatedAuthZwithZones http://wiki.openstack.org/FederatedAuthZwithZonesLook forward to helping out where I can. -S From:

Re: [Openstack] API for remotely controlling nova-manage

2011-04-17 Thread Sandy Walsh
I think part of the problem is there are some operations in nova-manage that require nova to not be running: - creating the initial project - creating the initial user etc for anything beyond these basic bootstrapping operations, layering something on the admin-only portion of the OS API is

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-15 Thread Sandy Walsh
Hey guys, I don't understand how adding more data to the *instances* table will be used for scheduling? Perhaps what you're talking about is metadata in Glance on the source images? If so, that data would simply be added to the required-capabilities that get passed into the scheduler during

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-15 Thread Sandy Walsh
data structures. ie. make them as rich as you like. We could replace the AZ stuff with the scheduler/zone manager approach to lessen confusion? -S From: Jay Pipes [jaypi...@gmail.com] Sent: Friday, April 15, 2011 11:37 AM To: Sandy Walsh Cc: Mark

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-15 Thread Sandy Walsh
Each update from the services are atomic updates ... fully self contained. Why does this need to be in a persistent store? -S From: Jay Pipes [jaypi...@gmail.com] you still need a persistent data store for attributes of the host. Just because you

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-15 Thread Sandy Walsh
about hadoop ... didn't know that! -S From: Jagane Sundar [jag...@sundar.org] Sent: Friday, April 15, 2011 3:39 PM To: Sandy Walsh; Jay Pipes; Ed Leafe Cc: Mark Washenberger; openstack@lists.launchpad.net Subject: RE: [Openstack] distributed

Re: [Openstack] Proposal for Ed Leafe to join Nova-Core

2011-04-15 Thread Sandy Walsh
+1 From: openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net [openstack-bounces+sandy.walsh=rackspace@lists.launchpad.net] on behalf of Jay Pipes [jaypi...@gmail.com] Sent: Friday, April 15, 2011 4:55 PM To: openstack@lists.launchpad.net

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-14 Thread Sandy Walsh
Let's not confuse instance metadata with Compute Node Capabilities. When scheduling, the instance has not been created yet. We have to make decisions on where the instance will ultimately reside on a number of factors: 1. the capabilities of the host hypervisor (the Compute node) 2. the

Re: [Openstack] Cactus RCFreeze now in effect

2011-04-14 Thread Sandy Walsh
Hear Hear! From: Jay Pipes [jaypi...@gmail.com] Thanks, Thierry, for all your assistance during the last couple weeks organizing the various freezes. It's a thankless job and often very frustrating. You keep your cool at all times. Thanks for that!

Re: [Openstack] Commas and semicolons

2011-04-14 Thread Sandy Walsh
From: Glen Campbell Sent: Thursday, April 14, 2011 10:37 AM To: Sandy Walsh; openstack@lists.launchpad.net Subject: Commas and semicolons On 4/14/11 6:19 AM, Sandy Walsh sandy.wa...@rackspace.com wrote: Capabilities are just multi-value key-value pairs

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-14 Thread Sandy Walsh
From: Soren Hansen [so...@openstack.org] 2. the current load the host is under I still question the usefulness of nr. 2. A host that is almost completely idle right now might be under tremendous pressure a minute from now and vice versa. Even if we had useful statistics (and trend

Re: [Openstack] distributed and heterogeneous schedulers

2011-04-14 Thread Sandy Walsh
We're just running into this problem with distributed scheduler. The problem is Provision 1000 servers ... how do we load balance this across hosts across zones? It busts the current dump the requests into the queue and let the workers feast approach in place currently. I have a plan for it,

[Openstack] Summit Talk: Information session on Zones? Any interest?

2011-04-14 Thread Sandy Walsh
I've been getting a lot of questions about Zones lately. How much interest is there for an informational session on Zones and, I guess, Distributed Scheduler and roadmap? (pending an available slot at the summit ... things are filling up quickly I gather) -S Confidentiality Notice: This

Re: [Openstack] Summit Talk: Information session on Zones? Any interest?

2011-04-14 Thread Sandy Walsh
From: Justin Santa Barbara [jus...@fathomdb.com] I would very much appreciate a Current State of Zones presentation that would precede a discussion session on what zones should look like in Diablo and beyond. We want to be sure that our zones design

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-07 Thread Sandy Walsh
From: Eric Day [e...@oddments.org] Well, they should start off with what the request specifies. For the 1.1 API, this takes the for of POST /v1.1/owner/servers/ so owner would be the owner. This could be anything depending on what the authenticated user has access to do and what the authz

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-05 Thread Sandy Walsh
Doh! I'm an idiot. Write that down. Eric, you're correct, we don't need to sync the AuthZ servers. We only need to pass the Resource Group ID's along after the user authenticates (thanks Jorge for reminding me.) This is along the lines of what you have been suggesting with different User

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-05 Thread Sandy Walsh
From: Vishvananda Ishaya [vishvana...@gmail.com] I think account/action tuple isn't too complicated. If we decide not to use use the resource_groups as tags, meaning multiple can be applied to same object, then we probably need this functionality. Or else we will have some crazy user

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-05 Thread Sandy Walsh
From: Vishvananda Ishaya [vishvana...@gmail.com] Ok so we are aggregating at the service layer. That does make optimization a bit easier. Especially if the user can specify with the OnBehalfOf idea a subset of the instances he wants to list. Yeah, previously it would have been expensive

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-04 Thread Sandy Walsh
Phew, ok, I've boiled down the various federated AuthZ discussions with eday, vish jorge. I've superseded the old blueprint since the bulk of the work is clearly in the Federated AuthZ camp and not the AuthN camp. http://wiki.openstack.org/FederatedAuthZwithZones Shorter and more succinct.

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-04 Thread Sandy Walsh
From: Eric Day [e...@oddments.org] Service Provider zones could be configured to access authz.myco.com for any authentication requests that come in for the myco.com namespace. Hmm, yes I think that might be possible (with the obvious performance concerns). My concern was that we would have

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-04 Thread Sandy Walsh
From: Vishvananda Ishaya [vishvana...@gmail.com] I don't see how one would give access to an entire organization at once. We don't need to. When a user auths into the SP world we get a set of permissions for that user from MyCo. If everyone in MyCo auth'ed against the SP they would all have

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-04 Thread Sandy Walsh
From: Vishvananda Ishaya [vishvana...@gmail.com] Eric: I agree that your suggestion is simpler, but I think we are too limited if we remove multi-membership and per- object overrides. Imagine that alice is an organization that has 10 users and a lot of instances. If i create a group

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-04 Thread Sandy Walsh
From: Eric Day [e...@oddments.org] The extra cost is this introduces a new type. If we are going with an authenticated user returning a list of accounts or account/action tuples, then having another type for resource groups seems excessive. It seems we only need one mapping layer here, not

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-01 Thread Sandy Walsh
Ishaya [vishvana...@gmail.com] Sent: Wednesday, March 30, 2011 7:29 PM To: Sandy Walsh Cc: Jay Pipes; openstack@lists.launchpad.net Subject: Re: [Openstack] Federated Identity Management (bursting and zones) I think authz is simplest if we just give it the responsibility of mapping subjects

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-04-01 Thread Sandy Walsh
For those of you following along at home ... there was a big IRC discussion around this: http://paste.openstack.org/show/1075/ Confidentiality Notice: This e-mail message (including any attached or embedded documents) is intended for the exclusive and confidential use of the individual or

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-30 Thread Sandy Walsh
So, I assuming having the auth service external, this would imply one HA Auth service per business. It would span regions, data centers, zones, etc. Otherwise it gets really messy. I've started mapping out some use cases (with event trace) here http://wiki.openstack.org/ZonesOauth It's really

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-30 Thread Sandy Walsh
From: Jon Slenk [jsl...@internap.com] I think that if the system used capabilities/ZBAC then there would be no such weird prompting. I see your point, but I'm assuming AuthZ has to be federated as well. We don't know about Alice, she lives in her private cloud. We have to ask her AuthZ system

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-30 Thread Sandy Walsh
From: Vishvananda Ishaya [vishvana...@gmail.com] So we can have a set of standard groups defined, and if Alice's AuthN returns one of those groups, she can launch. It means we will probably have to define some sort of openstack-compatible authn groups. True ... I'll give some thought to the

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-30 Thread Sandy Walsh
From: Jay Pipes [jaypi...@gmail.com] Come to think of it, there's no reason that role A would need to have similar privileges in zones X and Y. More likely than not, they would have different privileges, and therefore a federated authz service wouldn't really make sense. I see your point, I

Re: [Openstack] Feature Freeze status

2011-03-29 Thread Sandy Walsh
From: Todd Willey [t...@ansolabs.com] I, too, appreciate people taking their time to write blueprints. I also appreciate people who take time to write code, even if it doesn't come with a blueprint. People who take their creative energy to contribute to something I love earn enough favor that my

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-28 Thread Sandy Walsh
, option 2 :). The IdM solution can be extensible to support other Identity Federation protocols as well such as SAML. Khaled On Mon, Mar 28, 2011 at 11:17 AM, Jay Pipes jaypi...@gmail.commailto:jaypi...@gmail.com wrote: On Mon, Mar 28, 2011 at 10:15 AM, Sandy Walsh sandy.wa

Re: [Openstack] Federated Identity Management (bursting and zones)

2011-03-28 Thread Sandy Walsh
one last note for completeness: http://etherpad.openstack.org/r7eSWs0b8k http://etherpad.openstack.org/r7eSWs0b8k Thanks Vish ... that's what I was looking for. For others: https://code.launchpad.net/~anso/nova/authn_and_authz/+merge/52119

<    1   2   3   >