Re: [Openstack] metadata and file injection

2012-06-03 Thread William Herry
Thank you Pádraig Brady, I learn a lot, but still can not get some of them since centos has no nbd supported, I use libguestfs-mount to inject ssh-key, and I make it work you said if I can inject ssh-key, I can inject file, etc. but I don't know how I added --meta key=value to boot command, I no

Re: [Openstack] metadata and file injection

2012-06-01 Thread Pádraig Brady
On 06/01/2012 10:55 AM, William Herry wrote: > I have been spend all days to search metadata and file injection related info > with Google, > there are few doc or blog about this topic (or I am not use the proper > keyword) > I know about this is only pieces > > what I know now is: > cloud-init

[Openstack] metadata and file injection

2012-06-01 Thread William Herry
I have been spend all days to search metadata and file injection related info with Google, there are few doc or blog about this topic (or I am not use the proper keyword) I know about this is only pieces what I know now is: cloud-init can inject files to instance and a lot other things, seems only

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Scott Moser
On Tue, 10 Apr 2012, Justin Santa Barbara wrote: > Config drive can support all EC2 functionality, I believe. > > Images would need to be respun for OpenStack with config-drive, unless we > populated the config drive in a way that worked with cloud-init. (Scott?) cloud-init supports config-drive

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Michael Basnight
On Apr 10, 2012, at 6:19 PM, Angus Salkeld wrote: > On 10/04/12 15:36 -0700, Justin Santa Barbara wrote: >>> >>> The immediate use case I have in mind is to support this: >>> http://wiki.openstack.org/**PackageConfigForNova. >>> That design requi

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Angus Salkeld
On 10/04/12 15:36 -0700, Justin Santa Barbara wrote: The immediate use case I have in mind is to support this: http://wiki.openstack.org/**PackageConfigForNova. That design requires periodic checkins between an instance agent and a nova driver.

[Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
Surely if you haven't got spoofing locked down on your cloud it's game over anyway? I think we do have another potential requirement here though: it would be great to get a "machine" Keystone token securely. I think it would also be nice to be able to get the machine's automatically generated SSH

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Vishvananda Ishaya
On Apr 10, 2012, at 4:24 PM, Justin Santa Barbara wrote: > One advantage of a network metadata channel is it allows for communication > with cloud provider services without having to put a key into the vm. In > other words, the vm can be authenticated via its ipv6 address. > > Did you have a us

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Andrew Bogott
On 4/10/12 5:36 PM, Justin Santa Barbara wrote: The immediate use case I have in mind is to support this: http://wiki.openstack.org/PackageConfigForNova . That design requires periodic checkins between an instance agent and a nova driver. It certainly /could/ be implemented usi

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Steven Dake
On 04/10/2012 03:04 PM, Justin Santa Barbara wrote: > Having the ability to read config data from a runtime changeable > metadata server (rather then a config file on an injected disk) serves a > use case I am interested in. The only problem is horizontal scalability > of the metad

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
> > One advantage of a network metadata channel is it allows for communication > with cloud provider services without having to put a key into the vm. In > other words, the vm can be authenticated via its ipv6 address. > Did you have a use case in mind here? It seems that Keystone could use the I

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Vishvananda Ishaya
On Apr 10, 2012, at 3:04 PM, Justin Santa Barbara wrote: > Having the ability to read config data from a runtime changeable > metadata server (rather then a config file on an injected disk) serves a > use case I am interested in. The only problem is horizontal scalability > of the metadata serve

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
> > The immediate use case I have in mind is to support this: > http://wiki.openstack.org/**PackageConfigForNova. > That design requires periodic checkins between an instance agent and a > nova driver. It certainly /could/ be implemented using ssh,

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Andrew Bogott
On 4/10/12 5:04 PM, Justin Santa Barbara wrote: Can you please share that use case? I'm especially interested in finding use cases that would not better be better served by e.g. SSH or Zookeeper or Corosync.. The immediate use case I have in mind is to support this: http://wiki.openstack.or

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
> > Having the ability to read config data from a runtime changeable > metadata server (rather then a config file on an injected disk) serves a > use case I am interested in. The only problem is horizontal scalability > of the metadata server in this model which may not be a problem with > some ti

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Steven Dake
On 04/10/2012 12:36 PM, Andrew Bogott wrote: > What I crave is a communication channel between nova and running > instances. There was discussion at some point about extending the > metadata api to have this ability. > > Having a solid config drive standard seems like a good idea, but it > won't

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
I presume you're looking for more than SSH offers. What are the missing features you need? On Tue, Apr 10, 2012 at 12:36 PM, Andrew Bogott wrote: > What I crave is a communication channel between nova and running > instances. There was discussion at some point about extending the metadata > ap

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Duncan McGreggor
On Tue, Apr 10, 2012 at 3:12 PM, Eric Windisch wrote: > EC2 is strategically important.  I don't believe that building "gold images" > is the right focus for OpenStack. Indeed. Amazon drives a huge portion of the IaaS market today, and has an enormous impact on non-Amazon IaaS implementations/dep

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Andrew Bogott
What I crave is a communication channel between nova and running instances. There was discussion at some point about extending the metadata api to have this ability. Having a solid config drive standard seems like a good idea, but it won't get me run-time interaction, will it? -Andrew On 4

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Eric Windisch
EC2 is strategically important. I don't believe that building "gold images" is the right focus for OpenStack. Anyone wanting to use config-drive would need to support it in their images, that is a no-brainer. It should not be required that images launching in Nova via the EC2 API support con

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
Config drive can support all EC2 functionality, I believe. Images would need to be respun for OpenStack with config-drive, unless we populated the config drive in a way that worked with cloud-init. (Scott?) Personally, I'd rather our effort went into producing great images for OpenStack, than in

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Joshua Harlow
2Bphilip.day> =hp@lists.launchpad.net] On Behalf Of Scott Moser Sent: 10 April 2012 16:52 To: andrewbog...@gmail.com Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Metadata and File Injection (code summit session?) On Tue, 10 Apr 2012, Andrew Bogott wrote: > I'm r

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Justin Santa Barbara
metadata ? > > -Original Message- > From: openstack-bounces+philip.day=hp@lists.launchpad.net [mailto: > openstack-bounces+philip.day=hp@lists.launchpad.net] On Behalf Of > Scott Moser > Sent: 10 April 2012 16:52 > To: andrewbog...@gmail.com > Cc: openstack@l

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Day, Phil
: [Openstack] Metadata and File Injection (code summit session?) On Tue, 10 Apr 2012, Andrew Bogott wrote: > I'm reviving this ancient thread to ask: Will there be a code summit > session about this? And/or are there plans to start developing a > standard set of guest agents for

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Eric Windisch
I maintain my stance from pre-Diablo, that the configuration drive should be exported as a virtual cdrom device with an ISO9660 filesystem. We can generate the filesystem without root access and the filesystem is well-supported. Additionally, it lacks the patent-related issues associated with t

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Scott Moser
On Tue, 10 Apr 2012, Andrew Bogott wrote: > I'm reviving this ancient thread to ask: Will there be a code summit session > about this? And/or are there plans to start developing a standard set of > guest agents for Folsom? http://summit.openstack.org/sessions/view/100

Re: [Openstack] Metadata and File Injection (code summit session?)

2012-04-10 Thread Andrew Bogott
I'm reviving this ancient thread to ask: Will there be a code summit session about this? And/or are there plans to start developing a standard set of guest agents for Folsom? -Andrew On 12/15/11 2:34 AM, Jesse Andrews wrote: Great question. Right now there are 3 approaches to metadata/run

Re: [Openstack] Metadata and File Injection

2012-01-08 Thread Ewan Mellor
> -Original Message- > From: Scott Moser [mailto:ssmos...@gmail.com] On Behalf Of Scott Moser > Sent: 06 January 2012 08:15 > To: Ewan Mellor > Cc: Richard W.M. Jones; openstack@lists.launchpad.net > Subject: RE: [Openstack] Metadata and File Injection > > On Sun,

Re: [Openstack] Metadata and File Injection

2012-01-08 Thread Richard W.M. Jones
On Fri, Jan 06, 2012 at 06:41:28PM +, Caitlin Bestler wrote: > Is there any prospect of defining a universal agent for all virtio > guests>? (ovirt, kvm, xen, ...) Oh sure. In fact there are several :-) . qemu virt-agent (I think now called qemu-va?) . Matahari You could also consider the v

Re: [Openstack] Metadata and File Injection

2012-01-08 Thread Richard W.M. Jones
On Fri, Jan 06, 2012 at 11:04:10AM -0800, Duncan McGreggor wrote: > This does seem like an interesting project -- I've asked one of our guys > at DreamHost to do some investigation (LoE estimates, mostly) over the > next week or so, as he has time. This may be something that we're > interested in b

Re: [Openstack] Metadata and File Injection

2012-01-06 Thread Duncan McGreggor
21 December 2011 10:56 > > To: Scott Moser > > Cc: openstack@lists.launchpad.net > > Subject: Re: [Openstack] Metadata and File Injection > > > > On Thu, Dec 15, 2011 at 11:43:13AM -0500, Scott Moser wrote: > > > c.) No way to modify contents of the service aft

Re: [Openstack] Metadata and File Injection

2012-01-06 Thread Caitlin Bestler
Scott Moser wrote: > within kvm/qemu, the path that is being worked to getting host-guest > communication outside > of networking is being done via 'qemu-ga'. > http://wiki.qemu.org/Features/QAPI/GuestAgent > Thats a guest agent that would run inside. > It will communicate over a virtual ser

Re: [Openstack] Metadata and File Injection

2012-01-06 Thread Scott Moser
ember 2011 10:56 > > To: Scott Moser > > Cc: openstack@lists.launchpad.net > > Subject: Re: [Openstack] Metadata and File Injection > > > > On Thu, Dec 15, 2011 at 11:43:13AM -0500, Scott Moser wrote: > > > c.) No way to modify contents of the service after i

Re: [Openstack] Metadata and File Injection

2012-01-03 Thread Ewan Mellor
> I can't tell you how to run your business. All I know is that if a > client of mine gave me a functional requirement specification that > would > be perfectly met by DHCP, but they had a piece of paper from the > mid-90's that said "DHCP isn't allowed. Just because." on which they > refused to bu

Re: [Openstack] Metadata and File Injection

2012-01-03 Thread Soren Hansen
2012/1/2 Ewan Mellor : >> > In the context of this discussion, that means that OpenStack needs >> > to work in DHCP-free environments, because we already know of many. >> The only one I'm familiar with is Rackspace where I think (and please >> do correct me if I'm wrong) DHCP isn't used only becaus

Re: [Openstack] Metadata and File Injection

2012-01-02 Thread Ewan Mellor
> -Original Message- > From: Soren Hansen [mailto:so...@linux2go.dk] > > [Snip] > > > In the context of this discussion, that means that OpenStack needs to > > work in DHCP-free environments, because we already know of many. > > The only one I'm familiar with is Rackspace where I think (a

Re: [Openstack] Metadata and File Injection

2012-01-02 Thread Soren Hansen
2012/1/2 Ewan Mellor : >> I disagree. I think it's very important indeed whether the reasons are >> good or stupid. If they're good, they'll probably apply to others as >> well, so we need to know about them, understand them, and take >> appropriate action. If the reasons are stupid, whatever solut

Re: [Openstack] Metadata and File Injection

2012-01-02 Thread Ewan Mellor
> -Original Message- > From: Soren Hansen [mailto:so...@linux2go.dk] > Sent: 02 January 2012 02:47 > To: Ewan Mellor > Cc: Jesse Andrews; Jay Pipes; openstack@lists.launchpad.net > Subject: Re: [Openstack] Metadata and File Injection > > 2012/1/1 Ewan Mellor :

Re: [Openstack] Metadata and File Injection

2012-01-02 Thread Monty Taylor
On 01/02/2012 02:46 AM, Soren Hansen wrote: > 2012/1/1 Ewan Mellor : >> Rackspace aren't the only people to have problems with DHCP. I have >> encountered a number of enterprises where DHCP is expressly forbidden inside >> the datacenter (for good reasons or stupid ones, that's not important).

Re: [Openstack] Metadata and File Injection

2012-01-02 Thread Soren Hansen
2012/1/1 Ewan Mellor : > Rackspace aren't the only people to have problems with DHCP.  I have > encountered a number of enterprises where DHCP is expressly forbidden inside > the datacenter (for good reasons or stupid ones, that's not important). I disagree. I think it's very important indeed wh

Re: [Openstack] Metadata and File Injection

2011-12-31 Thread Ewan Mellor
pad.net > Subject: Re: [Openstack] Metadata and File Injection > > Great question. > > Right now there are 3 approaches to metadata/runtime config: > > * ec2 metadata service - http://169.254.169.254/ (used by ubuntu's > cloud-init for example) > * config driv

Re: [Openstack] Metadata and File Injection

2011-12-31 Thread Ewan Mellor
itrary files into a guest. Cheers, Ewan. From: openstack-bounces+ewan.mellor=citrix@lists.launchpad.net [mailto:openstack-bounces+ewan.mellor=citrix@lists.launchpad.net] On Behalf Of McNally, Dave Sent: 14 December 2011 06:04 To: openstack@lists.launchpad.net Subject: [Openstack] Metada

Re: [Openstack] Metadata and File Injection

2011-12-31 Thread Ewan Mellor
unchpad.net > Subject: Re: [Openstack] Metadata and File Injection > > On Thu, Dec 15, 2011 at 11:43:13AM -0500, Scott Moser wrote: > > c.) No way to modify contents of the service after instance launch. > > OK, I said 2 features, and really this one is wishlist. If we &

Re: [Openstack] Metadata and File Injection

2011-12-21 Thread Richard W.M. Jones
On Thu, Dec 15, 2011 at 11:43:13AM -0500, Scott Moser wrote: > c.) No way to modify contents of the service after instance launch. > OK, I said 2 features, and really this one is wishlist. If we had an > arbitrary key-value store that was available, the user could interact > with t

Re: [Openstack] Metadata and File Injection

2011-12-16 Thread Scott Moser
On Fri, 16 Dec 2011, John Garbutt wrote: > One use case is providing metadata to an instance before that instance > starts their network stack. A bit of an edge case, but I guess one > instance of this use case is the network injection logic used for Flat > networking. > > Would injected files cov

Re: [Openstack] Metadata and File Injection

2011-12-16 Thread John Garbutt
unchpad.net > [mailto:openstack-bounces+john.garbutt=eu.citrix@lists.launchpad.net] > On Behalf Of Vishvananda Ishaya > Sent: 15 December 2011 22:50 > To: Scott Moser > Cc: openstack@lists.launchpad.net > Subject: Re: [Openstack] Metadata and File Injection > > > On

Re: [Openstack] Metadata and File Injection

2011-12-16 Thread Scott Moser
On Thu, 15 Dec 2011, Vishvananda Ishaya wrote: > > On Dec 15, 2011, at 10:37 AM, Scott Moser wrote: > > > What does a "Server Personality" give me that cannot be accomplished > > accomplished by guest and lauching-entity agreeing on a key-value pair > > with keyname "server-personality". > > I thi

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Vishvananda Ishaya
On Dec 15, 2011, at 10:37 AM, Scott Moser wrote: > On Thu, 15 Dec 2011, Jesse Andrews wrote: > >> On Thu, Dec 15, 2011 at 8:43 AM, Scott Moser wrote: >>> I'm just curious, what are the motivations behind inventing something >>> other than the EC2 Metadata service? It is generally functional, a

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Scott Moser
On Thu, 15 Dec 2011, Jesse Andrews wrote: > On Thu, Dec 15, 2011 at 8:43 AM, Scott Moser wrote: > > I'm just curious, what are the motivations behind inventing something > > other than the EC2 Metadata service?  It is generally functional, and > > quite a lot can (and has) built atop this simple

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Jesse Andrews
On Thu, Dec 15, 2011 at 8:43 AM, Scott Moser wrote: > I'm just curious, what are the motivations behind inventing something > other than the EC2 Metadata service?  It is generally functional, and > quite a lot can (and has) built atop this simple service. I should clarify - the idea is that ec2 m

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Scott Moser
On Thu, 15 Dec 2011, Jesse Andrews wrote: > Great question. > > Right now there are 3 approaches to metadata/runtime config: > > * ec2 metadata service - http://169.254.169.254/ (used by ubuntu's > cloud-init for example) > * config drive - added in diablo > * xenstore via openstack agent - htt

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Scott Moser
> From: Jesse Andrews [mailto:anotherje...@gmail.com] > Sent: 15 December 2011 08:34 > To: Jay Pipes > Cc: McNally, Dave; openstack@lists.launchpad.net > Subject: Re: [Openstack] Metadata and File Injection > > Great question. > > Right now there are 3 approaches to metadata/r

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread McNally, Dave
nsert files? Dave -Original Message- From: Jesse Andrews [mailto:anotherje...@gmail.com] Sent: 15 December 2011 08:34 To: Jay Pipes Cc: McNally, Dave; openstack@lists.launchpad.net Subject: Re: [Openstack] Metadata and File Injection Great question. Right now there are 3 approaches to met

Re: [Openstack] Metadata and File Injection

2011-12-15 Thread Jesse Andrews
Great question. Right now there are 3 approaches to metadata/runtime config: * ec2 metadata service - http://169.254.169.254/ (used by ubuntu's cloud-init for example) * config drive - added in diablo * xenstore via openstack agent - https://launchpad.net/openstack-guest-agents * injecting fi

Re: [Openstack] Metadata and File Injection

2011-12-14 Thread Jay Pipes
On Wed, Dec 14, 2011 at 9:04 AM, McNally, Dave wrote: > Hi, > > I've recently been looking at file and metadata injection in Nova and I have > a question relating to it. > > (BTW this is based off what I have seen in nova/virt/disk.py) > > I notice that for key/value pairs specified as metadata du

[Openstack] Metadata and File Injection

2011-12-14 Thread McNally, Dave
Hi, I've recently been looking at file and metadata injection in Nova and I have a question relating to it. (BTW this is based off what I have seen in nova/virt/disk.py) I notice that for key/value pairs specified as metadata during boot of an instance these values are injected into a file /me