Re: [Openstack] Cells Status
What is a cell contra Aggregate or Zone? Den 3. okt. 2012 07:46 skrev Chris Behrens cbehr...@codestud.com følgende: Yup… looking forward to seeing those contributions! I'm working on getting the branch updated right now. - Chris On Oct 2, 2012, at 10:13 PM, Sam Morrison sorri...@gmail.com wrote: OK great, will be good to get this into master. I have some stuff relating to key pairs, security groups that I'd like to contribute. Also we are looking at the ability for you to specify the cell when booting an instance. Cheers, Sam On 02/10/2012, at 1:06 PM, Chris Behrens cbehr...@codestud.com wrote: Yup, it's done. I just have to deal with some conflicts with our internal branch and my public one.. On Oct 1, 2012, at 7:47 PM, Sam Morrison sorri...@gmail.com wrote: On 02/10/2012, at 12:33 PM, Chris Behrens cbehr...@codestud.com wrote: Thanks, Tom! I have changes to push up that add rpc versioning, etc. Maybe I can get those up tomorrow. Great! I was going to start looking into it but will hold off if you've already done it. Cheers, Sam ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Enabling logging in keystone.
Hi Dolph,
When I use user the keystone command, I am able to get proper tokens:
root@ubuntu1mailto:root@ubuntu1:~# keystone --os-username=adminUser
--os-password=secretword --os-tenant-name=openstackDemo --os-auth-url=http:/
/10.0.2.15:35357/v2.0 token-get
+---+--+
| Property | Value |
+---+--+
| expires | 2012-10-04T06:00:20Z |
| id| f10375dbe4dd4a90912ae9e6da4512e1 |
| tenant_id | 07a44f9d55694d638f41bc160c14b42e |
| user_id | 3e674f7f64ba452cb20781b8d5e26b7f |
+---+--+
root@ubuntu1mailto:root@ubuntu1:~# keystone --os-username=adminUser
--os-password=secretword --os-auth-url=http://10.0.2.15:35357/v2.0 token-get
No handlers could be found for logger keystoneclient.v2_0.client
+--+--+
| Property | Value |
+--+--+
| expires | 2012-10-04T06:00:41Z |
|id| b65af77d1ada496a929fb4991d54c147 |
| user_id | 3e674f7f64ba452cb20781b8d5e26b7f |
+--+--+
I have a naive question. What is this token? How is it used?
However, when I use the curl command, I get a page worth of something. I am
sorry but I am not familiar with the curl command. Since the above two
commands are working, my guess is it is safe to ignore the curl command output,
and that my keystone setup is correct. Would that be a safe assumption.
curl -d '{auth: {tenantName: openstackDemo, passwordCredentials:
{username: adminUser, password: secretword}}}' -H Content-type:
application/json http://10.0.2.15:35357/v2.0/tokens | python -mjson.tool
{
access: {
metadata: {
is_admin: 0,
roles: [
31ae9c8a9486481b9c25f9e8d7e2c2f2
]
},
serviceCatalog: [
{
endpoints: [
{
adminURL:
http://10.0.2.15:8774/v2/07a44f9d55694d638f41bc160c14b42e;,
id: 92ed4291f5ce431cb3677953c620ef9d,
internalURL:
http://10.0.2.15:8774/v2/07a44f9d55694d638f41bc160c14b42e;,
publicURL:
http://10.0.2.15:8774/v2/07a44f9d55694d638f41bc160c14b42e;,
region: RegionOne
}
],
endpoints_links: [],
name: nova,
type: compute
},
{
endpoints: [
{
adminURL: http://10.0.2.15:9292/v1;,
id: 8bb7d0241e144a61afb336ac7a37af68,
internalURL: http://10.0.2.15:9292/v1;,
publicURL: http://10.0.2.15:9292/v1;,
region: RegionOne
}
],
endpoints_links: [],
name: glance,
type: image
},
{
endpoints: [
{
adminURL:
http://10.0.2.15:8776/v1/07a44f9d55694d638f41bc160c14b42e;,
id: 6bccef05d60d49f78e50c8dab7a9a2eb,
internalURL:
http://10.0.2.15:8776/v1/07a44f9d55694d638f41bc160c14b42e;,
publicURL:
http://10.0.2.15:8776/v1/07a44f9d55694d638f41bc160c14b42e;,
region: RegionOne
}
],
endpoints_links: [],
name: volume,
type: volume
},
{
endpoints: [
{
adminURL: http://10.0.2.15:8773/services/Admin;,
id: 3efbabfc7e634bb0ac779a1e39ce385a,
internalURL: http://10.0.2.15:8773/services/Cloud;,
publicURL: http://10.0.2.15:8773/services/Cloud;,
region: RegionOne
}
],
endpoints_links: [],
name: ec2,
type: ec2
},
{
endpoints: [
{
adminURL: http://10.0.2.15:/v1;,
id: 1bf33c68cd70421797f05b55349abddc,
internalURL:
http://10.0.2.15:/v1/AUTH_07a44f9d55694d638f41bc160c14b42e;,
publicURL:
http://10.0.2.15:/v1/AUTH_07a44f9d55694d638f41bc160c14b42e;,
region: RegionOne
}
],
endpoints_links: [],
name: swift,
type: object-store
},
{
endpoints: [
{
adminURL: http://10.0.2.15:35357/v2.0;,
id:
[Openstack] File Injection through Horizon
Hi all, I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? Thanks in advance. -- Srikanth. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Enabling logging in keystone.
The scripted configuration openstack-manuals currently refers to (written by Lorin, CC'd here): https://github.com/nimbis/keystone-init Bugs in openstack-manuals don't really apply there :-/ I can't argue with having a scripted solution -- that's great, no doubt. However, I assume that making the scripted solution first and foremost in the manual leads most users to blindly run the script, bypassing the educational portion of the manual. Beyond that, the docs use the CLI, and the linked script uses the Python API directly, which means it will be difficult for most users to follow them both, side by side. At the very least, I'd like to move this approach to the end of the page; and ideally, the script would be managed by openstack. -Dolph On Tue, Oct 2, 2012 at 7:19 PM, Anne Gentle a...@openstack.org wrote: Comments below. With an I object. :) On Tue, Oct 2, 2012 at 6:50 PM, Dolph Mathews dolph.math...@gmail.comwrote: I find it odd that the document describes two approaches for configuring keystone -- one being a relatively undocumented, scripted approach not managed or distributed by OpenStack. Surely these two approaches will continue to evolve seperately and we'll experience more issues such as this one. Anyone have any objections to removing this scripted configuration section in favor of focusing on the existing manual approach? Sorry, I have to object after watching this page and the scripts evolve over the last 9-12 months. There just has to be a scripted option and I agree it needs to be tested and maintained. I'm fine with having the keystone script be the documented one. For a while though the scripts were populating templated catalogs (files) not populating the database. I think the best fix is to: - ensure scripts have exactly the documented names of tenants, users, etc. - patch the doc to use only the names in the script and manual in the verification step. Doc bug logged here describing the work needing done: https://bugs.launchpad.net/openstack-manuals/+bug/1060536 http://docs.openstack.org/trunk/openstack-compute/install/apt/content/setting-up-tenants-users-and-roles.html -Dolph On Tue, Oct 2, 2012 at 6:42 PM, Ahmed Al-Mehdi ah...@coraid.com wrote: Hi Dolph, I am now getting the same output as the curl command, basically Invalid Tenant. At this point root@ubuntu1:~# keystone --os-username=adminUser --os -password=secretword --os-tenant-name=service --os-auth-url=http://10.0. 2.15:35357/v2.0 token-get No handlers could be found for logger keystoneclient.client Invalid tenant (HTTP 401) Without the os-tenant-name parameter, I seem to get good' response. root@ubuntu1:~# keystone --os-username=adminUser --os -password=secretword --os-auth-url=http://10.0.2.15:35357/v2.0 token-get No handlers could be found for logger keystoneclient.v2_0.client +--+--+ | Property | Value | +--+--+ | expires | 2012-10-03T23:31:17Z | | id | 31078072aae94f5aab5c8e46ff5f6373 | | user_id | 3e674f7f64ba452cb20781b8d5e26b7f | +--+--+ At this point, I feel like I am running into issues with/in the python / PyYAML script (https://github.com/nimbis/keystone-init.git) which must not be populating info into keystone accurately and most probably not equivalent to manual steps mentioned in Deploy and Install OpenStack - Red Hat Ubuntu. I will look into the script. Regards, Ahmed. -- *From:* Dolph Mathews [dolph.math...@gmail.com] *Sent:* Tuesday, October 02, 2012 2:19 PM *To:* Ahmed Al-Mehdi *Cc:* heckj; openstack@lists.launchpad.net *Subject:* Re: [Openstack] Enabling logging in keystone. No worries, that's what a second set of eyes is for! By specifying a token and endpoint, you're bypassing the authentication process that your curl command is performing. You can test authentication with the keystone client using: $ keystone --os-username=adminUser --os-password=secretword --os-tenant-name=adminTenant --os-authurl=http://10.0.2.15:35357/v2.0http://10.0.2.15:35357/v2.0/tokens token-get But as Anne pointed out, you don't have a tenant named adminTenant. You'll also need to make sure you've granted a role to your user on the specified tenant for authorization to succeed. You can remove the tenant name argument from the token-get call to test authentication without authorization (therefore without requiring anything but a valid user in your keystone install). -Dolph On Tuesday, October 2, 2012, Ahmed Al-Mehdi wrote: Hi Dolph, Very sorry about that. With the correct token, calling keystone from the cli is working.However, the curl command is failing. Will this cause an issue down the line as I start to install glance and nova? # keystone --token 012345SECRET99TOKEN012345 --endpoint http://10.0.2.15:35357/v2.0 tenant-list
Re: [Openstack] Discussion / proposal: deleted column marker
+1. Let's do it. If we need to add some extra tests to protect against regressions, then so be it. I will help. I also think better use could be made of the notifications system. A properly defined topic namespace would go a long way to assist that. -Original Message- From: openstack-bounces+dave.haynes=hp@lists.launchpad.net [mailto:openstack-bounces+dave.haynes=hp@lists.launchpad.net] On Behalf Of Pitucha, Stanislaw Izaak Sent: 02 October 2012 17:43 To: openstack@lists.launchpad.net Subject: [Openstack] Discussion / proposal: deleted column marker Hi all, I'd like to open a discussion on a topic that's been bugging me for a number of reasons - soft deletes (by that I mean marking rows with deleted=1 in the db) and related - actions audit. Some research and speculations first... To be honest I could not find any reason why the feature is there in the first place. Here's the commit that introduced the 'deleted' columns: https://github.com/openstack/nova/commit/ae6905b9f1ef97206ee3c8722cec3b26fc0 64f38 - unfortunately the description says only Refactored orm to support atomic actions. So the guessing part starts here. These are the possible uses for soft-deletion of the database records that I could come up with: 1. safety net (recover data what was deleted by accident) 2. audit / log (preserve the information about past data) 3. some kind of micro-optimisation where update is more useful than deletion - be it speed or ease of handling foreign constraints (or not handling them straight away more likely) 4. ... no... that's all But I think there's a number of issues with that approach. First - what are the issues with the possible uses above. Then - issues that I can see otherwise. Point by point: 1. Soft-deletion probably makes some restoration possible, but I doubt there's much that could be done without full analysis of the situation. Mainly because the database is only about metainformation - the actual data users care about either goes away (ephemeral disks, memory, ...) or not (volumes, networks, ...) and is not recoverable. Since resources like ips and volumes can be just reused in other instances, not all recovery is possible anyway. Most hardcore fixes could be done by reinserting the original/reconstructed data just as easily as verifying what's safe to undelete. Both actions require looking at existing data and locking out information so it doesn't get reused while we're messing with the previous state. 2. Soft-deleted records are not great as a source of old information. This is connected to the previous point - some resources are just reused / rewritten instead of created and deleted. For example there's no record of what happens with old floating ips - the information gets overwritten when the IP is reassigned to the new instance, so the useful bits are gone. 3. This is the only thing I could come up with related to the commit message itself and the support atomic actions part. Maybe it was sometimes easier to mark something as deleted rather than managing and properly ordering deletes of a number of related entries. So with that out of the way, here's a number of issues related to soft-deletes that I run into myself: 4. Indexing all this data on a busy system is getting a bit silly. Unless you do your own cleanup of old entries, you will end up in a situation where looking up instances on a host actually looks through thousands of deleted rows even if only around 20 or so can be live and interesting. I know it's not a huge deal, but still an unnecessary cpu cycle burning. 5. Some things are just not possible to do in a safe and portable way at the moment. For example adding a new network and fixed IPs (there's a bug for that https://bugs.launchpad.net/nova/+bug/755138). I tried to fix this situation, but actually discovered that this is not possible to do using only sessions and with the 'deleted' column in place. There are ways to do it in a specific database (you can lock the whole table in mysql for example), but it's not portable then. The best you can do easily is limit the issue and hope that two inserts in different sessions won't happen at the same time. This could be easily done with an unique constraint if the 'deleted' column wasn't there. I haven't checked, but guess that anything that can be named (and should have a unique name) has the same problem - security groups, keys, instances, ... 6. The amount of data grows pretty quickly in a busy environment. It has to be cleaned up, but due to some constraints, it can't be done easily in one go. Cleanup triggers help here, but that's some additional work that needs maintenance during schema changes. Schema changes themselves get interesting when you're actually spending time converting mostly rows you really don't care about. There were also instances where migration over many steps failed for some reason on very old rows (virtual interface related, can't
Re: [Openstack] File Injection through Horizon
I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386-disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto:atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Cells Status
The simplest explanation is that Cells gives you a way to tie multiple nova deployments together under a single API. Each cell has its own DB and Rabbit, etc. This was my preso from the last summit: http://comstud.com/FolsomCells.pdf Start of diagrams: http://comstud.com/cells.pdf - Chris On Oct 2, 2012, at 11:09 PM, Endre Karlson endre.karl...@gmail.com wrote: What is a cell contra Aggregate or Zone? Den 3. okt. 2012 07:46 skrev Chris Behrens cbehr...@codestud.com følgende: Yup… looking forward to seeing those contributions! I'm working on getting the branch updated right now. - Chris On Oct 2, 2012, at 10:13 PM, Sam Morrison sorri...@gmail.com wrote: OK great, will be good to get this into master. I have some stuff relating to key pairs, security groups that I'd like to contribute. Also we are looking at the ability for you to specify the cell when booting an instance. Cheers, Sam On 02/10/2012, at 1:06 PM, Chris Behrens cbehr...@codestud.com wrote: Yup, it's done. I just have to deal with some conflicts with our internal branch and my public one.. On Oct 1, 2012, at 7:47 PM, Sam Morrison sorri...@gmail.com wrote: On 02/10/2012, at 12:33 PM, Chris Behrens cbehr...@codestud.com wrote: Thanks, Tom! I have changes to push up that add rpc versioning, etc. Maybe I can get those up tomorrow. Great! I was going to start looking into it but will hold off if you've already done it. Cheers, Sam ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Cells Status
Does this tie into Quantum / Cinder as well or? I guess this will be affected by the same thing? Endre. 2012/10/3 Chris Behrens cbehr...@codestud.com The simplest explanation is that Cells gives you a way to tie multiple nova deployments together under a single API. Each cell has its own DB and Rabbit, etc. This was my preso from the last summit: http://comstud.com/FolsomCells.pdf Start of diagrams: http://comstud.com/cells.pdf - Chris On Oct 2, 2012, at 11:09 PM, Endre Karlson endre.karl...@gmail.com wrote: What is a cell contra Aggregate or Zone? Den 3. okt. 2012 07:46 skrev Chris Behrens cbehr...@codestud.com følgende: Yup… looking forward to seeing those contributions! I'm working on getting the branch updated right now. - Chris On Oct 2, 2012, at 10:13 PM, Sam Morrison sorri...@gmail.com wrote: OK great, will be good to get this into master. I have some stuff relating to key pairs, security groups that I'd like to contribute. Also we are looking at the ability for you to specify the cell when booting an instance. Cheers, Sam On 02/10/2012, at 1:06 PM, Chris Behrens cbehr...@codestud.com wrote: Yup, it's done. I just have to deal with some conflicts with our internal branch and my public one.. On Oct 1, 2012, at 7:47 PM, Sam Morrison sorri...@gmail.com wrote: On 02/10/2012, at 12:33 PM, Chris Behrens cbehr...@codestud.com wrote: Thanks, Tom! I have changes to push up that add rpc versioning, etc. Maybe I can get those up tomorrow. Great! I was going to start looking into it but will hold off if you've already done it. Cheers, Sam ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Cells Status
First implementation requires global Quantum if you use Quantum… and global Glance. Volumes (Cinder) would also need to be global, but I don't have code appropriate for trunk to support it yet… - Chris On Oct 3, 2012, at 4:14 AM, Endre Karlson endre.karl...@gmail.com wrote: Does this tie into Quantum / Cinder as well or? I guess this will be affected by the same thing? Endre. 2012/10/3 Chris Behrens cbehr...@codestud.com The simplest explanation is that Cells gives you a way to tie multiple nova deployments together under a single API. Each cell has its own DB and Rabbit, etc. This was my preso from the last summit: http://comstud.com/FolsomCells.pdf Start of diagrams: http://comstud.com/cells.pdf - Chris On Oct 2, 2012, at 11:09 PM, Endre Karlson endre.karl...@gmail.com wrote: What is a cell contra Aggregate or Zone? Den 3. okt. 2012 07:46 skrev Chris Behrens cbehr...@codestud.com følgende: Yup… looking forward to seeing those contributions! I'm working on getting the branch updated right now. - Chris On Oct 2, 2012, at 10:13 PM, Sam Morrison sorri...@gmail.com wrote: OK great, will be good to get this into master. I have some stuff relating to key pairs, security groups that I'd like to contribute. Also we are looking at the ability for you to specify the cell when booting an instance. Cheers, Sam On 02/10/2012, at 1:06 PM, Chris Behrens cbehr...@codestud.com wrote: Yup, it's done. I just have to deal with some conflicts with our internal branch and my public one.. On Oct 1, 2012, at 7:47 PM, Sam Morrison sorri...@gmail.com wrote: On 02/10/2012, at 12:33 PM, Chris Behrens cbehr...@codestud.com wrote: Thanks, Tom! I have changes to push up that add rpc versioning, etc. Maybe I can get those up tomorrow. Great! I was going to start looking into it but will hold off if you've already done it. Cheers, Sam ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Discussion / proposal: deleted column marker
On Wed, Oct 3, 2012 at 4:46 AM, Haynes, Dave (Cloud Services) dave.hay...@hp.com wrote: +1. Let's do it. If we need to add some extra tests to protect against regressions, then so be it. I will help. I also think better use could be made of the notifications system. A properly defined topic namespace would go a long way to assist that. The ceilometer project is making *extensive* use of the existing notifications to collect metering data about resources (I expect us to be consuming notifications from all of the other OpenStack services by the time we're done). So, if you're going to change the way notifications work, please bring us into that discussion. Here are a few proposed summit sessions related to notifications, messaging in general, and ceilometer integration: http://summit.openstack.org/cfp/details/110 http://summit.openstack.org/cfp/details/113 http://summit.openstack.org/cfp/details/117 http://summit.openstack.org/cfp/details/128 Both Nick Barcet and I will be at the summit. -Original Message- From: openstack-bounces+dave.haynes=hp@lists.launchpad.net [mailto: openstack-bounces+dave.haynes=hp@lists.launchpad.net] On Behalf Of Pitucha, Stanislaw Izaak Sent: 02 October 2012 17:43 To: openstack@lists.launchpad.net Subject: [Openstack] Discussion / proposal: deleted column marker Hi all, I'd like to open a discussion on a topic that's been bugging me for a number of reasons - soft deletes (by that I mean marking rows with deleted=1 in the db) and related - actions audit. Some research and speculations first... To be honest I could not find any reason why the feature is there in the first place. Here's the commit that introduced the 'deleted' columns: https://github.com/openstack/nova/commit/ae6905b9f1ef97206ee3c8722cec3b26fc0 64f38 - unfortunately the description says only Refactored orm to support atomic actions. So the guessing part starts here. These are the possible uses for soft-deletion of the database records that I could come up with: 1. safety net (recover data what was deleted by accident) 2. audit / log (preserve the information about past data) 3. some kind of micro-optimisation where update is more useful than deletion - be it speed or ease of handling foreign constraints (or not handling them straight away more likely) 4. ... no... that's all But I think there's a number of issues with that approach. First - what are the issues with the possible uses above. Then - issues that I can see otherwise. Point by point: 1. Soft-deletion probably makes some restoration possible, but I doubt there's much that could be done without full analysis of the situation. Mainly because the database is only about metainformation - the actual data users care about either goes away (ephemeral disks, memory, ...) or not (volumes, networks, ...) and is not recoverable. Since resources like ips and volumes can be just reused in other instances, not all recovery is possible anyway. Most hardcore fixes could be done by reinserting the original/reconstructed data just as easily as verifying what's safe to undelete. Both actions require looking at existing data and locking out information so it doesn't get reused while we're messing with the previous state. 2. Soft-deleted records are not great as a source of old information. This is connected to the previous point - some resources are just reused / rewritten instead of created and deleted. For example there's no record of what happens with old floating ips - the information gets overwritten when the IP is reassigned to the new instance, so the useful bits are gone. 3. This is the only thing I could come up with related to the commit message itself and the support atomic actions part. Maybe it was sometimes easier to mark something as deleted rather than managing and properly ordering deletes of a number of related entries. So with that out of the way, here's a number of issues related to soft-deletes that I run into myself: 4. Indexing all this data on a busy system is getting a bit silly. Unless you do your own cleanup of old entries, you will end up in a situation where looking up instances on a host actually looks through thousands of deleted rows even if only around 20 or so can be live and interesting. I know it's not a huge deal, but still an unnecessary cpu cycle burning. 5. Some things are just not possible to do in a safe and portable way at the moment. For example adding a new network and fixed IPs (there's a bug for that https://bugs.launchpad.net/nova/+bug/755138). I tried to fix this situation, but actually discovered that this is not possible to do using only sessions and with the 'deleted' column in place. There are ways to do it in a specific database (you can lock the whole table in mysql for example), but it's not portable then. The best you can do easily is limit the issue and hope that two inserts in different sessions won't happen at the
Re: [Openstack] Cells Status
Ok. This took a lot longer to resolve than I expected, but here we go: https://github.com/comstud/nova/tree/cells_service This is rebased against trunk and contains a bunch of new things since the last branch: Random fixes for things that trunk broke with cells (deleting instances for one) RPC versioning (Thanks to Brian Elliott!) Split Replies and Bandwidth Updates into their own queues to better deal with them A number of admin API extensions modified to support cells (Thanks to Dragon, Alex Meade, Brian Lamar, Matt Sherborne, et al) Snapshots/backups query glance in API cell (Thanks to Iccha) Handle quotas in API cell (Thanks to Johannes for fixes!) Things are rapidly getting more kludgy because of changes in trunk that don't have any consideration for cells (because cells is not in trunk!). I'm hoping we can get this into an acceptable shape such that we can get it merged ASAP. - Chris On Oct 2, 2012, at 10:13 PM, Sam Morrison sorri...@gmail.com wrote: OK great, will be good to get this into master. I have some stuff relating to key pairs, security groups that I'd like to contribute. Also we are looking at the ability for you to specify the cell when booting an instance. Cheers, Sam On 02/10/2012, at 1:06 PM, Chris Behrens cbehr...@codestud.com wrote: Yup, it's done. I just have to deal with some conflicts with our internal branch and my public one.. On Oct 1, 2012, at 7:47 PM, Sam Morrison sorri...@gmail.com wrote: On 02/10/2012, at 12:33 PM, Chris Behrens cbehr...@codestud.com wrote: Thanks, Tom! I have changes to push up that add rpc versioning, etc. Maybe I can get those up tomorrow. Great! I was going to start looking into it but will hold off if you've already done it. Cheers, Sam ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Discussion / proposal: deleted column marker
Hi Johannes, I know the names collide here, but since this technique is known as soft-deletes... We need more namespaces :) Thanks for the idea of grepping for read_deleted. Fortunately I think the situation isn't as bad as it would seem. Let me group the places which change read_deleted in the code (many results from grep are comments). Reading only deleted entries, or all: - xenserver (instance) - cleanup tool - I don't do xen, so I'm not sure how useful is it. Anyone? - tests - can be ignored - if there is no functionality, tests can be killed - sqlalchemy api (instance) - fixed ip can reference a deleted instance (tricky situation; from the commit message: It adds a test to verify that the code works with a duplicate deleted floating_ip - this seems very wrong...) - sqlalchemy api (iscsi) - getting deleted iscsi targets which are still referenced by volume - sqlalchemy api (various) - instance migration, s3image, bandwidth, storage manager, flavors (only available from nova-manage) - compute manager (instance) - reaping deleted instances - I can't see why the same logic wouldn't apply if the rows are actually missing (needs analysis, maybe there's a reason) - compute instance_types (flavour) - apparently flavours are usually read even if they're deleted - network manager (instance) - making sure that ips/networks can be removed even if the instance is already deleted So here's what I can see: pretty much all the usage is about deleting instances or making sure parts connected to instances go away if the instance is deleted earlier. It doesn't seem right, but could be progressively fixed. It looks like another state of the instance, which could be integrated into the other state fields. Nothing else uses the deleted column explicitly (unless I missed something - possible). Ips, networks, keys, anything that actually goes away permanently (and doesn't involve a big chain of cleanup events) is never read back once it's marked as deleted. So maybe a better approach is not to remove the deleted column completely, but to start stripping it from places where it's not needed (fixed, floating ips, networks, ssh keys being good candidates). This could be done by creating a new layer over NovaBase and removing the deleted marker from NovaBase itself. Or maybe even by creating a SoftDeleteMixin and applying it to all current models, then removing it where unnecessary? That would keep the current behaviour where it's currently needed, but at the same time it would provide a known migration path to get rid of it. We could start stripping the new layer then table by table and adding unique constraints where they make sense, before trying to tackle the really tricky parts (for instances table, maybe the marker actually makes sense? maybe not? - it's definitely not going to be an easy decision/fix) Regards, Stanisław Pitucha Cloud Services Hewlett Packard -Original Message- From: openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net [mailto:openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net] On Behalf Of Johannes Erdfelt Sent: Tuesday, October 02, 2012 6:12 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Discussion / proposal: deleted column marker On Tue, Oct 02, 2012, Pitucha, Stanislaw Izaak stanislaw.pitu...@hp.com wrote: Does anyone know why soft-delete is still in place? Are there any reasons it can't / shouldn't be removed at this time? If it's possible to remove it, would you miss it? I'm certainly not a fan of the database soft-delete for many of the same reasons you've described, but there are some places where removing it would require code changes. Off the top of my head would be pretty much anywhere a context sets read_deleted to 'yes' or 'only', which is a surprising number of places now that I've done a grep. I suspect at least a handful of those cases don't need the functionality and others probably use it as a crutch around other problems. JE ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Hi Srikanth, File Injection is not available through Horizon. Atul is describing a different feature that can be used to achieve similar results. The contents of User-Data will be accessible to the instance via http://169.254.169.254/latest/user-data; - Ubuntu ships with a tool called cloud-init that makes use of this data if available. Eg One of the simple use cases for cloud-init is, if the data starts with #!, it will assume it's a shell script and download + execute it. This can, in a roundabout way, be used to achieve similar results to the file injection feature. Thanks, Kiall On Wed, Oct 3, 2012 at 12:59 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.com wrote: Hi, I am able to create an instance with the following command (along with File Injection): * * *# nova boot --file /root/inject.txt=/root/inject.txt --flavor=1 --image=4671e99b-1c01-42e8-94d6-2405a59bab57 testserver1* * * Now, what I need is to do the same from the Horizon. I will select a file to inject from Horizon and Launch the Instance, it should inject that file. Regards, Srikanth. On Wed, Oct 3, 2012 at 4:18 PM, Atul Jha atul@csscorp.com wrote: Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386-disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto: atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Thanks for the information, Kaill. Srikanth. On Wed, Oct 3, 2012 at 5:42 PM, Kiall Mac Innes ki...@managedit.ie wrote: Hi Srikanth, File Injection is not available through Horizon. Atul is describing a different feature that can be used to achieve similar results. The contents of User-Data will be accessible to the instance via http://169.254.169.254/latest/user-data; - Ubuntu ships with a tool called cloud-init that makes use of this data if available. Eg One of the simple use cases for cloud-init is, if the data starts with #!, it will assume it's a shell script and download + execute it. This can, in a roundabout way, be used to achieve similar results to the file injection feature. Thanks, Kiall On Wed, Oct 3, 2012 at 12:59 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.com wrote: Hi, I am able to create an instance with the following command (along with File Injection): * * *# nova boot --file /root/inject.txt=/root/inject.txt --flavor=1 --image=4671e99b-1c01-42e8-94d6-2405a59bab57 testserver1* * * Now, what I need is to do the same from the Horizon. I will select a file to inject from Horizon and Launch the Instance, it should inject that file. Regards, Srikanth. On Wed, Oct 3, 2012 at 4:18 PM, Atul Jha atul@csscorp.com wrote: Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386-disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto: atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Cloud-init is also available on RHEL systems too. We're using it extensively to contextualise VMs on Scientific Linux. We've even tried a windows version but this is not as functional. Tim From: openstack-bounces+tim.bell=cern...@lists.launchpad.net [mailto:openstack-bounces+tim.bell=cern...@lists.launchpad.net] On Behalf Of Kiall Mac Innes Sent: 03 October 2012 14:13 To: Srikanth Kumar Lingala Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon Hi Srikanth, File Injection is not available through Horizon. Atul is describing a different feature that can be used to achieve similar results. The contents of User-Data will be accessible to the instance via http://169.254.169.254/latest/user-data; - Ubuntu ships with a tool called cloud-init that makes use of this data if available. Eg One of the simple use cases for cloud-init is, if the data starts with #!, it will assume it's a shell script and download + execute it. This can, in a roundabout way, be used to achieve similar results to the file injection feature. Thanks, Kiall On Wed, Oct 3, 2012 at 12:59 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.com wrote: Hi, I am able to create an instance with the following command (along with File Injection): # nova boot --file /root/inject.txt=/root/inject.txt --flavor=1 --image=4671e99b-1c01-42e8-94d6-2405a59bab57 testserver1 Now, what I need is to do the same from the Horizon. I will select a file to inject from Horizon and Launch the Instance, it should inject that file. Regards, Srikanth. On Wed, Oct 3, 2012 at 4:18 PM, Atul Jha atul@csscorp.com wrote: Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386- disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto:atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Really? The same cloud-init as ubuntu uses? I had thought there was plenty of ubuntu/debian-isms hard coded? Thanks, Kiall On Wed, Oct 3, 2012 at 1:26 PM, Tim Bell tim.b...@cern.ch wrote: Cloud-init is also available on RHEL systems too. We’re using it extensively to contextualise VMs on Scientific Linux. ** ** We’ve even tried a windows version but this is not as functional. ** ** Tim ** ** *From:* openstack-bounces+tim.bell=cern...@lists.launchpad.net [mailto: openstack-bounces+tim.bell=cern...@lists.launchpad.net] *On Behalf Of *Kiall Mac Innes *Sent:* 03 October 2012 14:13 *To:* Srikanth Kumar Lingala *Cc:* openstack@lists.launchpad.net *Subject:* Re: [Openstack] File Injection through Horizon ** ** Hi Srikanth, ** ** File Injection is not available through Horizon. ** ** Atul is describing a different feature that can be used to achieve similar results. The contents of User-Data will be accessible to the instance via http://169.254.169.254/latest/user-data; - Ubuntu ships with a tool called cloud-init that makes use of this data if available. ** ** Eg One of the simple use cases for cloud-init is, if the data starts with #!, it will assume it's a shell script and download + execute it. This can, in a roundabout way, be used to achieve similar results to the file injection feature. Thanks, Kiall On Wed, Oct 3, 2012 at 12:59 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.com wrote: Hi, I am able to create an instance with the following command (along with File Injection): ** ** *# nova boot --file /root/inject.txt=/root/inject.txt --flavor=1 --image=4671e99b-1c01-42e8-94d6-2405a59bab57 testserver1* ** ** Now, what I need is to do the same from the Horizon. I will select a file to inject from Horizon and Launch the Instance, it should inject that file. ** ** Regards, Srikanth. ** ** On Wed, Oct 3, 2012 at 4:18 PM, Atul Jha atul@csscorp.com wrote: Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386-disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto: atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php ** ** ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ** ** ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
On 3 October 2012 22:27, Kiall Mac Innes ki...@managedit.ie wrote: Really? The same cloud-init as ubuntu uses? .NET service, can execute cmd.exe batch and PowerShell scripts, I believe. -- Cheers, ~Blairo ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
On 3 October 2012 22:35, Kiall Mac Innes ki...@managedit.ie wrote: Ah - I had meant the RHEL version :) That'd be why you explicitly mentioned Debian-isms! Nothing to see here... -- Cheers, ~Blairo ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Yes, we're running the RHEL EPEL and the Fedora one. The source is marked as http://launchpad.net/cloud-init rpm -qi cloud-init-0.6.3-0.5.bzr532.fc17.noarch Name: cloud-init Version : 0.6.3 Release : 0.5.bzr532.fc17 Architecture: noarch Install Date: Tue 02 Oct 2012 12:31:18 PM CEST Group : System Environment/Base Size: 477568 License : GPLv3 Signature : RSA/SHA256, Mon 17 Sep 2012 12:01:39 AM CEST, Key ID 50e94c991aca3465 Source RPM : cloud-init-0.6.3-0.5.bzr532.fc17.src.rpm Build Date : Fri 14 Sep 2012 06:57:21 AM CEST Build Host : buildvm-15.phx2.fedoraproject.org Relocations : (not relocatable) Packager: Fedora Project Vendor : Fedora Project URL : http://launchpad.net/cloud-init Summary : Cloud instance init scripts Description : Cloud-init is a set of init scripts for cloud instances. Cloud instances need special scripts to run during initialization to retrieve and install ssh keys and to let the user run various scripts. Tim -Original Message- From: Blair Bethwaite [mailto:blair.bethwa...@gmail.com] Sent: 03 October 2012 14:39 To: Kiall Mac Innes Cc: Tim Bell; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon On 3 October 2012 22:35, Kiall Mac Innes ki...@managedit.ie wrote: Ah - I had meant the RHEL version :) That'd be why you explicitly mentioned Debian-isms! Nothing to see here... -- Cheers, ~Blairo smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Discussion / proposal: deleted column marker
I *think* deleted flavours used to be needed as there could still be instances running against them and the flavour definition was used by the quota calculations. Not sure if this is still the case, or if the data now comes straight from the instances table.Some aspects of a flavour (e.g. rxtx_factor) could be useful to a scheduler, and that data currently isn't saved into the instance. I guess the usage audit type functionality (i.e. tell me about all instances that have run sometime in this audit period) may be another case where deleted instances are required at the moment. -Original Message- From: openstack-bounces+philip.day=hp@lists.launchpad.net [mailto:openstack-bounces+philip.day=hp@lists.launchpad.net] On Behalf Of Pitucha, Stanislaw Izaak Sent: 03 October 2012 13:09 To: openstack@lists.launchpad.net Subject: Re: [Openstack] Discussion / proposal: deleted column marker Hi Johannes, I know the names collide here, but since this technique is known as soft-deletes... We need more namespaces :) Thanks for the idea of grepping for read_deleted. Fortunately I think the situation isn't as bad as it would seem. Let me group the places which change read_deleted in the code (many results from grep are comments). Reading only deleted entries, or all: - xenserver (instance) - cleanup tool - I don't do xen, so I'm not sure how useful is it. Anyone? - tests - can be ignored - if there is no functionality, tests can be killed - sqlalchemy api (instance) - fixed ip can reference a deleted instance (tricky situation; from the commit message: It adds a test to verify that the code works with a duplicate deleted floating_ip - this seems very wrong...) - sqlalchemy api (iscsi) - getting deleted iscsi targets which are still referenced by volume - sqlalchemy api (various) - instance migration, s3image, bandwidth, storage manager, flavors (only available from nova-manage) - compute manager (instance) - reaping deleted instances - I can't see why the same logic wouldn't apply if the rows are actually missing (needs analysis, maybe there's a reason) - compute instance_types (flavour) - apparently flavours are usually read even if they're deleted - network manager (instance) - making sure that ips/networks can be removed even if the instance is already deleted So here's what I can see: pretty much all the usage is about deleting instances or making sure parts connected to instances go away if the instance is deleted earlier. It doesn't seem right, but could be progressively fixed. It looks like another state of the instance, which could be integrated into the other state fields. Nothing else uses the deleted column explicitly (unless I missed something - possible). Ips, networks, keys, anything that actually goes away permanently (and doesn't involve a big chain of cleanup events) is never read back once it's marked as deleted. So maybe a better approach is not to remove the deleted column completely, but to start stripping it from places where it's not needed (fixed, floating ips, networks, ssh keys being good candidates). This could be done by creating a new layer over NovaBase and removing the deleted marker from NovaBase itself. Or maybe even by creating a SoftDeleteMixin and applying it to all current models, then removing it where unnecessary? That would keep the current behaviour where it's currently needed, but at the same time it would provide a known migration path to get rid of it. We could start stripping the new layer then table by table and adding unique constraints where they make sense, before trying to tackle the really tricky parts (for instances table, maybe the marker actually makes sense? maybe not? - it's definitely not going to be an easy decision/fix) Regards, Stanisław Pitucha Cloud Services Hewlett Packard -Original Message- From: openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net [mailto:openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net] On Behalf Of Johannes Erdfelt Sent: Tuesday, October 02, 2012 6:12 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Discussion / proposal: deleted column marker On Tue, Oct 02, 2012, Pitucha, Stanislaw Izaak stanislaw.pitu...@hp.com wrote: Does anyone know why soft-delete is still in place? Are there any reasons it can't / shouldn't be removed at this time? If it's possible to remove it, would you miss it? I'm certainly not a fan of the database soft-delete for many of the same reasons you've described, but there are some places where removing it would require code changes. Off the top of my head would be pretty much anywhere a context sets read_deleted to 'yes' or 'only', which is a surprising number of places now that I've done a grep. I suspect at least a handful of those cases don't need the functionality and others probably use it as a crutch around other problems. JE ___ Mailing list:
Re: [Openstack] Discussion / proposal: deleted column marker
On Wed, Oct 3, 2012 at 9:08 AM, Day, Phil philip@hp.com wrote: I *think* deleted flavours used to be needed as there could still be instances running against them and the flavour definition was used by the quota calculations. Not sure if this is still the case, or if the data now comes straight from the instances table.Some aspects of a flavour (e.g. rxtx_factor) could be useful to a scheduler, and that data currently isn't saved into the instance. I guess the usage audit type functionality (i.e. tell me about all instances that have run sometime in this audit period) may be another case where deleted instances are required at the moment. That data is being gathered by ceilometer now, so maybe we can do away with it in the nova database during Grizzly. Doug -Original Message- From: openstack-bounces+philip.day=hp@lists.launchpad.net [mailto: openstack-bounces+philip.day=hp@lists.launchpad.net] On Behalf Of Pitucha, Stanislaw Izaak Sent: 03 October 2012 13:09 To: openstack@lists.launchpad.net Subject: Re: [Openstack] Discussion / proposal: deleted column marker Hi Johannes, I know the names collide here, but since this technique is known as soft-deletes... We need more namespaces :) Thanks for the idea of grepping for read_deleted. Fortunately I think the situation isn't as bad as it would seem. Let me group the places which change read_deleted in the code (many results from grep are comments). Reading only deleted entries, or all: - xenserver (instance) - cleanup tool - I don't do xen, so I'm not sure how useful is it. Anyone? - tests - can be ignored - if there is no functionality, tests can be killed - sqlalchemy api (instance) - fixed ip can reference a deleted instance (tricky situation; from the commit message: It adds a test to verify that the code works with a duplicate deleted floating_ip - this seems very wrong...) - sqlalchemy api (iscsi) - getting deleted iscsi targets which are still referenced by volume - sqlalchemy api (various) - instance migration, s3image, bandwidth, storage manager, flavors (only available from nova-manage) - compute manager (instance) - reaping deleted instances - I can't see why the same logic wouldn't apply if the rows are actually missing (needs analysis, maybe there's a reason) - compute instance_types (flavour) - apparently flavours are usually read even if they're deleted - network manager (instance) - making sure that ips/networks can be removed even if the instance is already deleted So here's what I can see: pretty much all the usage is about deleting instances or making sure parts connected to instances go away if the instance is deleted earlier. It doesn't seem right, but could be progressively fixed. It looks like another state of the instance, which could be integrated into the other state fields. Nothing else uses the deleted column explicitly (unless I missed something - possible). Ips, networks, keys, anything that actually goes away permanently (and doesn't involve a big chain of cleanup events) is never read back once it's marked as deleted. So maybe a better approach is not to remove the deleted column completely, but to start stripping it from places where it's not needed (fixed, floating ips, networks, ssh keys being good candidates). This could be done by creating a new layer over NovaBase and removing the deleted marker from NovaBase itself. Or maybe even by creating a SoftDeleteMixin and applying it to all current models, then removing it where unnecessary? That would keep the current behaviour where it's currently needed, but at the same time it would provide a known migration path to get rid of it. We could start stripping the new layer then table by table and adding unique constraints where they make sense, before trying to tackle the really tricky parts (for instances table, maybe the marker actually makes sense? maybe not? - it's definitely not going to be an easy decision/fix) Regards, Stanisław Pitucha Cloud Services Hewlett Packard -Original Message- From: openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net [mailto:openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net] On Behalf Of Johannes Erdfelt Sent: Tuesday, October 02, 2012 6:12 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Discussion / proposal: deleted column marker On Tue, Oct 02, 2012, Pitucha, Stanislaw Izaak stanislaw.pitu...@hp.com wrote: Does anyone know why soft-delete is still in place? Are there any reasons it can't / shouldn't be removed at this time? If it's possible to remove it, would you miss it? I'm certainly not a fan of the database soft-delete for many of the same reasons you've described, but there are some places where removing it would require code changes. Off the top of my head would be pretty much anywhere a context sets read_deleted to 'yes' or 'only', which is a surprising number
Re: [Openstack] [openstack] Summit coverage
You mean webex remote join, that's great! Gary On Tue, Oct 2, 2012 at 10:14 PM, Matt Joyce matt.jo...@cloudscaling.comwrote: i know this was attempted for the last summit though not widely advertised. i am willing to help set up again if we have equipment on hand. -matt On Tue, Oct 2, 2012 at 9:44 PM, surya_prabha...@dell.com wrote: Hi Folks, For the folks who cannot attend the design summit, are the sessions streamed online? Surya. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] fails to launch instance
Hi all, I am running openstack on Ubuntu 12.04 (with XCP). I create an ubuntu image (Raw). The creation of the image is successful. However, when I try to launch an instance using this image, I get this error: - 2012-10-03 15:39:15 DEBUG nova.virt.xenapi.vm_utils [req-ad542f39-2dff-4567-ae6b-9e11b692781a admin demo] [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] Fetched VDIs of type 'os_raw' with UUID '5674bc5f-4649-435f-9be0-b1aeee201a17' from (pid=5918) _fetch_image /opt/stack/nova/nova/virt/xenapi/vm_utils.py:948 2012-10-03 15:39:15 ERROR nova.utils [req-ad542f39-2dff-4567-ae6b-9e11b692781a admin demo] [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] Failed to spawn, rolling back 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] Traceback (most recent call last): 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 355, in spawn 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] vdis = create_disks_step(undo_mgr) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 139, in inner 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] rv = f(*args, **kwargs) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 257, in create_disks_step 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] image_meta, block_device_info) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 224, in _create_disks 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] block_device_info=block_device_info) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vm_utils.py, line 427, in get_vdis_for_instance 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] image_type) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vm_utils.py, line 919, in _create_image 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] image_id, image_type) 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vm_utils.py, line 843, in _create_cached_image 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] root_vdi = vdis['root'] 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] KeyError: 'root' 2012-10-03 15:39:15 TRACE nova.utils [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] 2012-10-03 15:39:15 ERROR nova.compute.manager [req-ad542f39-2dff-4567-ae6b-9e11b692781a admin demo] [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] Instance failed to spawn 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] Traceback (most recent call last): 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/compute/manager.py, line 748, in _spawn 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] block_device_info) 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/driver.py, line 179, in spawn 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] admin_password, network_info, block_device_info) 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 369, in spawn 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] undo_mgr.rollback_and_reraise(msg=msg, instance=instance) 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/utils.py, line 1315, in rollback_and_reraise 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] self._rollback() 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /usr/lib/python2.7/contextlib.py, line 24, in __exit__ 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] self.gen.next() 2012-10-03 15:39:15 TRACE nova.compute.manager [instance: ea4d2039-64c3-4f6f-a866-84db1f0e3693] File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 355, in spawn 2012-10-03 15:39:15 TRACE nova.compute.manager [instance:
Re: [Openstack] Discussion / proposal: deleted column marker
+1 to the design proposed here. Even without embracing anything nova specific but simply from a database perspective the soft-delete approach is proven to be a poor solution to most of the problems it promises to solve. In addition to what Stan already pointed out, let me recap something that you may already know but so that we have a complete picture, this time solely from a db point of view: - restoring a record is more than doing set deleted=0. It is about recovering the all graph of references in the database. Beside the complexity of a restore procedure, it makes not possible to selectively recover just the information we want. - tables grow also when alive data (deleted=0) are a small percentage of the total. This takes more space/time for backups and maintenance operations. - all queries require for every table involved an additional filter on deleted=0 and thus an additional scan, even though likely most DBMS are able to optimize queries discriminating on a binary flag. - using unique constraints and foreign keys is impossible. The nova database schema is now holding more foreign keys than in the old days, but unless normal deletions are performed they are worthless as they cannot protect the database from inconsistencies. And in Nova we saw a certain number of inconsistencies arising in a large usage context. What the soft delete approach tries (badly) to do is in practice to keep an archive of historical data. The best archiving solution could be left to the choice of the single vendor for the time being (until a more comprehensive notification system is in place), since every major DBMS provides its own facilities to implement it. In MySQL as in many other databases you can write db triggers which insert the row being deleted to a shadow table in the same db or in another db. Cheers, Federico Innocenti ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Discussion / proposal: deleted column marker
+1 to the design proposed here Looks like there is already a session proposed for Grizzly summit: http://summit.openstack.org/cfp/details/63 best, Joe On Wed, Oct 3, 2012 at 10:07 AM, Federico Innocenti federico.innoce...@hp.com wrote: +1 to the design proposed here. Even without embracing anything nova specific but simply from a database perspective the soft-delete approach is proven to be a poor solution to most of the problems it promises to solve. In addition to what Stan already pointed out, let me recap something that you may already know but so that we have a complete picture, this time solely from a db point of view: - restoring a record is more than doing set deleted=0. It is about recovering the all graph of references in the database. Beside the complexity of a restore procedure, it makes not possible to selectively recover just the information we want. - tables grow also when alive data (deleted=0) are a small percentage of the total. This takes more space/time for backups and maintenance operations. - all queries require for every table involved an additional filter on deleted=0 and thus an additional scan, even though likely most DBMS are able to optimize queries discriminating on a binary flag. - using unique constraints and foreign keys is impossible. The nova database schema is now holding more foreign keys than in the old days, but unless normal deletions are performed they are worthless as they cannot protect the database from inconsistencies. And in Nova we saw a certain number of inconsistencies arising in a large usage context. What the soft delete approach tries (badly) to do is in practice to keep an archive of historical data. The best archiving solution could be left to the choice of the single vendor for the time being (until a more comprehensive notification system is in place), since every major DBMS provides its own facilities to implement it. In MySQL as in many other databases you can write db triggers which insert the row being deleted to a shadow table in the same db or in another db. Cheers, Federico Innocenti __**_ Mailing list: https://launchpad.net/~**openstackhttps://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~**openstackhttps://launchpad.net/~openstack More help : https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Summit coverage
Webex would be a great idea. From: Gary Guo [javag...@gmail.com] Sent: Wednesday, October 03, 2012 8:48 PM To: Matt Joyce Cc: Prabhakar, Surya; openstack@lists.launchpad.net Subject: Re: [Openstack] [openstack] Summit coverage You mean webex remote join, that's great! Gary On Tue, Oct 2, 2012 at 10:14 PM, Matt Joyce matt.jo...@cloudscaling.commailto:matt.jo...@cloudscaling.com wrote: i know this was attempted for the last summit though not widely advertised. i am willing to help set up again if we have equipment on hand. -matt On Tue, Oct 2, 2012 at 9:44 PM, surya_prabha...@dell.commailto:surya_prabha...@dell.com wrote: Hi Folks, For the folks who cannot attend the design summit, are the sessions streamed online? Surya. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] When will the distro (specifically Ubuntu) have package for Folsom release
I am really confused about this. There are two pages that suggest the cloud archive is ready to use: http://blog.canonical.com/2012/09/14/now-you-can-have-your-openstack-cake-and-eat-it/ https://wiki.ubuntu.com/ServerTeam/CloudArchive What they tell you to put in /etc/apt/sources.list is different, but both give errors like this after putting the lines in and doing 'apt-get update': Reading package lists... Done W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-proposed/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-updates/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA u Can any one in the know explain what the real story about this? Or am I just doing something wrong? -David On 10/1/2012 1:20 PM, Nathanael Burton wrote: From the release notes: http://wiki.openstack.org/ReleaseNotes/Folsom#Ubuntu_12.04_.2BAC8_Ubuntu_12.10 On Oct 1, 2012 1:17 PM, Matt Joyce matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.com wrote: I am not sure indecently was the word you were looking for there. But I gather you are asking if Ubuntu is packaging folsom on their own (as in it's not part of openstack). So yes, Ubuntu is packaging folsom on their own. And I assume ubuntu will let people know when they are done packaging. They tend to be pretty good about that sort of thing. -Matt On Mon, Oct 1, 2012 at 10:02 AM, Ahmed Al-Mehdi ah...@coraid.com mailto:ah...@coraid.com wrote: Hello, Does anybody know when will the distress, specifically Ubuntu, have packages for the OpenStack Folsom release. Is this effort done indecently of OpenStack by Ubuntu and the release date will be mentioned on Ubuntu's website? Regards, Ahmed. ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] When will the distro (specifically Ubuntu) have package for Folsom release
On 3 October 2012 20:06, David Kranz david.kr...@qrclab.com wrote: I am really confused about this. There are two pages that suggest the cloud archive is ready to use: http://blog.canonical.com/2012/09/14/now-you-can-have-your-openstack-cake-and-eat-it/ https://wiki.ubuntu.com/ServerTeam/CloudArchive What they tell you to put in /etc/apt/sources.list is different, but both give errors like this after putting the lines in and doing 'apt-get update': Reading package lists... Done W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-proposed/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-updates/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA u Can any one in the know explain what the real story about this? Or am I just doing something wrong? Hi David, Sorry to hear you are having problems. This is because the Ubuntu Cloud Archive is signed with a dedicated key, which isn't installed by default. Can i suggest you install it with: $ sudo apt-get install ubuntu-cloud-keyring You should then find that, $ sudo apt-get update, returns success. I noticed you are using precise-proposed/folsom and precise-updates/folsom. Thank you for helping to test the proposed archive before it hits the updates. Thanks. -- Kind Regards, Dave Walker dave.wal...@canonical.com Engineering Manager, Ubuntu Server ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] When will the distro (specifically Ubuntu) have package for Folsom release
Hi, You probably dont have the cloud archive gpg key in your ubuntu-keyring. To fix that you have to run the following command: sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com 5EDB1B62EC4926EA Regards chuck On 12-10-03 03:06 PM, David Kranz wrote: I am really confused about this. There are two pages that suggest the cloud archive is ready to use: http://blog.canonical.com/2012/09/14/now-you-can-have-your-openstack-cake-and-eat-it/ https://wiki.ubuntu.com/ServerTeam/CloudArchive What they tell you to put in /etc/apt/sources.list is different, but both give errors like this after putting the lines in and doing 'apt-get update': Reading package lists... Done W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-proposed/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA W: GPG error: http://ubuntu-cloud.archive.canonical.com precise-updates/folsom Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 5EDB1B62EC4926EA u Can any one in the know explain what the real story about this? Or am I just doing something wrong? -David On 10/1/2012 1:20 PM, Nathanael Burton wrote: From the release notes: http://wiki.openstack.org/ReleaseNotes/Folsom#Ubuntu_12.04_.2BAC8_Ubuntu_12.10 On Oct 1, 2012 1:17 PM, Matt Joyce matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.com wrote: I am not sure indecently was the word you were looking for there. But I gather you are asking if Ubuntu is packaging folsom on their own (as in it's not part of openstack). So yes, Ubuntu is packaging folsom on their own. And I assume ubuntu will let people know when they are done packaging. They tend to be pretty good about that sort of thing. -Matt On Mon, Oct 1, 2012 at 10:02 AM, Ahmed Al-Mehdi ah...@coraid.com mailto:ah...@coraid.com wrote: Hello, Does anybody know when will the distress, specifically Ubuntu, have packages for the OpenStack Folsom release. Is this effort done indecently of OpenStack by Ubuntu and the release date will be mentioned on Ubuntu's website? Regards, Ahmed. ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list:https://launchpad.net/~openstack Post to :openstack@lists.launchpad.net Unsubscribe :https://launchpad.net/~openstack More help :https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Discussion / proposal: deleted column marker
On Wed, Oct 3, 2012 at 5:42 AM, Pitucha, Stanislaw Izaak stanislaw.pitu...@hp.com wrote: ... - Add a system similar to notifications, but for auditable events - who did what with which resource at what time - in some semi-structured way that allows reviewing and summaries (basic information as separate columns + a description as a text message). I saw there was some blueprint for a cloudaudit api (https://blueprints.launchpad.net/openstack-common/+spec/cloud-audit-api), but not much happened with it for a year, so I'm assuming it's dead now. There is a django implementation of an audit API at https://launchpad.net/auditor/ (also on pypi) - this was written for precisely the use case you describe - to let auditing be done in a freeform way, to let tools query the audit history, and to let it be used from heterogeneous services. Does it fit your needs? This would allow both proper cleanup of the data and retention of what's really necessary. It would also make it possible to use unique constraints where they're really needed (mainly IP descriptions) to prevent silly mistakes. Any additional external processing of deleted records would be easier to do because the database trigger could be just set on the delete action. Thoughts, comments and critique welcome :) Let me know what you think about these issues. +1 on the whole thing :) -Rob ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] When will the distro (specifically Ubuntu) have package for Folsom release
On 10/03/2012 02:12 PM, Daviey Walker wrote: sudo apt-get install ubuntu-cloud-keyring I've updated http://wiki.ubuntu.com/ServerTeam/CloudArchive to reflect this. -- Robbie Williamson rob...@ubuntu.com robbiew[irc.freenode.net] Don't make me angry...you wouldn't like me when I'm angry. -Bruce Banner ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Summit coverage
In last summit, there were both irc channels and webex setup and i attended some sessions but apart from one or two sessions all of them were not quiet audible. I hope something better comes up for this summit. Cheers! Syed Armani On Wed, Oct 3, 2012 at 11:31 PM, surya_prabha...@dell.com wrote: Webex would be a great idea. From: Gary Guo [javag...@gmail.com] Sent: Wednesday, October 03, 2012 8:48 PM To: Matt Joyce Cc: Prabhakar, Surya; openstack@lists.launchpad.net Subject: Re: [Openstack] [openstack] Summit coverage You mean webex remote join, that's great! Gary On Tue, Oct 2, 2012 at 10:14 PM, Matt Joyce matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.com wrote: i know this was attempted for the last summit though not widely advertised. i am willing to help set up again if we have equipment on hand. -matt On Tue, Oct 2, 2012 at 9:44 PM, surya_prabha...@dell.commailto: surya_prabha...@dell.com wrote: Hi Folks, For the folks who cannot attend the design summit, are the sessions streamed online? Surya. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] instance + shutdown state
Hi all, I installed openstack on ubuntu 12.04 (with XCP). I created an ubuntu image (Raw). When I try to launch an instance, while using the ubuntu image, I get the state shutdown for the instance. Rebooting the instance does not solve the problem, because the instance is still unavailable. My log file shows this error: 2012-10-03 20:19:31 ERROR nova.manager [-] Error during ComputeManager._poll_bandwidth_usage: 'module' object has no attribute 'fetch_bandwidth' 2012-10-03 20:19:31 TRACE nova.manager Traceback (most recent call last): 2012-10-03 20:19:31 TRACE nova.manager File /opt/stack/nova/nova/manager.py, line 175, in periodic_tasks 2012-10-03 20:19:31 TRACE nova.manager task(self, context) 2012-10-03 20:19:31 TRACE nova.manager File /opt/stack/nova/nova/compute/manager.py, line 2543, in _poll_bandwidth_usage 2012-10-03 20:19:31 TRACE nova.manager bw_counters = self.driver.get_all_bw_counters(instances) 2012-10-03 20:19:31 TRACE nova.manager File /opt/stack/nova/nova/virt/xenapi/driver.py, line 313, in get_all_bw_counters 2012-10-03 20:19:31 TRACE nova.manager all_counters = self._vmops.get_all_bw_counters() 2012-10-03 20:19:31 TRACE nova.manager File /opt/stack/nova/nova/virt/xenapi/vmops.py, line 1221, in get_all_bw_counters 2012-10-03 20:19:31 TRACE nova.manager counters = vm_utils.fetch_bandwidth(self._session) 2012-10-03 20:19:31 TRACE nova.manager AttributeError: 'module' object has no attribute 'fetch_bandwidth' 2012-10-03 20:19:31 TRACE nova.manager --- Would you please help me to fix this problem? Thank you, Afef ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] What's up doc? Oct 3 2012
Hi all - Welcome to doc land, where grammarians reign and roam. Had a good discussion yesterday at the project team meeting about defining done for documentation. While projects need to have all Critical/High bugs addressed, it's difficult to define what makes a release-critical doc issue. As I said in the meeting, I've been mentally reducing importance of some (so that they are no longer release-blocking) but perhaps need to mark them as so in Launchpad. All that to say, we will keep working on docs until after the Design Summit and not cut a release for at least another 3-4 weeks. 1. In review and merged this past week: Added Fedora install instructions for Quantum. Many additions to Quantum admin documentation this week. Added an all-in-one Folsom install on Ubuntu 12.04 as an appendix to the Install / Deploy guide. New sitemap.xml should alleviate some of the Google search results oddities we've seen. Added More releases... link to docs landing pages. CLI guide is no longer one long page. Image API doc updates for 1.1. 2. High priority doc work: Need volume docs, both an API document and how to configure different storage backends. I know the Cinder team is well aware of this need. Install/deploy guide improvements to get people running Folsom - waiting packages but pointing to Ubuntu Cloud Archive in the docs now. 3. Doc work going on that I know of: Working on clarification on scripted setup for users, roles, tenants, and services. Bug logged for the keystone sample_data.sh script at https://bugs.launchpad.net/keystone/+bug/1061144 . Doc patch ready for review at: https://review.openstack.org/#/c/13984/. 4. New incoming doc requests: Bugs being logged against the install/deploy guide as more people try to get Folsom going. Big uptick in visitors to API-related docs. 5. Doc tools updates: Expecting 1.6.0 Maven plugin to land soon. Watch https://github.com/rackspace/clouddocs-maven-plugin for updates. 6. Other doc news: Reviewing summit proposals for the Documentation track. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Summit coverage
Do you know the answer to this Stefano? Endre. 2012/10/3 Syed Armani dce3...@gmail.com In last summit, there were both irc channels and webex setup and i attended some sessions but apart from one or two sessions all of them were not quiet audible. I hope something better comes up for this summit. Cheers! Syed Armani On Wed, Oct 3, 2012 at 11:31 PM, surya_prabha...@dell.com wrote: Webex would be a great idea. From: Gary Guo [javag...@gmail.com] Sent: Wednesday, October 03, 2012 8:48 PM To: Matt Joyce Cc: Prabhakar, Surya; openstack@lists.launchpad.net Subject: Re: [Openstack] [openstack] Summit coverage You mean webex remote join, that's great! Gary On Tue, Oct 2, 2012 at 10:14 PM, Matt Joyce matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.com wrote: i know this was attempted for the last summit though not widely advertised. i am willing to help set up again if we have equipment on hand. -matt On Tue, Oct 2, 2012 at 9:44 PM, surya_prabha...@dell.commailto: surya_prabha...@dell.com wrote: Hi Folks, For the folks who cannot attend the design summit, are the sessions streamed online? Surya. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Summit coverage
Indeed, I've been working with WebEx to have a good experience for remote participation this year. I'm putting together the final details before I can push a full announcement. Having the calendar of the design summit (nearly) finalized by the end of this week would help. Stay tuned for details and links to remote registration. stef On Wed 03 Oct 2012 03:24:14 PM PDT, Endre Karlson wrote: Do you know the answer to this Stefano? Endre. 2012/10/3 Syed Armani dce3...@gmail.com mailto:dce3...@gmail.com In last summit, there were both irc channels and webex setup and i attended some sessions but apart from one or two sessions all of them were not quiet audible. I hope something better comes up for this summit. Cheers! Syed Armani On Wed, Oct 3, 2012 at 11:31 PM, surya_prabha...@dell.com mailto:surya_prabha...@dell.com wrote: Webex would be a great idea. From: Gary Guo [javag...@gmail.com mailto:javag...@gmail.com] Sent: Wednesday, October 03, 2012 8:48 PM To: Matt Joyce Cc: Prabhakar, Surya; openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Subject: Re: [Openstack] [openstack] Summit coverage You mean webex remote join, that's great! Gary On Tue, Oct 2, 2012 at 10:14 PM, Matt Joyce matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.commailto:matt.jo...@cloudscaling.com mailto:matt.jo...@cloudscaling.com wrote: i know this was attempted for the last summit though not widely advertised. i am willing to help set up again if we have equipment on hand. -matt On Tue, Oct 2, 2012 at 9:44 PM, surya_prabha...@dell.com mailto:surya_prabha...@dell.commailto:surya_prabha...@dell.com mailto:surya_prabha...@dell.com wrote: Hi Folks, For the folks who cannot attend the design summit, are the sessions streamed online? Surya. ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net mailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] nova-compute on Controller Node
Hello, I am following the steps in OpenStack Install and Deploy – Red Hat Ubuntu document to setup setup the controller node ( http://docs.openstack.org/trunk/openstack-compute/install/apt/content/installing-the-cloud-controller.html ). Do I need to install nova-compute on the controller node? Maybe there is no harm, but my understanding is nova-volume needs to be installed on all Compute Nodes. Is that right? If so, in that case can I skip installing nova-compute on the Controller Node without any side effects. Thank you, Ahmed. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Enabling logging in keystone.
On Wed, Oct 3, 2012 at 8:31 AM, Dolph Mathews dolph.math...@gmail.com wrote: At the very least, I'd like to move this approach to the end of the page; and ideally, the script would be managed by openstack. There's a sample script in Keystone https://github.com/openstack/keystone/blob/master/tools/sample_data.sh although I must say that yaml is much more readable. While at the it, there's one more in Devstack https://github.com/openstack-dev/devstack/blob/master/files/keystone_data.sh so maybe replacing both with keystone-init.py + yaml, maintained in Keystone git makes sense? Cheers, Alan ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Network IP address setting in nova.conf file
Hello, I am following the steps in OpenStack Install and Deploy – RedHat Ubuntu (Folsom) to setup a Controller node. The section Configuring OpenStack Compute ( http://docs.openstack.org/trunk/openstack-compute/install/apt/content/compute-minimum-configuration-settings.html ) gives a snippet of an example of the values of parameters in the nova.conf file. The document first lists some common settings in nova.conf file. I am highlighting the following two which I am concerned about: fixed_range=192.168.100.0/24 public_interface=eth0 The Document right after gives the whole content of a sample (usable) nova.conf file for the Controller Node, in which the above settings are set as follows: fixed_range=10.0.0.0/24 public_interface=br100 I am assuming fixed_range=192.168.100.0/24 is the correct setting. However, can someone please help as to the correct setting of public_interface. And the same setting value would be applicable for the Compute Node, is that right? Thank you very much in advance. Regards, Ahmed. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Question about Keystone RBAC
Hi I also have question about RBAC. when we can setting the roles permission in Horizon? On Thu, Oct 4, 2012 at 2:56 AM, Dolph Mathews dolph.math...@rackspace.comwrote: (replying on list) RBAC policy enforce is already implemented on consuming services and default policies are provided by policy.json files (e.g. https://github.com/openstack/nova/blob/master/etc/nova/policy.json ). We haven't yet implemented a method for services to consume policy blobs from Identity API v3, /v3/policies (which itself is still in development), rather than loading policy.json files. For an example of scoping RBAC per project, see the admin_or_owner rule in nova's policy.json above. As for the efficiency of policy storage, I'm not clear on what your concerns are? -Dolph -- *From:* MS. Faraji [ms.far...@utoronto.ca] *Sent:* Wednesday, October 03, 2012 1:34 PM *To:* Dolph Mathews *Subject:* Question about Keystone RBAC Hi, I sent an email to inquire about RBAC implementation in Keystone before, and you generously shared your information. However, there are a couple of questions that I have in mind. I searched the Internet and documents; however, I did not find useful information about them. I hope you can help me to find it out. 1) Consider the enforce API is implemented, which side should use it? Service or Keystone itself. If Keystone uses this function, how does it know about the action that a user wants to perform on a resource. If service call it as an API, what is the endpoint? How services use authorization in Keystone? 2) Can roles and associated actions be defined in the scope of project or domain? For example demo can do release in project 1 but not in project 2. 3) Is the plain storage of capabilities ( no data structure) efficient? In terms of required storage space and later lookups. Thanks in advance for your help and assistance, I look forward to your response. Moh, ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] File Injection through Horizon
Hi The user data whether need cloud-init support? On Wed, Oct 3, 2012 at 6:48 PM, Atul Jha atul@csscorp.com wrote: Hi, The test step followed for user-data as follows. 1. Got image from http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-i386-disk1.img 2. Booted it from Horizon and passed the script in the file #!/bin/sh mkdir /home/ubuntu/testdir 3. Logged in to the machine with ssh -i mykey.pub ubuntu@IP And i can see the directory created. File injection via Horizon uses cloud-init and i have tested it on Ubuntu 12.04 i have no idea about other distributions. You can file more about cloud-init here :- https://help.ubuntu.com/community/CloudInit And thanks, i will add this in the doc somewhere. :) Hope it helps. Atul jha From: Shake Chen [shake.c...@gmail.com] Sent: Wednesday, October 03, 2012 2:28 PM To: Srikanth Kumar Lingala Cc: Atul Jha; openstack@lists.launchpad.net Subject: Re: [Openstack] File Injection through Horizon I also have same question. can you give us example. how to injection throuth Horizon? On Wed, Oct 3, 2012 at 3:24 PM, Srikanth Kumar Lingala srikanthkumar.ling...@gmail.commailto:srikanthkumar.ling...@gmail.com wrote: Hi Atul, Can you please guide me how to do File Injection through Horizon? Regards, Srikanth. On Wed, Oct 3, 2012 at 12:41 PM, Atul Jha atul@csscorp.commailto: atul@csscorp.com wrote: Hi, snip I have some doubts regarding File Injection. Can File Injection can be done through Horizon, while creating an Instance? While creating an Instance from Horizon, a field called 'User Data' [text area] is there. Is that field is related to File Injection? Can anyone tell me, the values we need to give for 'User Data'? /snip Yes. Cheers!! Atul Jha http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto: openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen http://www.csscorp.com/common/email-disclaimer.php -- Shake Chen ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Network IP address setting in nova.conf file
Hi Ahmed - I have logged a doc bug to clear up this mismatch: https://bugs.launchpad.net/openstack-manuals/+bug/1061352. Appreciate you asking! Here's some explanation for each setting. fixed_range - fixed block of IP addresses handed out to VMs as they're provisioned. So these could be a 10.0.0.0/4 block if you want, or the 192... block. public_interface - some say this needs to be a physical nic, but when you're running a POC on a VM on a laptop in VirtualBox for example, it can be br100. It's what DevStack defaults to. This setting indicates the interface nova-network uses to send the floating ip traffic on the correct network. So if you have nova-network on each compute node then yes, it belongs on the compute node. The Install/deploy guide walks through Flat DHCP as the network manager. If you use --network_bridge=br100 when you run the nova-manage network command, nova will set up the bridge for you. This example command uses 192.168.100.0/24 for the fixed range of IP addresses: http://docs.openstack.org/trunk/openstack-compute/install/apt/content/compute-create-network.html Hope this helps. Others on the list, feel free to correct my explanations as needed! Thanks, Anne On Wed, Oct 3, 2012 at 6:46 PM, Ahmed Al-Mehdi ah...@coraid.com wrote: Hello, I am following the steps in OpenStack Install and Deploy – RedHat Ubuntu (Folsom) to setup a Controller node. The section Configuring OpenStack Compute ( http://docs.openstack.org/trunk/openstack-compute/install/apt/content/compute-minimum-configuration-settings.html ) gives a snippet of an example of the values of parameters in the nova.conf file. The document first lists some common settings in nova.conf file. I am highlighting the following two which I am concerned about: fixed_range=192.168.100.0/24 public_interface=eth0 The Document right after gives the whole content of a sample (usable) nova.conf file for the Controller Node, in which the above settings are set as follows: fixed_range=10.0.0.0/24 public_interface=br100 I am assuming fixed_range=192.168.100.0/24 is the correct setting. However, can someone please help as to the correct setting of public_interface. And the same setting value would be applicable for the Compute Node, is that right? Thank you very much in advance. Regards, Ahmed. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Question about Keystone RBAC
That will provided by Identity API v3, currently in draft: https://github.com/openstack/identity-api/blob/master/openstack-identity-api/src/markdown/identity-api-v3.md The when is first dependent on: 1) Identity API v3 support in keystone https://review.openstack.org/#/c/12106/ 2) Identity API v3 support in keystoneclient https://review.openstack.org/#/c/12806/ 3) services need to consume the centralized policy info, probably through common middleware 4) adding UI support in horizon An open question: are you looking to modify policy per service or do you need policy granularity per endpoint? -Dolph On Wed, Oct 3, 2012 at 7:29 PM, Shake Chen shake.c...@gmail.com wrote: Hi I also have question about RBAC. when we can setting the roles permission in Horizon? On Thu, Oct 4, 2012 at 2:56 AM, Dolph Mathews dolph.math...@rackspace.com wrote: (replying on list) RBAC policy enforce is already implemented on consuming services and default policies are provided by policy.json files (e.g. https://github.com/openstack/nova/blob/master/etc/nova/policy.json ). We haven't yet implemented a method for services to consume policy blobs from Identity API v3, /v3/policies (which itself is still in development), rather than loading policy.json files. For an example of scoping RBAC per project, see the admin_or_owner rule in nova's policy.json above. As for the efficiency of policy storage, I'm not clear on what your concerns are? -Dolph -- *From:* MS. Faraji [ms.far...@utoronto.ca] *Sent:* Wednesday, October 03, 2012 1:34 PM *To:* Dolph Mathews *Subject:* Question about Keystone RBAC Hi, I sent an email to inquire about RBAC implementation in Keystone before, and you generously shared your information. However, there are a couple of questions that I have in mind. I searched the Internet and documents; however, I did not find useful information about them. I hope you can help me to find it out. 1) Consider the enforce API is implemented, which side should use it? Service or Keystone itself. If Keystone uses this function, how does it know about the action that a user wants to perform on a resource. If service call it as an API, what is the endpoint? How services use authorization in Keystone? 2) Can roles and associated actions be defined in the scope of project or domain? For example demo can do release in project 1 but not in project 2. 3) Is the plain storage of capabilities ( no data structure) efficient? In terms of required storage space and later lookups. Thanks in advance for your help and assistance, I look forward to your response. Moh, ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Shake Chen ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack-ubuntu-testing-notifications] Build Still Failing: quantal_folsom_swift_trunk #98
Title: quantal_folsom_swift_trunk General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/quantal_folsom_swift_trunk/98/Project:quantal_folsom_swift_trunkDate of build:Wed, 03 Oct 2012 16:00:33 -0400Build duration:3 min 7 secBuild cause:Started by an SCM changeBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: All recent builds failed.0ChangesWarn when killing fails with EPERMby darrelledittest/unit/common/test_manager.pyeditswift/common/manager.pyConsole Output[...truncated 2944 lines...]dch -a [d24e280] obj replicator speed updch -a [063789b] container_info returns a dictdch -a [a2ac5ef] swift constraints are now settable via configdch -a [3139760] Fix pep8 issuesdch -a [cde6d59] Fix pep8 issuesdch -a [c0537ac] Breakout search_devs & add get_builder() for reusedch -a [54e28fa] fix some formatdch -a [4d6ae96] fix some format issuredch -a [edaaa47] format some code according to pep8dch -a [46a093f] Obj replicator cleans up files where part dirs should be.dch -a [d56772a] Fix pep8 issues in test_memcached.py.dch -a [73846c2] fix update_deleted directory creation. bug 1035274dch -a [07b4c21] 1.7.1 version bumpdch -a [341da75] changelog and authors updates for 1.7 releasedch -a [2e16b1f] Update swift.common.db to us swift.cmmn.utils.jsondch -a [314d3b7] Fall back to UDP if /dev/log does not exist.dch -a [0bb5d6d] use simplejson to serialize acct/cont resultsdch -a [54a2907] bumped version to 1.7.0 to reflect current dev effortdch -a [7b664c9] Fix PEP8 issues in ./test/unit/common .dch -a [ed3b12d] Can run swift-bench across multiple cores/servers.dch -a [4a2ae2b] Upating proxy-server StatsD logging.dch -a [c509ac2] Added ability to disable fallocatedch -a [2a38a04] Remove the gettext wrapper of server_type.dch -a [9290471] x-newest cleanup code with test. Fixes bug 1037337dch -a [9bda92d] Misc. swift-bench improvements.dch -a [e1ff51c] Do not use pickle for serialization in memcache, but JSONdebcommitbzr builddeb -S -- -sa -us -ucbzr builddeb -S -- -sa -us -ucdebsign -k9935ACDC swift_1.7.5+git201210031600~quantal-0ubuntu1_source.changessbuild -d quantal-folsom -n -A swift_1.7.5+git201210031600~quantal-0ubuntu1.dscTraceback (most recent call last): File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 141, in raise esubprocess.CalledProcessError: Command '['sbuild', '-d', 'quantal-folsom', '-n', '-A', 'swift_1.7.5+git201210031600~quantal-0ubuntu1.dsc']' returned non-zero exit status 2Error in sys.excepthook:Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 68, in apport_excepthookbinary = os.path.realpath(os.path.join(os.getcwdu(), sys.argv[0]))OSError: [Errno 2] No such file or directoryOriginal exception was:Traceback (most recent call last): File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 141, in raise esubprocess.CalledProcessError: Command '['sbuild', '-d', 'quantal-folsom', '-n', '-A', 'swift_1.7.5+git201210031600~quantal-0ubuntu1.dsc']' returned non-zero exit status 2Build step 'Execute shell' marked build as failureEmail was triggered for: FailureSending email for trigger: Failure-- Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications More help : https://help.launchpad.net/ListHelp
[Openstack-ubuntu-testing-notifications] Build Still Failing: quantal_folsom_swift_trunk #99
Title: quantal_folsom_swift_trunk General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/quantal_folsom_swift_trunk/99/Project:quantal_folsom_swift_trunkDate of build:Wed, 03 Oct 2012 17:00:33 -0400Build duration:3 min 10 secBuild cause:Started by an SCM changeBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: All recent builds failed.0Changeslocal WSGI Request and Response classesby mikeeditswift/proxy/controllers/account.pyeditdoc/source/development_auth.rstedittest/unit/obj/test_server.pyeditswift/common/wsgi.pyaddswift/common/swob.pyeditswift/common/middleware/healthcheck.pyedittest/unit/common/middleware/test_domain_remap.pyedittest/unit/common/middleware/test_name_check.pyedittest/unit/common/middleware/test_memcache.pyedittest/unit/common/middleware/test_tempurl.pyedittools/pip-requireseditdoc/source/debian_package_guide.rstedittest/unit/common/middleware/test_cname_lookup.pyeditswift/common/db_replicator.pyeditswift/proxy/controllers/obj.pyedittest/unit/common/test_wsgi.pyedittest/unit/common/middleware/test_formpost.pyedittest/unit/common/middleware/test_ratelimit.pyedittest/unit/common/middleware/test_except.pyeditswift/common/middleware/catch_errors.pyeditswift/common/middleware/domain_remap.pyedittest/unit/common/middleware/test_healthcheck.pyedittest/unit/container/test_server.pyeditswift/common/middleware/staticweb.pyeditswift/common/constraints.pyeditswift/common/middleware/tempauth.pyeditswift/common/middleware/recon.pyedittest/unit/common/middleware/test_proxy_logging.pyeditswift/common/utils.pyeditdoc/source/development_saio.rsteditswift/obj/server.pyeditdoc/source/getting_started.rstedittest/unit/common/test_constraints.pyeditswift/proxy/server.pyeditswift/account/server.pyedittest/unit/common/middleware/test_tempauth.pyedittest/unit/common/middleware/test_recon.pyedittest/unit/common/middleware/test_keystoneauth.pyeditswift/proxy/controllers/container.pyeditswift/container/server.pyedittest/unit/proxy/test_server.pyeditswift/common/internal_client.pyeditswift/common/middleware/proxy_logging.pyaddtest/unit/common/test_swob.pyeditswift/common/middleware/ratelimit.pyeditswift/common/middleware/name_check.pyeditswift/common/http.pyeditswift/common/middleware/keystoneauth.pyeditswift/common/middleware/cname_lookup.pyedittest/functional/tests.pyedittest/unit/common/middleware/test_staticweb.pyedittest/unit/obj/test_internal_client.pyeditswift/proxy/controllers/base.pyedittest/unit/account/test_server.pyConsole Output[...truncated 2953 lines...]dch -a [d24e280] obj replicator speed updch -a [063789b] container_info returns a dictdch -a [a2ac5ef] swift constraints are now settable via configdch -a [3139760] Fix pep8 issuesdch -a [cde6d59] Fix pep8 issuesdch -a [c0537ac] Breakout search_devs & add get_builder() for reusedch -a [54e28fa] fix some formatdch -a [4d6ae96] fix some format issuredch -a [edaaa47] format some code according to pep8dch -a [46a093f] Obj replicator cleans up files where part dirs should be.dch -a [d56772a] Fix pep8 issues in test_memcached.py.dch -a [73846c2] fix update_deleted directory creation. bug 1035274dch -a [07b4c21] 1.7.1 version bumpdch -a [341da75] changelog and authors updates for 1.7 releasedch -a [2e16b1f] Update swift.common.db to us swift.cmmn.utils.jsondch -a [314d3b7] Fall back to UDP if /dev/log does not exist.dch -a [0bb5d6d] use simplejson to serialize acct/cont resultsdch -a [54a2907] bumped version to 1.7.0 to reflect current dev effortdch -a [7b664c9] Fix PEP8 issues in ./test/unit/common .dch -a [ed3b12d] Can run swift-bench across multiple cores/servers.dch -a [4a2ae2b] Upating proxy-server StatsD logging.dch -a [c509ac2] Added ability to disable fallocatedch -a [2a38a04] Remove the gettext wrapper of server_type.dch -a [9290471] x-newest cleanup code with test. Fixes bug 1037337dch -a [9bda92d] Misc. swift-bench improvements.dch -a [e1ff51c] Do not use pickle for serialization in memcache, but JSONdebcommitbzr builddeb -S -- -sa -us -ucbzr builddeb -S -- -sa -us -ucdebsign -k9935ACDC swift_1.7.5+git201210031700~quantal-0ubuntu1_source.changessbuild -d quantal-folsom -n -A swift_1.7.5+git201210031700~quantal-0ubuntu1.dscTraceback (most recent call last): File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 141, in raise esubprocess.CalledProcessError: Command '['sbuild', '-d', 'quantal-folsom', '-n', '-A', 'swift_1.7.5+git201210031700~quantal-0ubuntu1.dsc']' returned non-zero exit status 2Error in sys.excepthook:Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 68, in apport_excepthookbinary = os.path.realpath(os.path.join(os.getcwdu(), sys.argv[0]))OSError: [Errno 2] No such file or directoryOriginal exception was:Traceback (most recent call last): File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 141, in raise esubprocess.CalledProcessError: Command '['sbuild', '-d', 'quantal-folsom',
