[Openstack] I18n issue for OpenStack

2012-04-11 Thread Sheng Bo Hou
Hi there from OpenStack Community,

After the research done by my colleage Edward Zhang and myself, we have 
found the following issues for openstack. We have already raised bug 
https://bugs.launchpad.net/nova/+bug/974810. 

1. The ROOT cause that i18n did not work in Nova
In Nova, within nova.image, there is a python file glance.py. This file 
has a line of code GlanceClient = 
utils.import_class('glance.client.Client'),
which calls the class glance.client.Client from Glance project. Each time 
this line of code is called, the gettext domain will change from nova to 
glance. But it doesn't recover nova domain after glance client returns the 
control. So the i18n won't be correctly working in nova.

Detailed explanation: 
Within Nova.__init__.py, there is gettext.install('nova', unicode=1). If 
we want to make i18n (e.g. Chinese) work, 
we need to modify it into gettext.install('nova', [path of locale 
directory], unicode=1). The first parameter nova is the domain for i18n 
within nova project. 
However, when the code as the right image shows is called, 
gettext.install('glance', unicode=1) within glance.__init__.py will be 
called. So the domain switches 
from 'nova' to 'glance', though we are still running the nova project. 
Nova project needs 'nova' as the domain. When the domain changes, 
certainly i18n will fail.


2. Differences between the development mode and the operation mode
We are using devstack to run our environment. As we talked about changing 
gettext.install('nova', unicode=1) into 
gettext.install('nova', [path of locale directory], unicode=1) before, 
this may lead to another issue. gettext.install has a default directory, 
which is where openstack
can install its locale files, like all the .mo files. However, devstack 
does not install locale files in the default directory, which is why we 
need to make the change.
We suggest that openstack have two modes: development and operation. 
Different modes have different settings for the paths.
 

3. Improvement of the context management
There is blueprint about decoupling client code of glance from the glance 
project and there is a python-glaceclient under development. It can 
resolve i18n issue potentially, since
nova won't call glance directly and glance domain won't be loaded in nova. 
In our opinion, we would call it AVOID it rather than RESOLVE it. If we go 
one step further, 
this indicates that there is an issue for the context management. 
OpenStack has different projects and different logging environments, etc, 
which we call context.
It is natual for us to switch context b/w different program, e.g. from 
nova to glance. In nova, there is no clear management and indication that 
the context 
has been changed or clear exist for the context to switch back. The i18n 
issue is just a tip of the iceberg for the context management. It is a 
potential improvement for openstack.

We hope the above information can help OpenStack become better and we 
would like to hear more comments from our community.
Thank you very much.

Best wishes.
Vincent Hou (侯胜博)

Software Engineer, Standards Growth Team, Emerging Technology Institute, 
IBM China Software Development Lab

Tel: 86-10-82450778 Fax: 86-10-82453660
Notes ID: Sheng Bo Hou/China/IBM@IBMCNE-mail: sb...@cn.ibm.com 
Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang 
West Road, Haidian District, Beijing, P.R.C.100193
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Instance can't reach dhcp or metadata

2012-04-11 Thread Vaze, Mandar
I have never been able to get to ssh to an instance with Quantum+mélange
https://lists.launchpad.net/openstack/msg09206.html

-Mandar

From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net 
[mailto:openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] On 
Behalf Of Nicolas de BONFILS
Sent: Wednesday, April 11, 2012 1:45 AM
To: Dan Wendlandt
Cc: openstack@lists.launchpad.net
Subject: Re: [Openstack] Instance can't reach dhcp or metadata

Hi,

I can't get the ssh connection,VNC doesn't respond and 10.0.0.1 go to localhost 
(ssh to server itself)

---
Nicolas


On Tue, Apr 10, 2012 at 21:42, Dan Wendlandt 
d...@nicira.commailto:d...@nicira.com wrote:

On Tue, Apr 10, 2012 at 11:54 AM, Nicolas de BONFILS 
ndebonf...@gmail.commailto:ndebonf...@gmail.com wrote:
Things starting to work !
When I boot boot cirros image with ip 10.0.0.1, I can ssh (even if it doesn't 
accept my password), but when I lauch tty-uec image (or other) with ip starting 
at 10.0.0.2, ssh tell no route to host

If it works on one image, but not another, this is probably an issue with the 
image itself.  The no route to host error is likely because the gateway 
interface 10.0.0.1 is arping for 10.0.0.2 and not getting a response.  Perhaps 
the image is not configured to use DCHP on the interface?  Or is not correctly 
launching?  I'd use VNC to login and check it out.

Dan


I sum up the actual conf

  *   br-int as bridge in OVS, no other conf (nothing in interfaces file), 
ifconfig show a 10.0.0.1 ip
  *   nova conf got public_interface=br-int / flat_network_bridge=br-int / 
flat_interface=eth0
  *   quantum manage the assignation successfully
Thanks
---
Nicolas

___
Mailing list: 
https://launchpad.net/~openstackhttps://launchpad.net/%7Eopenstack
Post to : 
openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net
Unsubscribe : 
https://launchpad.net/~openstackhttps://launchpad.net/%7Eopenstack
More help   : https://help.launchpad.net/ListHelp



--
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.comhttp://www.nicira.com
twitter: danwendlandt
~~~



__
Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data.  If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Issue in KVM block migration

2012-04-11 Thread Razique Mahroua
Hi,it looks like the user under which libvirt is running doesn't have the rights to manage server's IF.What version of libvirt are you using ?Can I see the file /etc/libvirt/libvirtd.com ? (cat /etc/libvirt/libvirtd.conf | grep -v -e "#" -e "^$Raz
Nuage  Co - Razique Mahrouarazique.mahr...@gmail.com

Le 11 avr. 2012 à 14:48, Gurjar, Unmesh a écrit :Hi,I have setup two Compute nodes (using Openstack master branch) and configured libvirt for block migration (by following step #1 and #4 mentionedhere). In addition, I have also disabled apparmor for libvirtd profile and have an entry in ‘/etc/hosts’ of both the Compute hosts.From both the Compute hosts, I am able to connect and fetch the list of running instances on the other host (using the hostname), as follows:virsh # connectqemu+tcp://ubuntu-dev-001/systemvirsh # listThe issue is block migrating an instance between these hosts fails with the following error in the source Compute host console:libvir: QEMU error : operation failed: migration job: unexpectedly failed2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous call on network ... from (pid=18487) multicall /opt/stack/nova/nova/rpc/amqp.py:3182012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] MSG_ID is 8d91158236ae4de0bd8b89533f060892 from (pid=18487) multicall /opt/stack/nova/nova/rpc/amqp.py:3212012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous cast on compute.ubuntu-dev-001... from (pid=18487) cast /opt/stack/nova/nova/rpc/amqp.py:343Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 97, in wait readers.get(fileno, noop).cb(fileno) File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 192, in main result = function(*args, **kwargs) File "/opt/stack/nova/nova/virt/libvirt/connection.py", line 2179, in _live_migration recover_method(ctxt, instance_ref, dest, block_migration) File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ self.gen.next() File "/opt/stack/nova/nova/virt/libvirt/connection.py", line 2175, in _live_migration FLAGS.live_migration_bandwidth) File "/usr/lib/python2.7/dist-packages/libvirt.py", line 689, in migrateToURI if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)libvirtError: operation failed: migration job: unexpectedly failedRemoving descriptor: 12I find the following in the qemu log file (/var/log/libvirt/qemu/instance-0003.log ) on the destination Compute host:2012-04-11 04:14:25.971: starting upLC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin QEMU_AUDIO_DRV=none /usr/bin/kvm -S -M pc-0.14 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -name instance-0003 -uuid f58d5f32-6d55-43fb-89ed-c33ebf72d1ed -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-0003.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c -kernel /opt/stack/nova/instances/instance-0003/kernel -initrd /opt/stack/nova/instances/instance-0003/ramdisk -append root=/dev/vda console=ttyS0 -drive file=/opt/stack/nova/instances/instance-0003/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none -device virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0 -netdev tap,ifname=tapfcfa2a6c-35,script=,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:7d:32:27,bus=pci.0,addr=0x3 -chardev file,id=charserial0,path=/opt/stack/nova/instances/instance-0003/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -usb -device usb-tablet,id=input0 -vnc 127.0.0.1:0 -k en-us -vga cirrus -incoming tcp:0.0.0.0:49166 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5Domain id=15 is tainted: high-privilegesDomain id=15 is tainted: shell-scriptschar device redirected to /dev/pts/172012-04-11 04:14:26.406: shutting downcan't delete tapfcfa2a6c-35 from eth1: Operation not supportedSIOCSIFADDR: Permission deniedSIOCSIFFLAGS: Permission deniedSIOCSIFFLAGS: Permission denied/etc/qemu-ifdown: could not launch network scriptWould be great if someone can point anything that I am missing here or any configuration changes required to resolve this issue.Thanks  Regards,Unmesh Gurjar| Lead Engineer |Vertex Software Private Ltd. |w.+91.20.6604.1500 x 379 |m.+91.982.324.7631 |unmesh.gur...@nttdata.com|Follow us on Twitter@NTTDATAAmericas__Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding___Mailing 

Re: [Openstack] Issue in KVM block migration

2012-04-11 Thread Gurjar, Unmesh
Thanks Razique for taking up this one.

Libvirt version on both Compute hosts:
$ libvirtd --version
libvirtd (libvirt) 0.9.2
$ virsh --version
0.9.2

Here are my libvirtd.conf details:
listen_tls = 0
listen_tcp = 1
unix_sock_group = libvirtd
unix_sock_rw_perms = 0770
auth_unix_ro = none
auth_unix_rw = none
auth_tcp = none


Thanks  Regards,
Unmesh Gurjar | Lead Engineer | Vertex Software Private Ltd. | w. 
+91.20.6604.1500 x 379 | m. +91.982.324.7631 | 
unmesh.gur...@nttdata.commailto:unmesh.gur...@nttdata.com | Follow us on 
Twitter@NTTDATAAmericas

From: Razique Mahroua [mailto:razique.mahr...@gmail.com]
Sent: Wednesday, April 11, 2012 7:33 PM
To: Gurjar, Unmesh
Cc: openstack@lists.launchpad.net
Subject: Re: [Openstack] Issue in KVM block migration

Hi,
it looks like the user under which libvirt is running doesn't have the rights 
to manage server's IF.
What version of libvirt are you using ?
Can I see the file /etc/libvirt/libvirtd.com ? (cat /etc/libvirt/libvirtd.conf 
| grep -v -e # -e ^$

Raz

Nuage  Co - Razique Mahroua
razique.mahr...@gmail.commailto:razique.mahr...@gmail.com

[cid:image001.jpg@01CD181B.15CF4060]

Le 11 avr. 2012 à 14:48, Gurjar, Unmesh a écrit :


Hi,

I have setup two Compute nodes (using Openstack master branch) and configured 
libvirt for block migration (by  following step #1 and #4 mentioned 
herehttp://docs.openstack.org/diablo/openstack-compute/admin/content/configuring-live-migrations.html).
 In addition, I have also disabled apparmor for libvirtd profile and have an 
entry in '/etc/hosts' of both the Compute hosts.

From both the Compute hosts, I am able to connect and fetch the list of 
running instances on the other host (using the hostname), as follows:
virsh # connect qemu+tcp://ubuntu-dev-001/system
virsh # list

The issue is block migrating an instance between these hosts fails with the 
following error in the source Compute host console:
libvir: QEMU error : operation failed: migration job: unexpectedly failed
2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous call on network 
... from (pid=18487) multicall /opt/stack/nova/nova/rpc/amqp.py:318
2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] MSG_ID is 
8d91158236ae4de0bd8b89533f060892 from (pid=18487) multicall 
/opt/stack/nova/nova/rpc/amqp.py:321
2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous cast on 
compute.ubuntu-dev-001... from (pid=18487) cast 
/opt/stack/nova/nova/rpc/amqp.py:343
Traceback (most recent call last):
  File /usr/lib/python2.7/dist-packages/eventlet/hubs/poll.py, line 97, in 
wait
readers.get(fileno, noop).cb(fileno)
  File /usr/lib/python2.7/dist-packages/eventlet/greenthread.py, line 192, in 
main
result = function(*args, **kwargs)
  File /opt/stack/nova/nova/virt/libvirt/connection.py, line 2179, in 
_live_migration
recover_method(ctxt, instance_ref, dest, block_migration)
  File /usr/lib/python2.7/contextlib.py, line 24, in __exit__
self.gen.next()
  File /opt/stack/nova/nova/virt/libvirt/connection.py, line 2175, in 
_live_migration
FLAGS.live_migration_bandwidth)
  File /usr/lib/python2.7/dist-packages/libvirt.py, line 689, in migrateToURI
if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', 
dom=self)
libvirtError: operation failed: migration job: unexpectedly failed
Removing descriptor: 12

I find the following in the qemu log file 
(/var/log/libvirt/qemu/instance-0003.log ) on the destination Compute host:
2012-04-11 04:14:25.971: starting up
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin 
QEMU_AUDIO_DRV=none /usr/bin/kvm -S -M pc-0.14 -enable-kvm -m 512 -smp 
1,sockets=1,cores=1,threads=1 -name instance-0003 -uuid 
f58d5f32-6d55-43fb-89ed-c33ebf72d1ed -nodefconfig -nodefaults -chardev 
socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-0003.monitor,server,nowait
 -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c 
-kernel /opt/stack/nova/instances/instance-0003/kernel -initrd 
/opt/stack/nova/instances/instance-0003/ramdisk -append root=/dev/vda 
console=ttyS0 -drive 
file=/opt/stack/nova/instances/instance-0003/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none
 -device 
virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0 
-netdev tap,ifname=tapfcfa2a6c-35,script=,id=hostnet0 -device 
rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:7d:32:27,bus=pci.0,addr=0x3 
-chardev 
file,id=charserial0,path=/opt/stack/nova/instances/instance-0003/console.log
 -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 
-device isa-serial,chardev=charserial1,id=serial1 -usb -device 
usb-tablet,id=input0 -vnc 127.0.0.1:0 -k en-us -vga cirrus -incoming 
tcp:0.0.0.0:49166 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
Domain id=15 is tainted: high-privileges
Domain id=15 is tainted: shell-scripts
char device redirected to /dev/pts/17
2012-04-11 04:14:26.406: shutting down
can't delete 

Re: [Openstack] EC2 compat.

2012-04-11 Thread Duncan McGreggor
Lurking on the thread, but love what I'm seeing :-)

Nice work, guys!

d

On Tue, Apr 10, 2012 at 10:43 PM, Joshua Harlow harlo...@yahoo-inc.com wrote:
 Very cool, glad to see that is being worked on, it looks pretty similar to
 what I was thinking of.
 I’m all for open dialogues.
 In fact.
 I was thinking of what is needed to make this work better.

 Open questions/thoughts/brainstorm (at least that I was thinking of):

 How strict do we want to be with the XSD? (there aren’t a lot of tolerant
 xsd validators out there, which sux)

 Should we use something like jaxb for python, that should be more tolerant
 (unsure as what the best solution here is)

 How do we continuously measure the compatibility level?

 # of test cases passing, # of xml differences, # of xsd issues

 Should we use boto as a intermediate layer? (it is very tolerant)

 From what I understand there XML code is basically selecting certain
 attributes out of the XML using SAX, then adding any unknown attributes
 dynamically on to a object

 How do we make it repeatable?

 For a given test X, if there is a problem with test X and its response Y,
 how do we easily recreate that test X and response Y (so that dev’s can fix
 it)?
 Do we have a “golden set” of responses that when test X is called it should
 match golden response Z (otherwise there is an issue)

 This is where the mock server maybe useful, in that we can point test X at
 the mock server; get the expected responses Z,
 Then point the test X at the real openstack server and get responses Y that
 should match Z (exactly, minus the request id?)
 EC2 seems to also already have some type of mocking, but I haven’t used
 it... (http://bit.ly/HJkdh7)


 I like how there is a tests folder that u guys have, that seems like it
 could be a good location for the “content checking tests” which actually
 require code/logic to dig into the XML response. It might make sense to use
 another tool to verify the XSD’s (how tolerant we want to be is an open
 question) and another tool that will show u the xml differences (some of
 which might be ok, some not). I have used in java xmlunit to do those kind
 of xml difference comparisons, it provides some nifty ways of ignoring
 certain differences and such. If say we had 3 levels of tests I think that
 would make sense (starting say from XSD validation, to difference
 comparisons to content comparisons), and would make a hell of a EC2 cool
 validation toolkit.

 The other usage of the site I was making was to list all the known error
 conditions, and any other incompatibilities that I am noticing with EC2
 (error conditions, features, parameters...). That seems really needed to
 allow for anyone to actually use the EC2 apis and handle all the cases which
 could be thrown at them.

 -Josh




 On 4/10/12 7:02 PM, Eric Windisch e...@cloudscaling.com wrote:


 Josh, as a follow-up, it would be good to keep an open dialogue on this.
 When/if you get a chance to review the aws-compat branch, I'd like to get
 your feedback as well.

 PS  I meant to write assess, not access. I only noticed when I read back
 my email. I'm too pedantic to not correct myself.



 ___
 Mailing list: https://launchpad.net/~openstack
 Post to     : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] question about keystone and dashboard on RHEL6

2012-04-11 Thread Adam Young

On 04/03/2012 09:25 AM, Russell Bryant wrote:

On 04/02/2012 08:44 PM, Xin Zhao wrote:

On 4/2/2012 6:35 PM, Russell Bryant wrote:

On 04/02/2012 03:09 PM, Xin Zhao wrote:

Hello,

I am new to OpenStack and trying to install the diablo release on a
RHEL6 cluster. I follow instructions here:
http://fedoraproject.org/wiki/Getting_started_with_OpenStack_Nova

The instruction doesn't mention how to install and configure Keystone
and dashboard services, I wonder:

1) are these two services available for RHEL6, in diablo release?
2) do I need to go to the latest Essex release, and where the
instructions is?

The dashboard, horizon, is not included with the Diablo packages that
you find in EPEL6 right now.  When we update EPEL6 to Essex, which
should be within the next few weeks, horizon will be included as well.


How about keystone, the instructions here
(http://fedoraproject.org/wiki/Getting_started_with_OpenStack_Nova) doesn't
mention how to install and configure keystone, although it tells how to
clean up keystone, which makes me think there is something
missing in the earlier sections of this instruction.

Keystone is there.  It has already been updated to one of the Essex RCs,
acutally.  As EPEL6 gets updated to Essex, these instructions will
become the ones you want to follow, and they include Keystone:

https://fedoraproject.org/wiki/Getting_started_with_OpenStack_on_Fedora_17

I don't think that Diablo code is actually capable of using Keystone.  
Keystone is only required for Essex.


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] question about keystone and dashboard on RHEL6

2012-04-11 Thread David Busby
Diablo (at least for nova, glance, swift) is capable of using keystone
there is however a lot of manual configuration needed, something that is on
my list for complete when integrating keystone into my 2011.3 deploy per my
blog post.

All I can say at the moment is this is far from trivial, and finding
documentation on this can be a problem (if anyone on the list could correct
me on this, it would help massively and expidite my documentation of
integrating keystone with nova  glance on 2011.3)

Cheers

Davud


On Wed, Apr 11, 2012 at 4:16 PM, Adam Young ayo...@redhat.com wrote:

 On 04/03/2012 09:25 AM, Russell Bryant wrote:

 On 04/02/2012 08:44 PM, Xin Zhao wrote:

 On 4/2/2012 6:35 PM, Russell Bryant wrote:

 On 04/02/2012 03:09 PM, Xin Zhao wrote:

 Hello,

 I am new to OpenStack and trying to install the diablo release on a
 RHEL6 cluster. I follow instructions here:
 http://fedoraproject.org/wiki/**Getting_started_with_**OpenStack_Novahttp://fedoraproject.org/wiki/Getting_started_with_OpenStack_Nova

 The instruction doesn't mention how to install and configure Keystone
 and dashboard services, I wonder:

 1) are these two services available for RHEL6, in diablo release?
 2) do I need to go to the latest Essex release, and where the
 instructions is?

 The dashboard, horizon, is not included with the Diablo packages that
 you find in EPEL6 right now.  When we update EPEL6 to Essex, which
 should be within the next few weeks, horizon will be included as well.

  How about keystone, the instructions here
 (http://fedoraproject.org/**wiki/Getting_started_with_**OpenStack_Novahttp://fedoraproject.org/wiki/Getting_started_with_OpenStack_Nova)
 doesn't
 mention how to install and configure keystone, although it tells how to
 clean up keystone, which makes me think there is something
 missing in the earlier sections of this instruction.

 Keystone is there.  It has already been updated to one of the Essex RCs,
 acutally.  As EPEL6 gets updated to Essex, these instructions will
 become the ones you want to follow, and they include Keystone:

 https://fedoraproject.org/**wiki/Getting_started_with_**
 OpenStack_on_Fedora_17https://fedoraproject.org/wiki/Getting_started_with_OpenStack_on_Fedora_17

  I don't think that Diablo code is actually capable of using Keystone.
  Keystone is only required for Essex.


 __**_
 Mailing list: 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 More help   : 
 https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] ERROR: string indices must be integers, not str

2012-04-11 Thread Guilherme Birk

I've got OpenStack working with this tutorial 
http://www.hastexo.com/resources/docs/installing-openstack-essex-20121-ubuntu-1204-precise-pangolin.

Now I'm trying to deploy a new installation with the official manual, 
http://docs.openstack.org/trunk/openstack-compute/install/content/index.html. I 
can access dashboard, upload images and other things, but when I try to execute 
a nova list, or after connect to dashboard, I got this error: ERROR: string 
indices must be integers, not str.

Anyone had this problem too? Maybe some wrong configuration?

  ___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [openstack][keystone] Service isolation?

2012-04-11 Thread Jay Pipes

On 04/10/2012 09:44 PM, Nguyen, Liem Manh wrote:

Hi fellow Stackers,

I am reading http://keystone.openstack.org/configuringservices.html, and it 
appears that for service registration, all services (or rather service users) 
reside within the same tenant with the same Admin role.  So, if I understand it 
correctly, it is then possible that a service user for Nova can actually 
accidentally nuke an endpoint for a Glance service, for example?  Don't we want 
isolation among services, i.e., a user owning one service may not modify 
another service that he/she did not create?


Hi Liem!

As Joe Heck noted, the concept of roles hasn't changed from the Diablo 
codebase, and there is certainly the danger of a service tenant user 
nuking an endpoint for a different service, as you describe above. In 
Glance, we added a config option admin_role that can be set to guard 
against this, however. Just set admin_role = glance_admin and create a 
glance_admin role in Keystone and just assign the Glance service user 
(and only that user) that role...


Kind of a hacky workaround, but it works...

Best,
-jay

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Instance can't reach dhcp or metadata

2012-04-11 Thread Dan Wendlandt
On Wed, Apr 11, 2012 at 5:24 AM, Vaze, Mandar mandar.v...@nttdata.comwrote:

  I have *never* been able to get to ssh to an instance with
 Quantum+mélange

 https://lists.launchpad.net/openstack/msg09206.html


Looking at that thread, I suspect you may be hitting the same issue I
mentioned above: https://bugs.launchpad.net/quantum/+bug/949234

If you try that fix and either do or don't have luck with it, please add a
comment to the issue.

Dan



 

 ** **

 -Mandar

 ** **

 *From:* openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net[mailto:
 openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] *On Behalf
 Of *Nicolas de BONFILS
 *Sent:* Wednesday, April 11, 2012 1:45 AM
 *To:* Dan Wendlandt
 *Cc:* openstack@lists.launchpad.net
 *Subject:* Re: [Openstack] Instance can't reach dhcp or metadata

 ** **

 Hi,

 I can't get the ssh connection,VNC doesn't respond and 10.0.0.1 go to
 localhost (ssh to server itself)
 

 ** **

 ---

 Nicolas



 

 On Tue, Apr 10, 2012 at 21:42, Dan Wendlandt d...@nicira.com wrote:

 ** **

 On Tue, Apr 10, 2012 at 11:54 AM, Nicolas de BONFILS ndebonf...@gmail.com
 wrote:

 Things starting to work !

 When I boot boot cirros image with ip 10.0.0.1, I can ssh (even if it
 doesn't accept my password), but when I lauch tty-uec image (or other) with
 ip starting at 10.0.0.2, ssh tell no route to host

 ** **

 If it works on one image, but not another, this is probably an issue with
 the image itself.  The no route to host error is likely because the
 gateway interface 10.0.0.1 is arping for 10.0.0.2 and not getting a
 response.  Perhaps the image is not configured to use DCHP on the
 interface?  Or is not correctly launching?  I'd use VNC to login and check
 it out.  

  

 Dan

 ** **


 I sum up the actual conf

- br-int as bridge in OVS, no other conf (nothing in interfaces file),
ifconfig show a 10.0.0.1 ip
- nova conf got public_interface=br-int / flat_network_bridge=br-int /
flat_interface=eth0
- quantum manage the assignation successfully

  Thanks

 ---

 Nicolas

 ** **

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



 

 ** **

 -- 

 ~~~
 Dan Wendlandt 

 Nicira, Inc: www.nicira.com

 twitter: danwendlandt
 ~~~

 ** **

 ** **

 __
 Disclaimer:This email and any attachments are sent in strictest confidence
 for the sole use of the addressee and may contain legally privileged,
 confidential, and proprietary data. If you are not the intended recipient,
 please advise the sender by replying promptly to this email and then delete
 and destroy this email and any attachments without any further use, copying
 or forwarding




-- 
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.com
twitter: danwendlandt
~~~
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] EC2 compat.

2012-04-11 Thread Joshua Harlow
Sweet,

Ideas and thoughts are welcome.

There is a lot of cleanup/testing/validation that needs to happen, but someones 
got to do it :-P

On 4/11/12 8:06 AM, Duncan McGreggor dun...@dreamhost.com wrote:

Lurking on the thread, but love what I'm seeing :-)

Nice work, guys!

d

On Tue, Apr 10, 2012 at 10:43 PM, Joshua Harlow harlo...@yahoo-inc.com wrote:
 Very cool, glad to see that is being worked on, it looks pretty similar to
 what I was thinking of.
 I'm all for open dialogues.
 In fact.
 I was thinking of what is needed to make this work better.

 Open questions/thoughts/brainstorm (at least that I was thinking of):

 How strict do we want to be with the XSD? (there aren't a lot of tolerant
 xsd validators out there, which sux)

 Should we use something like jaxb for python, that should be more tolerant
 (unsure as what the best solution here is)

 How do we continuously measure the compatibility level?

 # of test cases passing, # of xml differences, # of xsd issues

 Should we use boto as a intermediate layer? (it is very tolerant)

 From what I understand there XML code is basically selecting certain
 attributes out of the XML using SAX, then adding any unknown attributes
 dynamically on to a object

 How do we make it repeatable?

 For a given test X, if there is a problem with test X and its response Y,
 how do we easily recreate that test X and response Y (so that dev's can fix
 it)?
 Do we have a golden set of responses that when test X is called it should
 match golden response Z (otherwise there is an issue)

 This is where the mock server maybe useful, in that we can point test X at
 the mock server; get the expected responses Z,
 Then point the test X at the real openstack server and get responses Y that
 should match Z (exactly, minus the request id?)
 EC2 seems to also already have some type of mocking, but I haven't used
 it... (http://bit.ly/HJkdh7)


 I like how there is a tests folder that u guys have, that seems like it
 could be a good location for the content checking tests which actually
 require code/logic to dig into the XML response. It might make sense to use
 another tool to verify the XSD's (how tolerant we want to be is an open
 question) and another tool that will show u the xml differences (some of
 which might be ok, some not). I have used in java xmlunit to do those kind
 of xml difference comparisons, it provides some nifty ways of ignoring
 certain differences and such. If say we had 3 levels of tests I think that
 would make sense (starting say from XSD validation, to difference
 comparisons to content comparisons), and would make a hell of a EC2 cool
 validation toolkit.

 The other usage of the site I was making was to list all the known error
 conditions, and any other incompatibilities that I am noticing with EC2
 (error conditions, features, parameters...). That seems really needed to
 allow for anyone to actually use the EC2 apis and handle all the cases which
 could be thrown at them.

 -Josh




 On 4/10/12 7:02 PM, Eric Windisch e...@cloudscaling.com wrote:


 Josh, as a follow-up, it would be good to keep an open dialogue on this.
 When/if you get a chance to review the aws-compat branch, I'd like to get
 your feedback as well.

 PS  I meant to write assess, not access. I only noticed when I read back
 my email. I'm too pedantic to not correct myself.



 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-11 Thread Sean Dague

On 04/11/2012 08:41 AM, Thierry Carrez wrote:

Sheng Bo Hou wrote:

After the research done by my colleage Edward Zhang and myself, we have
found the following issues for openstack. We have already raised bug
https://bugs.launchpad.net/nova/+bug/974810
https://bugs.launchpad.net/nova/+bug/974810  .
[...]


Thanks for your analysis. We plan to discuss how to fix and extend I18N
at the summit. One question that was raised on the ML in February was
whether internationalization was actually worth the effort for
infrastructure software like OpenStack.

I'll be the first to admit that there are other languages than English,
but all our open development is based in English already (bugs, reviews,
commit messages, mailing-lists, IRC...), so I don't think supporting
more languages in the software itself will help growing our developer
community.


I would tend to disagree with that. People are more likely to invest 
their time in software if they'll be able to use it better in their 
locale. I think this is definitely even more true in places where 
English has less of a dominant presence. It may even bring people to the 
table solely interested in helping with translation. I've seen that 
happen elsewhere.



On our users community, do operators of OpenStack need translated error
messages ? Given that translations are often incomplete, is it worth it
? What do comparable infrastructure open source software projects
provide ? The effort to provide them has proven non-trivial, I'd like to
make sure it's time well spent.


If we want to think about OpenStack as a basic building block like 
Apache, i18n is critical. Otherwise there are regions that won't adopt 
it solely because of a lack of i18n.


Is there a metric on the completeness so far? Something automated that 
could be a jenkins coverage kind of test?


-Sean

--
Sean Dague
IBM Linux Technology Center
email: slda...@us.ibm.com
alt-email: sda...@linux.vnet.ibm.com


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Management API Blueprint

2012-04-11 Thread Wilkinson, Lyle
Hi folks,

We've got some significant interest in creating a pattern for OpenStack 
management APIs.  We've created a blueprint to capture some of our thoughts 
around how to do this for Nova.

https://blueprints.launchpad.net/nova/+spec/management-api

We're hoping to discuss this at the design summit next week.  We've created an 
etherpad page to get the discussion going, so if you have questions, 
suggestions, etc., feel free to contribute there.

http://etherpad.openstack.org/Management-API

Thanks in advance!

Lyle Wilkinson

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Stable Branch, alt title: What happens to Diablo

2012-04-11 Thread Lloyd Dewolf
On Tue, Apr 10, 2012 at 8:57 AM, Mark McLoughlin mar...@redhat.com wrote:
 Hi,

 On Fri, 2012-04-06 at 09:13 -0700, Lloyd Dewolf wrote:
 I've updated http://wiki.openstack.org/StableBranch to put Diablo in
 the past, and Essex as the current stable release.

 I'm delighted to see that Mark McLoughlin already has Stable Branch
 on the agenda for the Summit,
 http://summit.openstack.org/sessions/view/29

 Before the summit I hope to get clarification on The stable branch
 will only be maintained until the next release is out. This period may
 be extended if there are volunteers to maintain it beyond this point.

 I suspect we can generally agree that Diablo and future each stable -
 1 should still be supported for some overlap with the current stable
 release, and beyond that would be dependent on... well the
 organizations dependent on that release.

 How long will https://launchpad.net/~openstack-stable-maint continue
 to maintain Diablo? Based on that we can determine if there is a group
 interested in continuing to own maintenance for an additional period.

 It's a good question, and one that we still need to figure out an answer
 to.

 Judging by the level of interest so far in helping to maintain the
 branch, I think this would work:

  - Core projects in a given release have a stable branch for that
    release maintained by openstack-stable-maint

  - A stable branch is actively maintained (read - the branch
    maintainers actively monitor master for patches to backport and
    release new versions from the branch) until the next release comes
    out

  - A stable branch is then passively maintained (read - the branch
    maintainers will backport security fixes and accept patches for
    high impact issues, but will not do new releases) until the next
    release after that comes out

 Giving a current state of stable-maint actively maintaining stable/essex
 and passively maintaining stable/diablo. We will EOL stable/diablo when
 Folsom comes out.

 Of course, we can always re-evaluate the policy if interest increases.

 Looking forward to discussing further at the summit ...

Thanks Mark. This seems sane, and gives me confidence.

See you next week,
Lloyd

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Health Monitoring Blueprints

2012-04-11 Thread Wilkinson, Lyle
Hi folks,

We've created a set of 3 blueprints on the topics of health and monitoring, 
metrics data collection, and cloud inventory maintenance.

https://blueprints.launchpad.net/nova/+spec/resource-monitor-alerts-and-notifications
https://blueprints.launchpad.net/nova/+spec/utilizationdata
https://blueprints.launchpad.net/nova/+spec/cloud-inventory-manager

We're hoping to discuss these at the design summit next week, but currently 
don't know if they'll be part of an existing session or covered in a separate 
session in one of the open space.  We've created some etherpad pages to get the 
discussion going, so if you have questions, suggestions, etc., feel free to 
contribute there.

http://etherpad.openstack.org/ResourceMonitorAlertsandNotifications
http://etherpad.openstack.org/utilizationdata
http://etherpad.openstack.org/Cloud-Inventory-Manager

Thanks in advance!

Lyle Wilkinson

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Health Monitoring Blueprints

2012-04-11 Thread Duncan McGreggor
Lyle, would you mind if I add these to the Instrumenting OpenStack session?
  http://summit.openstack.org/sessions/edit/163

d

On Wed, Apr 11, 2012 at 4:33 PM, Wilkinson, Lyle lyle.wilkin...@hp.com wrote:
 Hi folks,



 We’ve created a set of 3 blueprints on the topics of health and monitoring,
 metrics data collection, and cloud inventory maintenance.



 https://blueprints.launchpad.net/nova/+spec/resource-monitor-alerts-and-notifications

 https://blueprints.launchpad.net/nova/+spec/utilizationdata

 https://blueprints.launchpad.net/nova/+spec/cloud-inventory-manager



 We’re hoping to discuss these at the design summit next week, but currently
 don’t know if they’ll be part of an existing session or covered in a
 separate session in one of the open space.  We’ve created some etherpad
 pages to get the discussion going, so if you have questions, suggestions,
 etc., feel free to contribute there.



 http://etherpad.openstack.org/ResourceMonitorAlertsandNotifications

 http://etherpad.openstack.org/utilizationdata

 http://etherpad.openstack.org/Cloud-Inventory-Manager



 Thanks in advance!



 Lyle Wilkinson




 ___
 Mailing list: https://launchpad.net/~openstack
 Post to     : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Health Monitoring Blueprints

2012-04-11 Thread Wilkinson, Lyle
Hi folks,

We've created a set of 3 blueprints on the topics of health and monitoring, 
metrics data collection, and cloud inventory maintenance.

https://blueprints.launchpad.net/nova/+spec/resource-monitor-alerts-and-notifications
https://blueprints.launchpad.net/nova/+spec/utilizationdata
https://blueprints.launchpad.net/nova/+spec/cloud-inventory-manager

We're hoping to discuss these at the design summit next week, but currently 
don't know if they'll be part of an existing session or covered in a separate 
session in one of the open space.  We've got some currently blank etherpad 
pages that we'll be filling out, so if you have questions, suggestions, etc., 
feel free to contribute there.

http://etherpad.openstack.org/ResourceMonitorAlertsandNotifications
http://etherpad.openstack.org/utilizationdata
http://etherpad.openstack.org/Cloud-Inventory-Manager

Thanks in advance!

Lyle Wilkinson
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Health Monitoring Blueprints

2012-04-11 Thread Duncan McGreggor
Resharing with the Operators list...

d

On Wed, Apr 11, 2012 at 4:33 PM, Wilkinson, Lyle lyle.wilkin...@hp.com wrote:
 Hi folks,



 We’ve created a set of 3 blueprints on the topics of health and monitoring,
 metrics data collection, and cloud inventory maintenance.



 https://blueprints.launchpad.net/nova/+spec/resource-monitor-alerts-and-notifications

 https://blueprints.launchpad.net/nova/+spec/utilizationdata

 https://blueprints.launchpad.net/nova/+spec/cloud-inventory-manager



 We’re hoping to discuss these at the design summit next week, but currently
 don’t know if they’ll be part of an existing session or covered in a
 separate session in one of the open space.  We’ve created some etherpad
 pages to get the discussion going, so if you have questions, suggestions,
 etc., feel free to contribute there.



 http://etherpad.openstack.org/ResourceMonitorAlertsandNotifications

 http://etherpad.openstack.org/utilizationdata

 http://etherpad.openstack.org/Cloud-Inventory-Manager



 Thanks in advance!



 Lyle Wilkinson




 ___
 Mailing list: https://launchpad.net/~openstack
 Post to     : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] profiling nova-api

2012-04-11 Thread Yun Mao
Hi Stackers, I spent some time looking at nova-api today.

Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
with 10 tiny VMs.
Client: 3 python threads each doing a loop of nova list equivalent
for 100 times. So 300 API calls with concurrency=3.
how to profile: python -m cProfile -s time
/opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
--logdir=/var/log/nova --nodebug
The partial output is attached in the end.

Observations:
* It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90%

* Database access: Each nova list API call will issue 4 db APIs: 3
instance_get_all_by_filters(), 1
instance_fault_get_by_instance_uuids(), so 1200 db API calls total
(note: not necessarily 1200 SQL statements, could be more). The 900
instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
each)! The 300 instance_fault_get_by_instance_uuids() calls only took
1.129 seconds (0.004 each).

You might think: MySQL sucks. Not so fast. Remember this is a tiny
database with only 10 VMs. Profile also shows that the actual
_mysql.connection.query() method only took 1.883 seconds in total. So,
we pretty much spend 29 seconds out of 60 seconds doing either
sqlalchemy stuff or our own wrapper. You can also see from the sheer
volume of sqlalchemy library calls involved.

* the cfg.py library inefficiency. During 300 API calls,
common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
sec for that.

Hopefully this is useful for whoever wants to improve the performance
of nova-api.

Thanks,
Yun

===

 23355694 function calls (22575841 primitive calls) in 77.874 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
  812   25.7250.032   25.7250.032 {method 'poll' of
'select.epoll' objects}
 24081.8830.0011.8830.001 {method 'query' of
'_mysql.connection' objects}
703801.6670.0007.1870.000
expression.py:2263(corresponding_column)
   1350051.2540.0002.4700.000 cfg.py:1058(_get)
410271.0430.0001.9070.000 schema.py:542(__init__)
388021.0080.0001.2190.000 __init__.py:451(format)
   1622060.8210.0000.8210.000 util.py:883(values)
  15306660.7730.0000.7740.000 {isinstance}
135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute)
 12050.7130.0011.3690.001 base.py:2106(__init__)
   1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path)
810020.6870.0002.4920.000 compiler.py:312(visit_label)
388020.6500.0006.0870.000 log.py:227(format)
   3192700.6220.0000.7480.000 attributes.py:164(__get__)
890242/8842290.6080.0001.8850.000 {getattr}
405000.6050.0003.1010.000 schema.py:955(_make_proxy)
120783/1207380.6030.0000.6050.000 {method 'sub' of
'_sre.SRE_Pattern' objects}
810000.6010.0002.1560.000
interfaces.py:677(create_row_processor)
630000.5900.0000.7070.000 times.py:44(DateTime_or_None)
981020.5880.0000.8860.000 compiler.py:337(visit_column)
   6580980.5800.0000.5810.000 {method 'intersection'
of 'set' objects}
   1098020.5620.0000.5620.000 expression.py:3625(_from_objects)
231610/12020.5510.0005.8130.005
visitors.py:58(_compiler_dispatch)
   1440020.5100.0000.6930.000
compiler.py:622(_truncated_identifier)
135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__)
 24080.4630.0001.9420.001 {built-in method fetch_row}
711000.4600.0000.5800.000
strategies.py:121(create_row_processor)
   2990310.4370.0000.4370.000 {_codecs.utf_8_decode}
 60000.4370.0001.7990.000 models.py:93(iteritems)
36000/90000.4090.0004.7910.001 mapper.py:2146(populate_state)
810020.3930.0001.1040.000
compiler.py:672(label_select_column)
45000/90000.3900.0005.1480.001 mapper.py:2186(_instance)
 12020.3660.0005.7970.005 compiler.py:701(visit_select)
231610/12020.3470.0005.8170.005 base.py:714(process)
   1728000.3410.0001.1480.000
interfaces.py:651(_get_context_strategy)
258680.3390.0000.3390.000 {method 'write' of 'file' objects}
91800/522000.3270.0006.7280.000 interfaces.py:673(setup)

228010.3240.0000.3240.000 {method 'strftime' of
'datetime.date' objects}
784780.3160.0000.9140.000
expression.py:2143(contains_column)
258680.3140.0000.3140.000 {method 'flush' of 'file' objects}
   2990330.3090.0000.9300.000 {method 'decode' of 'str' objects}
118969/1189240.3050.0000.9300.000 string.py:174(safe_substitute)

[Openstack] DevStack stable/essex branch

2012-04-11 Thread Dean Troyer
The stable/essex branch of DevStack has been created in GitHub
(https://github.com/openstack-dev/devstack/tree/stable/essex) with
stackrc pre-configured to pull from stable/essex branches of the
project repos as appropriate.

http://devstack.org has been updated to reflect the current state.

dt

-- 

Dean Troyer
dtro...@gmail.com

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Management API Blueprint

2012-04-11 Thread Vishvananda Ishaya
FYI there were existing blueprints covering some of this functionality here:

https://blueprints.launchpad.net/nova/+spec/admin-cli
https://blueprints.launchpad.net/nova/+spec/admin-service-actions

I like the detailed features in the wiki.  A few notes:

a) managing one administrative api across multiple projects is going to be 
difficult, might be good to focus on each project individually, perhaps pushing 
some common code into openstack-common.
b) users/projects/roles is out of scope for nova, this can be administered 
through keystone + keystone-client
c) a lot of administrative features are already in the nova cli (you can delete 
networks but not create them yet)


I think there will be some serious weight behind the operational support team 
in this cycle.  Would love to see nova-manage + talking directly to the db go 
boom. For now i will target this blueprint to the nova-operations team to sort 
out vs other blueprints.

https://blueprints.launchpad.net/~nova-operations


On Apr 11, 2012, at 12:55 PM, Wilkinson, Lyle wrote:

 Hi folks,
  
 We’ve got some significant interest in creating a pattern for OpenStack 
 management APIs.  We’ve created a blueprint to capture some of our thoughts 
 around how to do this for Nova.
  
 https://blueprints.launchpad.net/nova/+spec/management-api
  
 We’re hoping to discuss this at the design summit next week.  We’ve created 
 an etherpad page to get the discussion going, so if you have questions, 
 suggestions, etc., feel free to contribute there.
  
 http://etherpad.openstack.org/Management-API
  
 Thanks in advance!
  
 Lyle Wilkinson
  
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-11 Thread Matt Joyce
Problem of course is many operators aren't on the design summit
contributor list ( ala don't have codes to get into it ) and if it's
later it's 500 USD to attend.

Maybe not the best means of collaborating on something that effects them deeply.

Pondering that.

-Matt

On Wed, Apr 11, 2012 at 1:43 PM, Duncan McGreggor dun...@dreamhost.com wrote:
 Resharing with the Operators list...

 d

 On Wed, Apr 11, 2012 at 4:33 PM, Wilkinson, Lyle lyle.wilkin...@hp.com 
 wrote:
 Hi folks,



 We’ve created a set of 3 blueprints on the topics of health and monitoring,
 metrics data collection, and cloud inventory maintenance.



 https://blueprints.launchpad.net/nova/+spec/resource-monitor-alerts-and-notifications

 https://blueprints.launchpad.net/nova/+spec/utilizationdata

 https://blueprints.launchpad.net/nova/+spec/cloud-inventory-manager



 We’re hoping to discuss these at the design summit next week, but currently
 don’t know if they’ll be part of an existing session or covered in a
 separate session in one of the open space.  We’ve created some etherpad
 pages to get the discussion going, so if you have questions, suggestions,
 etc., feel free to contribute there.



 http://etherpad.openstack.org/ResourceMonitorAlertsandNotifications

 http://etherpad.openstack.org/utilizationdata

 http://etherpad.openstack.org/Cloud-Inventory-Manager



 Thanks in advance!



 Lyle Wilkinson




 ___
 Mailing list: https://launchpad.net/~openstack
 Post to     : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

 ___
 Openstack-operators mailing list
 openstack-operat...@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Where does Keystone middleware for Swift belong?

2012-04-11 Thread Maru Newby
The Keystone repo currently contains the following Swift-specific wsgi 
middleware modules:

https://github.com/openstack/keystone/blob/master/keystone/middleware/s3_token.py
https://github.com/openstack/keystone/blob/master/keystone/middleware/swift_auth.py

Neither module depends directly on Keystone.  s3_token calls Keystone through 
HTTP, and swift_auth retrieves Keystone identity data from the wsgi 
environment.  Both modules, however, depend directly on Swift, and this forces 
the Keystone test suite to have to install Swift to run successfully.

Separate from the dependency issue, both middleware modules need to ensure that 
Swift-specific authorization requirements are met.  It doesn't make sense for 
the Keystone project to be responsible for this, since the Swift team is the 
final arbiter of how Swift authorization should behave.

All signs point to the Swift repo being the best place for these modules to be 
maintained.  Does this seem reasonable, or is there a better alternative?  
Please chime in, especially if you are Swift core.

Cheers,


Maru
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-11 Thread Duncan McGreggor
On Wed, Apr 11, 2012 at 5:03 PM, Matt Joyce m...@nycresistor.com wrote:
 Problem of course is many operators aren't on the design summit
 contributor list ( ala don't have codes to get into it ) and if it's
 later it's 500 USD to attend.

 Maybe not the best means of collaborating on something that effects them 
 deeply.

 Pondering that.

That's a really good point. In the post-conference conversations that
deal with attendance policy, this should be kept in mind.

In lieu of not being able to attend in person, keep in mind the
live-casting that will be done, in combination with IRC channels. When
I led tracks at Ubuntu Developer Summits, we were able to keep remote
attendees closely in the loop. As non-optimal as this may be, we can
still work hard to get the best out of it.

I'm not sure it the Design Summit will be projecting IRC chat on a
screen for each session (like is done at UDS); at the very least, I
can make sure I'm on Freenode and can act as a proxy -- ensuring any
questions or concerns from IRC get audibly voiced and become part of
the conversation. I will be attending all of the DevOps (and related)
sessions, as long as they don't conflict.

Thanks for bringing this up,

d

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] compute create instance failure

2012-04-11 Thread Craig Vyvial
I've run into a few issues while i have been testing creating and deleting
instances on my vm after setting everything up with devstack. I create a
new instance and it goes into an error state. the log says it failed to map
partitions but this is the same image i have been using without problems
before. its a qcow2 image i created with ubuntu-vmbuilder.

Anyone else see this?

i thought maybe i was out of memory but thats not the case.
ubuntu@ubuntu:/opt/stack$ df
Filesystem   1K-blocks  Used Available Use% Mounted on
/dev/sda1 18578172   7169564  10464892  41% /
udev501644 4501640   1% /dev
tmpfs   203828   324203504   1% /run
none  5120 0  5120   0% /run/lock
none509560 0509560   0% /run/shm

Excerpt from the nova-compute logs:

2012-04-11 13:54:26 DEBUG nova.virt.libvirt.connection
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] [instance:
939d3af8-e7bd-4d4b-b026-c20097e207a6] Finished toXML method from (pid=2720)
to_xml /opt/stack/nova/nova/virt/libvirt/connection.py:1662
2012-04-11 13:54:26 INFO nova.virt.libvirt.firewall
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] [instance:
939d3af8-e7bd-4d4b-b026-c20097e207a6] Called setup_basic_filtering in
nwfilter
2012-04-11 13:54:26 INFO nova.virt.libvirt.firewall
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] [instance:
939d3af8-e7bd-4d4b-b026-c20097e207a6] Ensuring static filters
2012-04-11 13:54:26 DEBUG nova.virt.firewall
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Filters added to instance
939d3af8-e7bd-4d4b-b026-c20097e207a6 from (pid=2720)
prepare_instance_filter /opt/stack/nova/nova/virt/firewall.py:137
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Attempting to grab semaphore iptables
for method _do_refresh_provider_fw_rules... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:929
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Got semaphore iptables for method
_do_refresh_provider_fw_rules... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:933
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Attempting to grab file lock iptables
for method _do_refresh_provider_fw_rules... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:937
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Got file lock iptables for method
_do_refresh_provider_fw_rules... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:944
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Attempting to grab semaphore iptables
for method apply... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:929
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Got semaphore iptables for method
apply... from (pid=2720) inner /opt/stack/nova/nova/utils.py:933
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Attempting to grab file lock iptables
for method apply... from (pid=2720) inner
/opt/stack/nova/nova/utils.py:937
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Got file lock iptables for method
apply... from (pid=2720) inner /opt/stack/nova/nova/utils.py:944
2012-04-11 13:54:26 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Running cmd (subprocess): sudo
/usr/local/bin/nova-rootwrap iptables-save -t filter from (pid=2720)
execute /opt/stack/nova/nova/utils.py:220
2012-04-11 13:54:27 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Running cmd (subprocess): sudo
/usr/local/bin/nova-rootwrap iptables-restore from (pid=2720) execute
/opt/stack/nova/nova/utils.py:220
2012-04-11 13:54:27 DEBUG nova.utils
[req-91b3855a-1f90-42bb-8c24-6bf546aed826 2e11238b4cf444ba8dcf321a98764050
cb0ad32733bb4366962ba76033f4b6fb] Running cmd (subprocess): sudo
/usr/local/bin/nova-rootwrap iptables-save -t nat from (pid=2720) execute
/opt/stack/nova/nova/utils.py:220
2012-04-11 13:54:27 DEBUG nova.utils

Re: [Openstack] DevStack stable/essex branch

2012-04-11 Thread Vishvananda Ishaya
Yay! Awesome work Dean!

Monty/Jim: Has the ci infrastructure been updated to use the stable/essex 
branch for integration tests on the stable/essex merges?

Vish

On Apr 11, 2012, at 1:57 PM, Dean Troyer wrote:

 The stable/essex branch of DevStack has been created in GitHub
 (https://github.com/openstack-dev/devstack/tree/stable/essex) with
 stackrc pre-configured to pull from stable/essex branches of the
 project repos as appropriate.
 
 http://devstack.org has been updated to reflect the current state.
 
 dt
 
 -- 
 
 Dean Troyer
 dtro...@gmail.com
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] profiling nova-api

2012-04-11 Thread Joshua Harlow
Awesome, great stuff to know!

On 4/11/12 1:48 PM, Yun Mao yun...@gmail.com wrote:

Hi Stackers, I spent some time looking at nova-api today.

Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
with 10 tiny VMs.
Client: 3 python threads each doing a loop of nova list equivalent
for 100 times. So 300 API calls with concurrency=3.
how to profile: python -m cProfile -s time
/opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
--logdir=/var/log/nova --nodebug
The partial output is attached in the end.

Observations:
* It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90%

* Database access: Each nova list API call will issue 4 db APIs: 3
instance_get_all_by_filters(), 1
instance_fault_get_by_instance_uuids(), so 1200 db API calls total
(note: not necessarily 1200 SQL statements, could be more). The 900
instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
each)! The 300 instance_fault_get_by_instance_uuids() calls only took
1.129 seconds (0.004 each).

You might think: MySQL sucks. Not so fast. Remember this is a tiny
database with only 10 VMs. Profile also shows that the actual
_mysql.connection.query() method only took 1.883 seconds in total. So,
we pretty much spend 29 seconds out of 60 seconds doing either
sqlalchemy stuff or our own wrapper. You can also see from the sheer
volume of sqlalchemy library calls involved.

* the cfg.py library inefficiency. During 300 API calls,
common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
sec for that.

Hopefully this is useful for whoever wants to improve the performance
of nova-api.

Thanks,
Yun

===

 23355694 function calls (22575841 primitive calls) in 77.874 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
  812   25.7250.032   25.7250.032 {method 'poll' of
'select.epoll' objects}
 24081.8830.0011.8830.001 {method 'query' of
'_mysql.connection' objects}
703801.6670.0007.1870.000
expression.py:2263(corresponding_column)
   1350051.2540.0002.4700.000 cfg.py:1058(_get)
410271.0430.0001.9070.000 schema.py:542(__init__)
388021.0080.0001.2190.000 __init__.py:451(format)
   1622060.8210.0000.8210.000 util.py:883(values)
  15306660.7730.0000.7740.000 {isinstance}
135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute)
 12050.7130.0011.3690.001 base.py:2106(__init__)
   1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path)
810020.6870.0002.4920.000 compiler.py:312(visit_label)
388020.6500.0006.0870.000 log.py:227(format)
   3192700.6220.0000.7480.000 attributes.py:164(__get__)
890242/8842290.6080.0001.8850.000 {getattr}
405000.6050.0003.1010.000 schema.py:955(_make_proxy)
120783/1207380.6030.0000.6050.000 {method 'sub' of
'_sre.SRE_Pattern' objects}
810000.6010.0002.1560.000
interfaces.py:677(create_row_processor)
630000.5900.0000.7070.000 times.py:44(DateTime_or_None)
981020.5880.0000.8860.000 compiler.py:337(visit_column)
   6580980.5800.0000.5810.000 {method 'intersection'
of 'set' objects}
   1098020.5620.0000.5620.000 expression.py:3625(_from_objects)
231610/12020.5510.0005.8130.005
visitors.py:58(_compiler_dispatch)
   1440020.5100.0000.6930.000
compiler.py:622(_truncated_identifier)
135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__)
 24080.4630.0001.9420.001 {built-in method fetch_row}
711000.4600.0000.5800.000
strategies.py:121(create_row_processor)
   2990310.4370.0000.4370.000 {_codecs.utf_8_decode}
 60000.4370.0001.7990.000 models.py:93(iteritems)
36000/90000.4090.0004.7910.001 mapper.py:2146(populate_state)
810020.3930.0001.1040.000
compiler.py:672(label_select_column)
45000/90000.3900.0005.1480.001 mapper.py:2186(_instance)
 12020.3660.0005.7970.005 compiler.py:701(visit_select)
231610/12020.3470.0005.8170.005 base.py:714(process)
   1728000.3410.0001.1480.000
interfaces.py:651(_get_context_strategy)
258680.3390.0000.3390.000 {method 'write' of 'file' objects}
91800/522000.3270.0006.7280.000 interfaces.py:673(setup)

228010.3240.0000.3240.000 {method 'strftime' of
'datetime.date' objects}
784780.3160.0000.9140.000
expression.py:2143(contains_column)
258680.3140.0000.3140.000 {method 'flush' of 'file' objects}
   2990330.3090.0000.9300.000 {method 'decode' of 'str' objects}

Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-11 Thread Stefano Maffulli
On Wed, 2012-04-11 at 14:03 -0700, Matt Joyce wrote:
 Problem of course is many operators aren't on the design summit
 contributor list ( ala don't have codes to get into it ) and if it's
 later it's 500 USD to attend. 

There will be over 400 people at the summit, not all of them are
developers. I expect lots of operators/users have a representation
there. Will there be enough to justify having this discussion there? I
don't know but we can try.

On Wed, 2012-04-11 at 17:16 -0400, Duncan McGreggor wrote:
 That's a really good point. In the post-conference conversations that
 deal with attendance policy, this should be kept in mind.

We probably should set a date for a post-mortem discussion, after the
conference. I'm quite sure I'll take a few days off after April 20,
maybe have a couple of live feedback sessions in the first week of May
would work?

 In lieu of not being able to attend in person, keep in mind the
 live-casting that will be done, 


We're not yet sure to be able to offer this. Wait for an official
communication.

 in combination with IRC channels. 

This we can do: use IRC but there will be only one projector in the
rooms, not two like at UDS. Each track leader can decide how to use it
(for IRC or something else).

Since you are already familiar with UDS setup, would you mind setting up
the IRC channels for each of the rooms at the summit? This is the layout
of the rooms and their expected usage:

Ballroom: Intro Plenary, Breakout tables, Lightning Talks

Seacliff A+B: Design summit sessions (fishbowl setup)*
Seacliff C: Design summit sessions (fishbowl setup)*
Seacliff D: Design summit sessions (fishbowl setup)*
Marina: Design summit sessions (fishbowl setup)*
Bayview B: Design summit sessions (fishbowl setup)*

Golden Gate: Unconference room (theater setup)*
Bayview A: Developer's lounge

The association between rooms+track will be published soon, once the
revisions on summit.openstack.org are completed.

Cheers,
stef


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-11 Thread Duncan McGreggor
On Wed, Apr 11, 2012 at 5:52 PM, Stefano Maffulli stef...@openstack.org wrote:
 On Wed, 2012-04-11 at 14:03 -0700, Matt Joyce wrote:
 Problem of course is many operators aren't on the design summit
 contributor list ( ala don't have codes to get into it ) and if it's
 later it's 500 USD to attend.

 There will be over 400 people at the summit, not all of them are
 developers. I expect lots of operators/users have a representation
 there. Will there be enough to justify having this discussion there? I
 don't know but we can try.

 On Wed, 2012-04-11 at 17:16 -0400, Duncan McGreggor wrote:
 That's a really good point. In the post-conference conversations that
 deal with attendance policy, this should be kept in mind.

 We probably should set a date for a post-mortem discussion, after the
 conference. I'm quite sure I'll take a few days off after April 20,
 maybe have a couple of live feedback sessions in the first week of May
 would work?

+1 for me!

 In lieu of not being able to attend in person, keep in mind the
 live-casting that will be done,

 We're not yet sure to be able to offer this. Wait for an official
 communication.

Whoops, my bad -- sorry about that Stefano!

 in combination with IRC channels.

 This we can do: use IRC but there will be only one projector in the
 rooms, not two like at UDS. Each track leader can decide how to use it
 (for IRC or something else).

 Since you are already familiar with UDS setup, would you mind setting up
 the IRC channels for each of the rooms at the summit?

Sure thing!

 This is the layout
 of the rooms and their expected usage:

        Ballroom: Intro Plenary, Breakout tables, Lightning Talks

        Seacliff A+B: Design summit sessions (fishbowl setup)*
        Seacliff C: Design summit sessions (fishbowl setup)*
        Seacliff D: Design summit sessions (fishbowl setup)*
        Marina: Design summit sessions (fishbowl setup)*
        Bayview B: Design summit sessions (fishbowl setup)*

        Golden Gate: Unconference room (theater setup)*
        Bayview A: Developer's lounge

 The association between rooms+track will be published soon, once the
 revisions on summit.openstack.org are completed.

Thanks, Stefano! Good info. I'll let you know when it's set up.

d

 Cheers,
 stef


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-11 Thread Joshua Harlow
This also seems to make sense for other items in that directory /middleware?

Should the EC2/S3 stuff be in nova?

On 4/11/12 2:07 PM, Maru Newby mne...@internap.com wrote:

The Keystone repo currently contains the following Swift-specific wsgi 
middleware modules:

https://github.com/openstack/keystone/blob/master/keystone/middleware/s3_token.py
https://github.com/openstack/keystone/blob/master/keystone/middleware/swift_auth.py

Neither module depends directly on Keystone.  s3_token calls Keystone through 
HTTP, and swift_auth retrieves Keystone identity data from the wsgi 
environment.  Both modules, however, depend directly on Swift, and this forces 
the Keystone test suite to have to install Swift to run successfully.

Separate from the dependency issue, both middleware modules need to ensure that 
Swift-specific authorization requirements are met.  It doesn't make sense for 
the Keystone project to be responsible for this, since the Swift team is the 
final arbiter of how Swift authorization should behave.

All signs point to the Swift repo being the best place for these modules to be 
maintained.  Does this seem reasonable, or is there a better alternative?  
Please chime in, especially if you are Swift core.

Cheers,


Maru
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-11 Thread Chmouel Boudjnah
On Thu, Apr 12, 2012 at 12:01 AM, Joshua Harlow harlo...@yahoo-inc.comwrote:

  This also seems to make sense for other items in that directory
 /middleware?
 Should the EC2/S3 stuff be in nova?


I'd say the s3 middle-ware if it has to be moved would probably be a better
fit in swift than nova since it has been designed to be used with swift's
swift3 middleware.

Chnmouel.
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] DevStack stable/essex branch

2012-04-11 Thread Monty Taylor
It should Just Work™

On 04/11/2012 02:29 PM, Vishvananda Ishaya wrote:
 Yay! Awesome work Dean!
 
 Monty/Jim: Has the ci infrastructure been updated to use the stable/essex 
 branch for integration tests on the stable/essex merges?
 
 Vish
 
 On Apr 11, 2012, at 1:57 PM, Dean Troyer wrote:
 
 The stable/essex branch of DevStack has been created in GitHub
 (https://github.com/openstack-dev/devstack/tree/stable/essex) with
 stackrc pre-configured to pull from stable/essex branches of the
 project repos as appropriate.

 http://devstack.org has been updated to reflect the current state.

 dt

 -- 

 Dean Troyer
 dtro...@gmail.com

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-11 Thread Maru Newby
Agreed that s3_token belongs in Swift, and as per Joshua, ec2_token probably 
belongs in Nova.

Cheers,


Maru

On 2012-04-11, at 3:07 PM, Chmouel Boudjnah wrote:

 On Thu, Apr 12, 2012 at 12:01 AM, Joshua Harlow harlo...@yahoo-inc.com 
 wrote:
 This also seems to make sense for other items in that directory /middleware?
 Should the EC2/S3 stuff be in nova? 
 
 I'd say the s3 middle-ware if it has to be moved would probably be a better 
 fit in swift than nova since it has been designed to be used with swift's 
 swift3 middleware.
 
 Chnmouel.

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [DESIGN SUMMIT] Short training video for session leaders and participants to the summit

2012-04-11 Thread Stefano Maffulli
Hello all,

we want to have the most productive time during the next week. We'll
have many sessions to attend to, decision to make, things to learn and
also have fun. 

Last time we had a summit some people asked us to improve how the tracks
are managed during the summit. Jim Plamondon kindly volunteered to give
some pointers for session leaders and participants to the OpenStack
Folsom Design Summit. 

Please watch this video, it's brief and will help you make the most of
your time next week:

https://www.youtube.com/watch?v=GmY4cK_6NKY

If you know somebody that should watch it too, pass it along, tweet it:
spread the word.

Thanks,
stef


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Templates for slides?

2012-04-11 Thread Joshua Harlow
Are there any good powerpoint/keynote templates for slides that should be used 
for the conference/summit (ie with openstack branding??)

Or is it just show whatever u want for the template (if anything)?

Thx!
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-11 Thread Duncan McGreggor
On Wed, Apr 11, 2012 at 5:52 PM, Stefano Maffulli stef...@openstack.org wrote:
 On Wed, 2012-04-11 at 14:03 -0700, Matt Joyce wrote:
 Problem of course is many operators aren't on the design summit
 contributor list ( ala don't have codes to get into it ) and if it's
 later it's 500 USD to attend.

 There will be over 400 people at the summit, not all of them are
 developers. I expect lots of operators/users have a representation
 there. Will there be enough to justify having this discussion there? I
 don't know but we can try.

 On Wed, 2012-04-11 at 17:16 -0400, Duncan McGreggor wrote:
 That's a really good point. In the post-conference conversations that
 deal with attendance policy, this should be kept in mind.

 We probably should set a date for a post-mortem discussion, after the
 conference. I'm quite sure I'll take a few days off after April 20,
 maybe have a couple of live feedback sessions in the first week of May
 would work?

 In lieu of not being able to attend in person, keep in mind the
 live-casting that will be done,


 We're not yet sure to be able to offer this. Wait for an official
 communication.

 in combination with IRC channels.

 This we can do: use IRC but there will be only one projector in the
 rooms, not two like at UDS. Each track leader can decide how to use it
 (for IRC or something else).

 Since you are already familiar with UDS setup, would you mind setting up
 the IRC channels for each of the rooms at the summit? This is the layout
 of the rooms and their expected usage:

        Ballroom: Intro Plenary, Breakout tables, Lightning Talks

        Seacliff A+B: Design summit sessions (fishbowl setup)*
        Seacliff C: Design summit sessions (fishbowl setup)*
        Seacliff D: Design summit sessions (fishbowl setup)*
        Marina: Design summit sessions (fishbowl setup)*
        Bayview B: Design summit sessions (fishbowl setup)*

        Golden Gate: Unconference room (theater setup)*
        Bayview A: Developer's lounge

 The association between rooms+track will be published soon, once the
 revisions on summit.openstack.org are completed.

The following channels have been created on Freenode and are registered.

#osds-ballroom
#osds-seacliff-a-b
#osds-seacliff-c
#osds-seacliff-d
#osds-marina
#osds-bayview-a
#osds-bayview-b
#osds-golden-gate

Each channel is also getting logged, viewable via HTTP here:
  http://irclogs.osds.cogitat.io/

Feel free to put another logger in there ;-)

At UDS, messages get sent to IRC channels at a countdown interval...
not sure if we have anything that sophisticated for OSDS. At the very
least, we can monitor the times ourselves and post messages to the
channels.

d

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Instance can't reach dhcp or metadata

2012-04-11 Thread Vaze, Mandar
Dan,
Bug you referred to specifically says default tenant - which is not the case 
for me.
I'm not using default tenant - I'm using  uuid of demo tenant created by 
stack.sh
BTW, stack.sh creates incorrect  entries in quantum/mélange DB,  it has tenant 
ID = default - This should be uuid of some valid tenant, not string default

FWIW, this setup (although seems incorrect) works with quantum+nova_ipam - not 
with quantum+mélange
i.e. With quantum+nova_ipam I can just create a VM and ssh to it.

-Mandar

From: Dan Wendlandt [mailto:d...@nicira.com]
Sent: Wednesday, April 11, 2012 11:07 PM
To: Vaze, Mandar
Cc: Nicolas de BONFILS; openstack@lists.launchpad.net
Subject: Re: [Openstack] Instance can't reach dhcp or metadata


On Wed, Apr 11, 2012 at 5:24 AM, Vaze, Mandar 
mandar.v...@nttdata.commailto:mandar.v...@nttdata.com wrote:
I have never been able to get to ssh to an instance with Quantum+mélange
https://lists.launchpad.net/openstack/msg09206.html

Looking at that thread, I suspect you may be hitting the same issue I mentioned 
above: https://bugs.launchpad.net/quantum/+bug/949234

If you try that fix and either do or don't have luck with it, please add a 
comment to the issue.

Dan



-Mandar

From: 
openstack-bounces+mandar.vaze=nttdata@lists.launchpad.netmailto:nttdata@lists.launchpad.net
 
[mailto:openstack-bounces+mandar.vazemailto:openstack-bounces%2Bmandar.vaze=nttdata@lists.launchpad.netmailto:nttdata@lists.launchpad.net]
 On Behalf Of Nicolas de BONFILS
Sent: Wednesday, April 11, 2012 1:45 AM
To: Dan Wendlandt
Cc: openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net
Subject: Re: [Openstack] Instance can't reach dhcp or metadata

Hi,

I can't get the ssh connection,VNC doesn't respond and 10.0.0.1 go to localhost 
(ssh to server itself)

---
Nicolas

On Tue, Apr 10, 2012 at 21:42, Dan Wendlandt 
d...@nicira.commailto:d...@nicira.com wrote:

On Tue, Apr 10, 2012 at 11:54 AM, Nicolas de BONFILS 
ndebonf...@gmail.commailto:ndebonf...@gmail.com wrote:
Things starting to work !
When I boot boot cirros image with ip 10.0.0.1, I can ssh (even if it doesn't 
accept my password), but when I lauch tty-uec image (or other) with ip starting 
at 10.0.0.2, ssh tell no route to host

If it works on one image, but not another, this is probably an issue with the 
image itself.  The no route to host error is likely because the gateway 
interface 10.0.0.1 is arping for 10.0.0.2 and not getting a response.  Perhaps 
the image is not configured to use DCHP on the interface?  Or is not correctly 
launching?  I'd use VNC to login and check it out.

Dan


I sum up the actual conf

  *   br-int as bridge in OVS, no other conf (nothing in interfaces file), 
ifconfig show a 10.0.0.1 ip
  *   nova conf got public_interface=br-int / flat_network_bridge=br-int / 
flat_interface=eth0
  *   quantum manage the assignation successfully
Thanks
---
Nicolas

___
Mailing list: 
https://launchpad.net/~openstackhttps://launchpad.net/%7Eopenstack
Post to : 
openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net
Unsubscribe : 
https://launchpad.net/~openstackhttps://launchpad.net/%7Eopenstack
More help   : https://help.launchpad.net/ListHelp



--
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.comhttp://www.nicira.com
twitter: danwendlandt
~~~



__
Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data. If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding



--
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.comhttp://www.nicira.com
twitter: danwendlandt
~~~


__
Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data.  If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack-poc] [Bug 972859] Re: Fix utils.import_object() when trying to get an instance of a class

2012-04-11 Thread OpenStack Hudson
Reviewed:  https://review.openstack.org/6191
Committed: 
http://github.com/openstack/openstack-common/commit/4acd7829ab0857356594dce3b841f4d785cf2aa1
Submitter: Jenkins
Branch:master

commit 4acd7829ab0857356594dce3b841f4d785cf2aa1
Author: Russell Bryant rbry...@redhat.com
Date:   Tue Apr 3 17:05:37 2012 -0400

Change behavior in utils.import_object().

Fix bug 972859.

Prior to this patch, utils.import_object(foo) and
utils.import_class(foo) would return the same thing if foo was the path
to a class.  This patch changes utils.import_object() to return an
instance of the class, instead, also allowing you to pass in arguments
to the constructor.

This patch also removes the odd behavior of import_object() to be able
to also import a module.  Instead, a new function import_module() has
been added.

Finally, the three import helpers have been moved to a new module,
importutils.

Change-Id: Ia2ea64c965692f8c3a29adec332dd93a83980070


** Changed in: openstack-common
   Status: In Progress = Fix Committed

-- 
You received this bug notification because you are a member of OpenStack
Common Drivers, which is the registrant for openstack-common.
https://bugs.launchpad.net/bugs/972859

Title:
  Fix utils.import_object() when trying to get an instance of a class

Status in openstack-common:
  Fix Committed

Bug description:
  RIght now, utils.import_object('foo') is the same as
  utils.import_class('foo') when 'foo' is the path to a class.  This
  should be fixed so that import_object() returns an instance of that
  class (like how this works in nova.utils).

To manage notifications about this bug go to:
https://bugs.launchpad.net/openstack-common/+bug/972859/+subscriptions

___
Mailing list: https://launchpad.net/~openstack-poc
Post to : openstack-poc@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack-poc
More help   : https://help.launchpad.net/ListHelp


[Openstack-ubuntu-testing-notifications] Build Fixed: precise-openstack-essex-glance-trunk #172

2012-04-11 Thread openstack-testing-bot
Title: precise-openstack-essex-glance-trunk
General InformationBUILD SUCCESSBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-glance-trunk/172/Project:precise-openstack-essex-glance-trunkDate of build:Wed, 11 Apr 2012 15:40:15 -0400Build duration:37 minBuild cause:Started by user adamBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: 4 out of the last 5 builds failed.20ChangesNo ChangesConsole Output[...truncated 4497 lines...]Install-Time: 67Job: glance_2012.1+git201204111540-0ubuntu1.dscPackage: glancePackage-Time: 2032Source-Version: 2012.1+git201204111540-0ubuntu1Space: 16040Status: successfulVersion: 2012.1+git201204111540-0ubuntu1Finished at 20120411-1617Build needed 00:33:52, 16040k disc spaceINFO:root:Uploading package to ppa:openstack-ubuntu-testing/openstack-trunk-testingDEBUG:root:['dput', 'ppa:openstack-ubuntu-testing/openstack-trunk-testing', 'glance_2012.1+git201204111540-0ubuntu1_source.changes']gpg: Signature made Wed 11 Apr 2012 03:43:29 PM EDT using RSA key ID 9935ACDCgpg: Good signature from "Openstack Ubuntu Testing Bot (Jenkins Key) <ja...@shingle-house.org.uk>"gpg: Signature made Wed 11 Apr 2012 03:43:29 PM EDT using RSA key ID 9935ACDCgpg: Good signature from "Openstack Ubuntu Testing Bot (Jenkins Key) <ja...@shingle-house.org.uk>"Checking signature on .changesGood signature on /tmp/tmp9BPYXy/glance_2012.1+git201204111540-0ubuntu1_source.changes.Checking signature on .dscGood signature on /tmp/tmp9BPYXy/glance_2012.1+git201204111540-0ubuntu1.dsc.Uploading to ppa (via ftp to ppa.launchpad.net):  Uploading glance_2012.1+git201204111540-0ubuntu1.dsc: done.  Uploading glance_2012.1+git201204111540.orig.tar.gz: done.  Uploading glance_2012.1+git201204111540-0ubuntu1.debian.tar.gz: done.  Uploading glance_2012.1+git201204111540-0ubuntu1_source.changes: done.Successfully uploaded packages.INFO:root:Installing build artifacts into /var/lib/jenkins/www/aptExporting indices...Successfully created '/var/lib/jenkins/www/apt/dists/precise/Release.gpg.new'Successfully created '/var/lib/jenkins/www/apt/dists/precise/InRelease.new'Deleting files no longer referenced...deleting and forgetting pool/main/g/glance/glance-api_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/glance-client_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/glance-common_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/glance-registry_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/glance_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/python-glance-doc_2012.1+git201204020855-0ubuntu1_all.debdeleting and forgetting pool/main/g/glance/python-glance_2012.1+git201204020855-0ubuntu1_all.debINFO:root:Pushing changes back to bzr testing branchDEBUG:root:['bzr', 'push', 'lp:~openstack-ubuntu-testing/glance/essex']Pushed up to revision 143.INFO:root:Storing current commit for next build: 0d4d1f7a1d5a595acf7c66c9054446140044b838INFO:root:Destroying schroot session: precise-amd64-1a86dcf7-7261-4546-a2f0-6b8cf8774fff+ [ ! 0 ]+ [ glance = nova ]Email was triggered for: FixedTrigger Success was overridden by another trigger and will not send an email.Sending email for trigger: Fixed-- 
Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications
Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications
More help   : https://help.launchpad.net/ListHelp


[Openstack-ubuntu-testing-notifications] Build Failure: precise-openstack-essex-nova-trunk #706

2012-04-11 Thread openstack-testing-bot
Title: precise-openstack-essex-nova-trunk
General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-nova-trunk/706/Project:precise-openstack-essex-nova-trunkDate of build:Wed, 11 Apr 2012 23:04:54 -0400Build duration:31 secBuild cause:Started by user adamBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: 1 out of the last 5 builds failed.80ChangesNo ChangesConsole OutputStarted by user adamBuilding remotely on pkg-builderCheckout:precise-openstack-essex-nova-trunk / /var/lib/jenkins/slave/workspace/precise-openstack-essex-nova-trunk - hudson.remoting.Channel@1d008ff:pkg-builderUsing strategy: DefaultLast Built Revision: Revision bbb021c8423c5662290c6a569e6352e2f67e2873 (origin/milestone-proposed)Checkout:nova / /var/lib/jenkins/slave/workspace/precise-openstack-essex-nova-trunk/nova - hudson.remoting.LocalChannel@3fea5d72Wiping out workspace first.Cloning the remote Git repositoryCloning repository originFetching upstream changes from https://github.com/openstack/nova.gitERROR: Couldn't find any revision to build. Verify the repository and branch configuration for this job.Email was triggered for: FailureSending email for trigger: Failure-- 
Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications
Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications
More help   : https://help.launchpad.net/ListHelp