Re: [Openstack] Ceilometer application for incubation

2012-07-06 Thread Nick Barcet
On 07/05/2012 09:22 PM, Jonathan Bryce wrote:
 Thanks, Nick. I've added it to the agenda for next Tuesday's meeting
 at 20:00 UTC/3:00 PM CDT. If you can join the meeting to field any
 questions, that would be helpful.
 
 Jonathan

Great! I'll be there, hopefully joined by other team members.

Thanks,
Nick

 On Jul 5, 2012, at 12:52 PM, Nick Barcet wrote:
 
 Dear members of the Project Policy Board,
 
 After 3 month of work on the Ceilometer project, and great
 progress being made, our last meeting IRC meeting [1] validated
 that we should be submitting this project for incubation.
 Following the OpenStack project rules, we have completed the
 incubation application form which you will find at [2].
 
 We would be happy to answer any question you may have about our 
 application and hope that you will give a favorable answer to our
 request.
 
 [1] 
 http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-07-05-16.00.html

 
[2] http://wiki.openstack.org/Governance/Proposed/Ceilometer
 
 On behalf of the Ceilometer project team, -- Nick Barcet
 nick.bar...@canonical.com aka: nijaba, nicolas
 
 ___ Mailing list:
 https://launchpad.net/~openstack Post to :
 openstack@lists.launchpad.net Unsubscribe :
 https://launchpad.net/~openstack More help   :
 https://help.launchpad.net/ListHelp
 
 
 ___ Mailing list:
 https://launchpad.net/~openstack Post to :
 openstack@lists.launchpad.net Unsubscribe :
 https://launchpad.net/~openstack More help   :
 https://help.launchpad.net/ListHelp
 





signature.asc
Description: OpenPGP digital signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Libvirt LXC with volume-attach broken ?

2012-07-06 Thread Daniel P. Berrange
On Thu, Jul 05, 2012 at 06:49:06PM -0700, Eric W. Biederman wrote:
 Serge Hallyn serge.hal...@canonical.com writes:
 
  Quoting Daniel P. Berrange (berra...@redhat.com):
  On Thu, Jul 05, 2012 at 03:00:26PM +0100, Daniel P. Berrange wrote:
   Now, when using 'nova volume-attach':
   
 # nova volume-attach 05eb16df-03b8-451b-85c1-b838a8757736 
   a5ad1d37-aed0-4bf6-8c6e-c28543cd38ac /dev/sdf
   
   nova will import an iSCSI LUN from the nova volume service, on the 
   compute
   node. The kernel will assign it the next free SCSI drive letter, in my
   case '/dev/sdc'.
   
   The libvirt nova driver will then do a mknod, using the volume name
   passed to 'nova volume-attach'.
   eg it will do
   
 mknod  /var/lib/nova/instances/instance-000e/rootfs/dev/sdf
  
  Opps, I'm slightly wrong here. What it actually does is
  
mount --bind /dev/sdc 
  /var/lib/nova/instances/instance-000e/rootfs/dev/sdf
  
  so you get a 'sdf' device, but with the major/minor number of the 'sdc'
  device. I can't say I particularly like this approach. Ultimately I
  think we need the kernel support to make this work correctly. In any
 
  Yes, that's what the 'devices namespace' is meant to address.  I'm hoping
  we can some serious design discussion on that in the next few months.
 
 This is not the device namespace problem.
 
 This is the setns problem for mount namespaces, and the unprivilged
 mount problem.
 
 There may be a notification issue so use space can perform actions
 in a container when a device shows up.
 
 But it should be very possible on the host to call.
 setns(containers_mount_namespace);
 mknod(/dev/foo);
 chown(/dev/foo, CONTAINER_ROOT_UID, CONTAINER_ROOT_GID);
 
 And then from inside the container especially when I get the rest of
 the user namespace merged it should be very possible to manipulate
 the block device because you have permission, and to mount the
 partitions of the block device, because you are root in your container.
 
 But until the user namespace is merged you really are root so you can
 mount whatever.
 
 Daniel does that sound like the support you are looking for?

Yes, the setns(mnt) approach you describe above is exactly what I'd
like to be able todo, to solve the first half of the problem.

The part of the problem is that I have a /dev/sdf, or even a
/dev/volgroup00/logvol3 in the host (with whatever major:minor
number that implies), and I want to be able to make it always
appear as /dev/sda  in the container (with the correspondingly
different major:minor number).  I'm guessing this is what Serge
was refering to as the 'device' namespace problem


Regards,
Daniel
-- 
|: http://berrange.com  -o-http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org  -o- http://virt-manager.org :|
|: http://autobuild.org   -o- http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org   -o-   http://live.gnome.org/gtk-vnc :|

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Libvirt LXC with volume-attach broken ?

2012-07-06 Thread Daniel P. Berrange
On Fri, Jul 06, 2012 at 02:35:14AM -0700, Eric W. Biederman wrote:
 Daniel P. Berrange berra...@redhat.com writes:
  The part of the problem is that I have a /dev/sdf, or even a
  /dev/volgroup00/logvol3 in the host (with whatever major:minor
  number that implies), and I want to be able to make it always
  appear as /dev/sda  in the container (with the correspondingly
  different major:minor number).  I'm guessing this is what Serge
  was refering to as the 'device' namespace problem
 
 Getting the device to always appear with the name /dev/sda is easy.
 
 Where does the need to have a specific device come from?  I would have
 thought by now that hotplug had been around long enough that in general
 user space would not care.
 
 The only case that I know of where keeping the same device number seems
 reasonable is in the case of live migration an application, in order to
 avoid issues with stat changing for the same file over the transition,
 and I think a synthesized hotplug event could probably handle that case.
 
 Is there another case besides buggy applications that have hard
 coded device numbers that need specific device numbers?

There isn't any particular buggy application we're trying to avoid
here. We're just trying to provide an piece of OpenStack functionality
to LXC in the same way as its provided to KVM.

With a basic OpenStack instance, you just get the root filesystem
from the image you booted, whose contents are transient (ie thrown
away on shutdown). It is possible to tell OpenStack to attach one
or more block devices to a running instance, which give you some
persistent storage.

The end user API for this lets the host admin specify the device
name that the block device will appear as inside the instance.

eg, with KVM you'd invoke:

 # nova volume-attach myguest  mystoragevol1 /dev/vdb
 # nova volume-attach myguest  mystoragevol2 /dev/vdc

Obviously with KVM this just works, because you have a level of
indirection between host  guest device names via virtio-blk.

The desire is to be able to wire up LXC in a similar way

 # nova volume-attach myguest  mystoragevol1 /dev/sdb
 # nova volume-attach myguest  mystoragevol2 /dev/sdc

So it is really the host admin specifying that they want to provide
the container with a '/dev/sdb' device, regardless of what the actual
device node on the host is (it could be an iSCSI LUN, multipath LUN,
LVM volume, or whatever). So I'm really looking to have the container
visible device name be independent of host name.

Regards,
Daniel
-- 
|: http://berrange.com  -o-http://www.flickr.com/photos/dberrange/ :|
|: http://libvirt.org  -o- http://virt-manager.org :|
|: http://autobuild.org   -o- http://search.cpan.org/~danberr/ :|
|: http://entangle-photo.org   -o-   http://live.gnome.org/gtk-vnc :|

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [OpenStack][Nova] Live Migration Error

2012-07-06 Thread Leander Bessa Beernaert
Hello,

I've recently setup a system to test out the live migration feature. So far
i've been able to launch the instances with the shared nfs folder. However,
when i run the live-migration command i encounter this error in the
destination compute node:

2012-07-05 09:33:48 ERROR nova.manager [-] Error during
 ComputeManager.update_available_resource: Domain not found: no domain with
 matching id 2
 2012-07-05 09:33:48 TRACE nova.manager Traceback (most recent call last):
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/manager.py, line 155, in
 periodic_tasks
 2012-07-05 09:33:48 TRACE nova.manager task(self, context)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/compute/manager.py, line 2409, in
 update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager
 self.driver.update_available_resource(context, self.host)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1936, in update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager 'vcpus_used':
 self.get_vcpu_used(),
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1743, in get_vcpu_used
 2012-07-05 09:33:48 TRACE nova.manager dom =
 self._conn.lookupByID(dom_id)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/libvirt.py, line 2363, in lookupByID
 2012-07-05 09:33:48 TRACE nova.manager if ret is None:raise
 libvirtError('virDomainLookupByID() failed', conn=self)
 2012-07-05 09:33:48 TRACE nova.manager libvirtError: Domain not found: no
 domain with matching id 2


Any ideas on how to solve this?

Regards,
Leander
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Per host floating ip

2012-07-06 Thread Alessandro Tagliapietra
Hello guys, i've some servers at hetzner,
i've actually installed essex on those and they're working fine, the step i'm 
missing is that hetzner gives you additional ip fixed to one host or failover 
ip that i can move to one server to another with the api.
What i want is to assign floating ip to vm, depending on which host the vm is 
running or use a create hook to move the failover ip to the host which is 
running the vm. Is it possible in some way?

Best Regards
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Baremetal Provisioning and proxy-nova-compute

2012-07-06 Thread Trinath Somanchi
Hi-

I'm currently trying/testing on How Baremetal provisioning works with
openstack nova.

when I start nova-compute server in the proxy-nova-compute server, I have
seen the following error

2012-07-06 16:13:15 DEBUG nova.service [-] quota_security_group_rules : 20
from (pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] xenapi_connection_password :
FLAG SET  from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:409
2012-07-06 16:13:15 DEBUG nova.service [-] rabbit_virtual_host : / from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] libvirt_volume_drivers :
['iscsi=nova.virt.libvirt.volume.LibvirtISCSIVolumeDriver',
'local=nova.virt.libvirt.volume.LibvirtVolumeDriver',
'fake=nova.virt.libvirt.volume.LibvirtFakeVolumeDriver',
'rbd=nova.virt.libvirt.volume.LibvirtNetVolumeDriver',
'sheepdog=nova.virt.libvirt.volume.LibvirtNetVolumeDriver'] from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] network_driver :
nova.network.linux_net from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] quota_instances : 10 from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] vnc_keymap : FLAG SET  from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-07-06 16:13:15 DEBUG nova.service [-] image_service :
nova.image.glance.GlanceImageService from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] libvirt_inject_password : FLAG
SET  from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:409
2012-07-06 16:13:15 DEBUG nova.service [-] control_exchange : nova from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] cnt_vpn_clients : 0 from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] log_file : None from (pid=11576)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] compute_manager :
nova.compute.manager.ComputeManager from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] compute_driver :
nova.virt.connection.get_connection from (pid=11576) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 DEBUG nova.service [-] network_topic : network from
(pid=11576) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-07-06 16:13:15 AUDIT nova.service [-] Starting compute node (version
2012.1-LOCALBRANCH:LOCALREVISION)
2012-07-06 16:13:16 DEBUG nova.utils
[req-dc7cdfb3-e7b6-468d-8c62-9f7c2a6f5291 None None] backend module
'nova.db.sqlalchemy.api' from
'/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.pyc' from
(pid=11576) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658
2012-07-06 16:13:16 CRITICAL nova [-] Expecting property name: line 1
column 2 (char 2)
2012-07-06 16:13:16 TRACE nova Traceback (most recent call last):
2012-07-06 16:13:16 TRACE nova   File /usr/bin/nova-compute, line 49, in
module
2012-07-06 16:13:16 TRACE nova service.wait()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/nova/service.py, line 413, in wait
2012-07-06 16:13:16 TRACE nova _launcher.wait()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/nova/service.py, line 131, in wait
2012-07-06 16:13:16 TRACE nova service.wait()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/eventlet/greenthread.py, line 166, in
wait
2012-07-06 16:13:16 TRACE nova return self._exit_event.wait()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/eventlet/event.py, line 116, in wait
2012-07-06 16:13:16 TRACE nova return hubs.get_hub().switch()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py, line 177, in switch
2012-07-06 16:13:16 TRACE nova return self.greenlet.switch()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/eventlet/greenthread.py, line 192, in
main
2012-07-06 16:13:16 TRACE nova result = function(*args, **kwargs)
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/nova/service.py, line 101, in run_server
2012-07-06 16:13:16 TRACE nova server.start()
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/nova/service.py, line 174, in start
2012-07-06 16:13:16 TRACE nova
self.manager.update_available_resource(ctxt)
2012-07-06 16:13:16 TRACE nova   File
/usr/lib/python2.7/dist-packages/nova/compute/manager.py, line 2403, in
update_available_resource
2012-07-06 16:13:16 TRACE nova
self.driver.update_available_resource(context, 

[Openstack] Performance metrics of RabbitMQServer

2012-07-06 Thread Naveen Kuna
Hi All,

Can anyone know performance metrics of RabbitMQServer ?

Is there any better alternative than RabbitMQServer ?

Thanks in advance.


Regards,
Naveen Reddy
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [OpenStack][Nova] Help with libvirt unit-test - get_diagnostics command

2012-07-06 Thread Leander Bessa Beernaert
Hello,

I've been working on implementing the diagnostics command for libvirt -
https://review.openstack.org/#/c/8839/ . Now i need to create the unit test
for this new operation. I've been looking at the code to try and figure out
an easy way to replicate this, but i'm a bit lost.

What i need to do is simulate a connection to libvirt, create a fake
instance with a predefined characteristics, retrieve the virtdomain and
then verify the results from the get_diagnostics command. I'm more at loss
as to how exactly do i setup a fake connection a create a fake instance? I
thought about creating a dummy implementation as i've seen being used
around the tests, however that doesn't give me any access to real method.
Do note that I'm relatively new to python world, so there's a lot of things
i can't grasp yes :s.


Regards,
Leander
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [OpenStack][Nova] Help with libvirt unit-test - get_diagnostics command

2012-07-06 Thread Daniel P. Berrange
On Fri, Jul 06, 2012 at 11:59:51AM +0100, Leander Bessa Beernaert wrote:
 Hello,
 
 I've been working on implementing the diagnostics command for libvirt -
 https://review.openstack.org/#/c/8839/ . Now i need to create the unit test
 for this new operation. I've been looking at the code to try and figure out
 an easy way to replicate this, but i'm a bit lost.
 
 What i need to do is simulate a connection to libvirt, create a fake
 instance with a predefined characteristics, retrieve the virtdomain and
 then verify the results from the get_diagnostics command. I'm more at loss
 as to how exactly do i setup a fake connection a create a fake instance? I
 thought about creating a dummy implementation as i've seen being used
 around the tests, however that doesn't give me any access to real method.
 Do note that I'm relatively new to python world, so there's a lot of things
 i can't grasp yes :s.

As you say, figuring out the libvirt Nova test framework is not entirely
easy, particularly if you're new to Python / Nova. So to help you get
your patch through review, here is one suitable test case you can add to
test_libvirt.py for exercising the get_diagnostics API:

diff --git a/nova/tests/test_libvirt.py b/nova/tests/test_libvirt.py
index eed43b8..f3fa5ff 100644
--- a/nova/tests/test_libvirt.py
+++ b/nova/tests/test_libvirt.py
@@ -1938,6 +1938,91 @@ class LibvirtConnTestCase(test.TestCase):
 got = jsonutils.loads(conn.get_cpu_info())
 self.assertEqual(want, got)
 
+def test_diagnostic_full(self):
+xml = 
+domain type='kvm'
+devices
+disk type='file'
+source file='filename'/
+target dev='vda' bus='virtio'/
+/disk
+disk type='block'
+source dev='/path/to/dev/1'/
+target dev='vdb' bus='virtio'/
+/disk
+interface type='network'
+mac address='52:54:00:a4:38:38'/
+source network='default'/
+target dev='vnet0'/
+/interface
+/devices
+/domain
+
+
+class DiagFakeDomain(FakeVirtDomain):
+
+def __init__(self):
+super(DiagFakeDomain, self).__init__(fake_xml=xml)
+
+def vcpus(self):
+return ([(0, 1, 1534000L, 0),
+ (1, 1, 164000L, 0),
+ (2, 1, 304000L, 0),
+ (3, 1, 142000L, 0)],
+[(True, False),
+ (True, False),
+ (True, False),
+ (True, False)])
+
+def blockStats(self, path):
+return (169L, 688640L, 0L, 0L, -1L)
+
+def interfaceStats(self, path):
+return (4408L, 82L, 0L, 0L, 0L, 0L, 0L, 0L)
+
+def memoryStats(self):
+return {'actual': 220160L, 'rss': 200164L}
+
+def maxMemory(self):
+return 280160L
+
+def fake_lookup_name(name):
+return DiagFakeDomain()
+
+self.mox.StubOutWithMock(libvirt_driver.LibvirtDriver, '_conn')
+libvirt_driver.LibvirtDriver._conn.lookupByName = fake_lookup_name
+
+conn = libvirt_driver.LibvirtDriver(False)
+actual = conn.get_diagnostics( { name: testvirt })
+expect = {'cpu0_time': 1534000L,
+  'cpu1_time': 164000L,
+  'cpu2_time': 304000L,
+  'cpu3_time': 142000L,
+  'vda_read': 688640L,
+  'vda_read_req': 169L,
+  'vda_write': 0L,
+  'vda_write_req': 0L,
+  'vda_errors': -1L,
+  'vdb_read': 688640L,
+  'vdb_read_req': 169L,
+  'vdb_write': 0L,
+  'vdb_write_req': 0L,
+  'vdb_errors': -1L,
+  'memory': 280160L,
+  'memory-actual': 220160L,
+  'memory-rss': 200164L,
+  'vnet0_rx': 4408L,
+  'vnet0_rx_drop': 0L,
+  'vnet0_rx_errors': 0L,
+  'vnet0_rx_packets': 82L,
+  'vnet0_tx': 0L,
+  'vnet0_tx_drop': 0L,
+  'vnet0_tx_errors': 0L,
+  'vnet0_tx_packets': 0L,
+  }
+
+self.assertEqual(actual, expect)
+
 
 class HostStateTestCase(test.TestCase):


A description of what I'm doing here:

 * First we mock up an XML document that describes our test
   guest, with 2 disks and 1 NIC.

 * We create the FakeVirtDomain() class which provides a stub
   implementation of the various libvirt APIs that the
   get_diagnostics method will call.


Re: [Openstack] Libvirt LXC with volume-attach broken ?

2012-07-06 Thread Serge Hallyn
Quoting Eric W. Biederman (ebied...@xmission.com):
 Daniel P. Berrange berra...@redhat.com writes:
 
  On Thu, Jul 05, 2012 at 06:49:06PM -0700, Eric W. Biederman wrote:
  Serge Hallyn serge.hal...@canonical.com writes:
  
   Quoting Daniel P. Berrange (berra...@redhat.com):
   On Thu, Jul 05, 2012 at 03:00:26PM +0100, Daniel P. Berrange wrote:
Now, when using 'nova volume-attach':

  # nova volume-attach 05eb16df-03b8-451b-85c1-b838a8757736 
a5ad1d37-aed0-4bf6-8c6e-c28543cd38ac /dev/sdf

nova will import an iSCSI LUN from the nova volume service, on the 
compute
node. The kernel will assign it the next free SCSI drive letter, in my
case '/dev/sdc'.

The libvirt nova driver will then do a mknod, using the volume name
passed to 'nova volume-attach'.
eg it will do

  mknod  /var/lib/nova/instances/instance-000e/rootfs/dev/sdf
   
   Opps, I'm slightly wrong here. What it actually does is
   
 mount --bind /dev/sdc 
   /var/lib/nova/instances/instance-000e/rootfs/dev/sdf
   
   so you get a 'sdf' device, but with the major/minor number of the 'sdc'
   device. I can't say I particularly like this approach. Ultimately I
   think we need the kernel support to make this work correctly. In any
  
   Yes, that's what the 'devices namespace' is meant to address.  I'm hoping
   we can some serious design discussion on that in the next few months.
  
  This is not the device namespace problem.
  
  This is the setns problem for mount namespaces, and the unprivilged
  mount problem.
  
  There may be a notification issue so use space can perform actions
  in a container when a device shows up.
  
  But it should be very possible on the host to call.
  setns(containers_mount_namespace);
  mknod(/dev/foo);
  chown(/dev/foo, CONTAINER_ROOT_UID, CONTAINER_ROOT_GID);
  
  And then from inside the container especially when I get the rest of
  the user namespace merged it should be very possible to manipulate
  the block device because you have permission, and to mount the
  partitions of the block device, because you are root in your container.
  
  But until the user namespace is merged you really are root so you can
  mount whatever.
  
  Daniel does that sound like the support you are looking for?
 
  Yes, the setns(mnt) approach you describe above is exactly what I'd
  like to be able todo, to solve the first half of the problem.
 
  The part of the problem is that I have a /dev/sdf, or even a
  /dev/volgroup00/logvol3 in the host (with whatever major:minor
  number that implies), and I want to be able to make it always
  appear as /dev/sda  in the container (with the correspondingly
  different major:minor number).  I'm guessing this is what Serge
  was refering to as the 'device' namespace problem

Right.

 Getting the device to always appear with the name /dev/sda is easy.

It's easy to log in and make it look that way.  It's not easy to
make all distros see it that way across boot.

 Where does the need to have a specific device come from?  I would have
 thought by now that hotplug had been around long enough that in general
 user space would not care.

Yes the *primary* need for the devices namespace is to prevent udev
storm in the host and send uevents to the right place, and macvtap
and loop devices.

 The only case that I know of where keeping the same device number seems
 reasonable is in the case of live migration an application, in order to
 avoid issues with stat changing for the same file over the transition,
 and I think a synthesized hotplug event could probably handle that case.
 
 Is there another case besides buggy applications that have hard
 coded device numbers that need specific device numbers?

Other cases where specific device maj-min numbers are important
are things like makedev.  There is lots of software, and especially
automatic update software, which insists that things have specific
'correct' maj-minor numbers.

FWIW my (presumably naive) view is that for each non-init devicens
we'd have a list of

type-major:minor::type2-major:minor2

(:: meaning maps-to).  Then if a uevent comes through not aimed at
any type2-major2:minor2 valid in the namespace, that ns doesn't get
the uevent.

-serge

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] PLEASE HELP multi_host not working

2012-07-06 Thread Marnus van Niekerk

On 04/07/2012 15:53, Mark Russell wrote:

There is likely a better way to fix this than what I did (drop and
recreate nova db) but it was the simplest fix given that this was a
brand new installation.  There is almost certainly a better way to fix
it by manually hacking nova db.
Thank you Mark!  Creating a new nova database called novaMulti and 
creating the pvt and floating networks from scratch has taken me leaps 
forward.


Still struggling a bit with some of the routing, but at least I can now 
launce VMs on all of the compute nodes.


Tx
M


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Ceilometer application for incubation

2012-07-06 Thread Doug Hellmann
On Fri, Jul 6, 2012 at 3:20 AM, Nick Barcet nick.bar...@canonical.comwrote:

 On 07/05/2012 09:22 PM, Jonathan Bryce wrote:
  Thanks, Nick. I've added it to the agenda for next Tuesday's meeting
  at 20:00 UTC/3:00 PM CDT. If you can join the meeting to field any
  questions, that would be helpful.
 
  Jonathan

 Great! I'll be there, hopefully joined by other team members.


I will try to make it, too.

Doug



 Thanks,
 Nick

  On Jul 5, 2012, at 12:52 PM, Nick Barcet wrote:
 
  Dear members of the Project Policy Board,
 
  After 3 month of work on the Ceilometer project, and great
  progress being made, our last meeting IRC meeting [1] validated
  that we should be submitting this project for incubation.
  Following the OpenStack project rules, we have completed the
  incubation application form which you will find at [2].
 
  We would be happy to answer any question you may have about our
  application and hope that you will give a favorable answer to our
  request.
 
  [1]
 
 http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-07-05-16.00.html
 
 
 [2] http://wiki.openstack.org/Governance/Proposed/Ceilometer
 
  On behalf of the Ceilometer project team, -- Nick Barcet
  nick.bar...@canonical.com aka: nijaba, nicolas
 
  ___ Mailing list:
  https://launchpad.net/~openstack Post to :
  openstack@lists.launchpad.net Unsubscribe :
  https://launchpad.net/~openstack More help   :
  https://help.launchpad.net/ListHelp
 
 
  ___ Mailing list:
  https://launchpad.net/~openstack Post to :
  openstack@lists.launchpad.net Unsubscribe :
  https://launchpad.net/~openstack More help   :
  https://help.launchpad.net/ListHelp
 




 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [OpenStack][Nova] Help with libvirt unit-test - get_diagnostics command

2012-07-06 Thread Leander Bessa Beernaert
Daniel, thank you very much for your help!

However, i'm running into my infamous  import libvirt problem again when
running the tests (see output below), i really though i'd fixed that one
for sure -.-'.


 ==
 ERROR: test_diagnostic_full (nova.tests.test_libvirt.LibvirtConnTestCase)
 --
 Traceback (most recent call last):
   File /home/gsd/nova/nova/tests/test_libvirt.py, line 1923, in
 test_diagnostic_full
 actual = conn.get_diagnostics({name: testvirt})
   File /home/gsd/nova/nova/virt/libvirt/driver.py, line 2678, in
 get_diagnostics
 return diagnostics.get_diagnostics(dom)
   File /home/gsd/nova/nova/virt/libvirt/diagnostics.py, line 97, in
 get_diagnostics
 import libvirt
 ImportError: No module named libvirt




On Fri, Jul 6, 2012 at 1:11 PM, Daniel P. Berrange berra...@redhat.comwrote:

 On Fri, Jul 06, 2012 at 11:59:51AM +0100, Leander Bessa Beernaert wrote:
  Hello,
 
  I've been working on implementing the diagnostics command for libvirt -
  https://review.openstack.org/#/c/8839/ . Now i need to create the unit
 test
  for this new operation. I've been looking at the code to try and figure
 out
  an easy way to replicate this, but i'm a bit lost.
 
  What i need to do is simulate a connection to libvirt, create a fake
  instance with a predefined characteristics, retrieve the virtdomain and
  then verify the results from the get_diagnostics command. I'm more at
 loss
  as to how exactly do i setup a fake connection a create a fake instance?
 I
  thought about creating a dummy implementation as i've seen being used
  around the tests, however that doesn't give me any access to real method.
  Do note that I'm relatively new to python world, so there's a lot of
 things
  i can't grasp yes :s.

 As you say, figuring out the libvirt Nova test framework is not entirely
 easy, particularly if you're new to Python / Nova. So to help you get
 your patch through review, here is one suitable test case you can add to
 test_libvirt.py for exercising the get_diagnostics API:

 diff --git a/nova/tests/test_libvirt.py b/nova/tests/test_libvirt.py
 index eed43b8..f3fa5ff 100644
 --- a/nova/tests/test_libvirt.py
 +++ b/nova/tests/test_libvirt.py
 @@ -1938,6 +1938,91 @@ class LibvirtConnTestCase(test.TestCase):
  got = jsonutils.loads(conn.get_cpu_info())
  self.assertEqual(want, got)

 +def test_diagnostic_full(self):
 +xml = 
 +domain type='kvm'
 +devices
 +disk type='file'
 +source file='filename'/
 +target dev='vda' bus='virtio'/
 +/disk
 +disk type='block'
 +source dev='/path/to/dev/1'/
 +target dev='vdb' bus='virtio'/
 +/disk
 +interface type='network'
 +mac address='52:54:00:a4:38:38'/
 +source network='default'/
 +target dev='vnet0'/
 +/interface
 +/devices
 +/domain
 +
 +
 +class DiagFakeDomain(FakeVirtDomain):
 +
 +def __init__(self):
 +super(DiagFakeDomain, self).__init__(fake_xml=xml)
 +
 +def vcpus(self):
 +return ([(0, 1, 1534000L, 0),
 + (1, 1, 164000L, 0),
 + (2, 1, 304000L, 0),
 + (3, 1, 142000L, 0)],
 +[(True, False),
 + (True, False),
 + (True, False),
 + (True, False)])
 +
 +def blockStats(self, path):
 +return (169L, 688640L, 0L, 0L, -1L)
 +
 +def interfaceStats(self, path):
 +return (4408L, 82L, 0L, 0L, 0L, 0L, 0L, 0L)
 +
 +def memoryStats(self):
 +return {'actual': 220160L, 'rss': 200164L}
 +
 +def maxMemory(self):
 +return 280160L
 +
 +def fake_lookup_name(name):
 +return DiagFakeDomain()
 +
 +self.mox.StubOutWithMock(libvirt_driver.LibvirtDriver, '_conn')
 +libvirt_driver.LibvirtDriver._conn.lookupByName = fake_lookup_name
 +
 +conn = libvirt_driver.LibvirtDriver(False)
 +actual = conn.get_diagnostics( { name: testvirt })
 +expect = {'cpu0_time': 1534000L,
 +  'cpu1_time': 164000L,
 +  'cpu2_time': 304000L,
 +  'cpu3_time': 142000L,
 +  'vda_read': 688640L,
 +  'vda_read_req': 169L,
 +  'vda_write': 0L,
 +  'vda_write_req': 0L,
 +  'vda_errors': 

Re: [Openstack] Ceilometer application for incubation

2012-07-06 Thread Julien Danjou
On Fri, Jul 06 2012, Doug Hellmann wrote:

 Great! I'll be there, hopefully joined by other team members.


 I will try to make it, too.

I won't be there, but I trust Nick  Doug. :)

-- 
Julien Danjou
-- Free Software hacker  freelance
-- http://julien.danjou.info

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread John Paul Walters
Hi All,

One of the outputs of the design summit was that folks are interested in 
participating in a monthly (or so) telecon to express feature requests, best 
practices, etc.  I'd like to get this process started.  For those of you who 
are interested, what's the preferred format?  IRC, telephone, something else?  
Depending on the number of people who are interested, we're (ISI) capable of 
hosting a conference call.  

Does something like the first Monday of the month at 4:00pm EDT (UTC-4) work?  
I'm just throwing out that time as something that seems to broadly work on my 
end, but I'd welcome any input from others.

best,
JP
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Narayan Desai
On Fri, Jul 6, 2012 at 9:51 AM, John Paul Walters jwalt...@isi.edu wrote:

 Does something like the first Monday of the month at 4:00pm EDT (UTC-4) work? 
  I'm just throwing out that time as something that seems to broadly work on 
 my end, but I'd welcome any input from others.

That generally works fine for me.
 -nld

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Tim Bell

Would it be possible a bit earlier ? This would be 10pm in Europe so it
would limit the participation.

Tim

 -Original Message-
 From: openstack-bounces+tim.bell=cern...@lists.launchpad.net
 [mailto:openstack-bounces+tim.bell=cern...@lists.launchpad.net] On Behalf
 Of Narayan Desai
 Sent: 06 July 2012 17:08
 To: John Paul Walters
 Cc: openstack@lists.launchpad.net (openstack@lists.launchpad.net)
 Subject: Re: [Openstack] [HPC] Openstack HPC telecon
 
 On Fri, Jul 6, 2012 at 9:51 AM, John Paul Walters jwalt...@isi.edu
wrote:
 
  Does something like the first Monday of the month at 4:00pm EDT (UTC-4)
 work?  I'm just throwing out that time as something that seems to broadly
 work on my end, but I'd welcome any input from others.
 
 That generally works fine for me.
  -nld
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


smime.p7s
Description: S/MIME cryptographic signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Per host floating ip

2012-07-06 Thread Michael Grosser
Hey,

I would love to hear more on your setup at hetzner, I was looking to
setup openstack there myself, but I didn't see a solution for the per
server ip issue.
How many machines do you use?
How did you set it up?
Do you use only nova or swift too?

I would love to get more insight.

Thanks for taking the time
Cheers Michael

On Fri, Jul 6, 2012 at 12:24 PM, Alessandro Tagliapietra
tagliapietra.alessan...@gmail.com wrote:
 Hello guys, i've some servers at hetzner,
 i've actually installed essex on those and they're working fine, the step i'm 
 missing is that hetzner gives you additional ip fixed to one host or failover 
 ip that i can move to one server to another with the api.
 What i want is to assign floating ip to vm, depending on which host the vm is 
 running or use a create hook to move the failover ip to the host which is 
 running the vm. Is it possible in some way?

 Best Regards
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Stefano Maffulli
On 07/06/2012 07:51 AM, John Paul Walters wrote:
 One of the outputs of the design summit was that folks are
 interested in participating in a monthly (or so) telecon to express
 feature requests, best practices, etc.  I'd like to get this process
 started. For those of you who are interested, what's the preferred
 format? IRC, telephone, something else?

This is a great idea. HPC is an interesting topic and discussions around
it may be useful for lots of people. As format, I would suggest
something that can be recorded and played back conveniently, after it
happened. Casual Hangouts on Google are very trendy lately (it's the new
toy) and come with the advantage of going to youtube once they're done.
The good old audio conference is also good, if it can be recorded can
become a podcast. There are plenty of tools available for that.

What would be an 'agenda' (loosely defined points to discuss or
illustrate?) for the first meeting?

 Does something like the first Monday of the month at 4:00pm EDT 
 (UTC-4) work?  I'm just throwing out that time as something that 
 seems to broadly work on my end, but I'd welcome any input from 
 others.

That may be problematic for Europeans. Who else would be interested in
speaking? If we record the chat, listeners can enjoy it any time.

/stef

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Matt Joyce
That's 1 PM west coast USA.  I think the biggest concern may be Asia.

On Fri, Jul 6, 2012 at 8:55 AM, Tim Bell tim.b...@cern.ch wrote:


 Would it be possible a bit earlier ? This would be 10pm in Europe so it
 would limit the participation.

 Tim

  -Original Message-
  From: openstack-bounces+tim.bell=cern...@lists.launchpad.net
  [mailto:openstack-bounces+tim.bell=cern...@lists.launchpad.net] On
 Behalf
  Of Narayan Desai
  Sent: 06 July 2012 17:08
  To: John Paul Walters
  Cc: openstack@lists.launchpad.net (openstack@lists.launchpad.net)
  Subject: Re: [Openstack] [HPC] Openstack HPC telecon
 
  On Fri, Jul 6, 2012 at 9:51 AM, John Paul Walters jwalt...@isi.edu
 wrote:
 
   Does something like the first Monday of the month at 4:00pm EDT (UTC-4)
  work?  I'm just throwing out that time as something that seems to broadly
  work on my end, but I'd welcome any input from others.
 
  That generally works fine for me.
   -nld
 
  ___
  Mailing list: https://launchpad.net/~openstack
  Post to : openstack@lists.launchpad.net
  Unsubscribe : https://launchpad.net/~openstack
  More help   : https://help.launchpad.net/ListHelp

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Per host floating ip

2012-07-06 Thread Marnus van Niekerk
I have limited knowledge of OpenStack, but I host many servers with 
Hetzner and know their infrastructure well.


Since nova allows you to assign specific floating IPs to specific 
instances you could do the following.

Create a floating range include all of the IPs Hetzner has given you.
Then just associate the IP from the underlying host with a VM running on 
it that host using euca-associate-address.


On 06/07/2012 18:17, Michael Grosser wrote:

Hey,

I would love to hear more on your setup at hetzner, I was looking to
setup openstack there myself, but I didn't see a solution for the per
server ip issue.
How many machines do you use?
How did you set it up?
Do you use only nova or swift too?

I would love to get more insight.

Thanks for taking the time
Cheers Michael

On Fri, Jul 6, 2012 at 12:24 PM, Alessandro Tagliapietra
tagliapietra.alessan...@gmail.com wrote:

Hello guys, i've some servers at hetzner,
i've actually installed essex on those and they're working fine, the step i'm 
missing is that hetzner gives you additional ip fixed to one host or failover 
ip that i can move to one server to another with the api.
What i want is to assign floating ip to vm, depending on which host the vm is 
running or use a create hook to move the failover ip to the host which is 
running the vm. Is it possible in some way?

Best Regards
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] 答复: [OpenStack][Nova] Live Migration + NFSv4 - Permission issues

2012-07-06 Thread Mandar Vaze / मंदार वझे

 So i've managed to get my instances to launch, thx Mandar!


Does that mean you used nfsv3 ? Based on the comments on the URL, several
people (all ??) seems to have problem with nfsv4

*Anne, Is it possible to add this to FAQ (or relevant document(s) )? *(after
Leander confirms that nfs v3 solved the problem)
(See https://answers.launchpad.net/nova/+question/164689,
specifically comment #11)

-Mandar
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread John Paul Walters
Earlier is totally fine.  I want to strike a balance with the people on the 
west coast.  How about noon EDT or even 11am EDT?  Is that getting too early 
for the west coast?

JP


On Jul 6, 2012, at 11:55 AM, Tim Bell wrote:

 
 Would it be possible a bit earlier ? This would be 10pm in Europe so it
 would limit the participation.
 
 Tim
 
 -Original Message-
 From: openstack-bounces+tim.bell=cern...@lists.launchpad.net
 [mailto:openstack-bounces+tim.bell=cern...@lists.launchpad.net] On Behalf
 Of Narayan Desai
 Sent: 06 July 2012 17:08
 To: John Paul Walters
 Cc: openstack@lists.launchpad.net (openstack@lists.launchpad.net)
 Subject: Re: [Openstack] [HPC] Openstack HPC telecon
 
 On Fri, Jul 6, 2012 at 9:51 AM, John Paul Walters jwalt...@isi.edu
 wrote:
 
 Does something like the first Monday of the month at 4:00pm EDT (UTC-4)
 work?  I'm just throwing out that time as something that seems to broadly
 work on my end, but I'd welcome any input from others.
 
 That generally works fine for me.
 -nld
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread John Paul Walters
Stefano,


 
 This is a great idea. HPC is an interesting topic and discussions around
 it may be useful for lots of people. As format, I would suggest
 something that can be recorded and played back conveniently, after it
 happened. Casual Hangouts on Google are very trendy lately (it's the new
 toy) and come with the advantage of going to youtube once they're done.
 The good old audio conference is also good, if it can be recorded can
 become a podcast. There are plenty of tools available for that.
 
 What would be an 'agenda' (loosely defined points to discuss or
 illustrate?) for the first meeting?
 

A Google Hangout is an option.  My only reluctance is that I don't want a 
Google+ account to be a barrier to participation if we can avoid it.  I don't 
have a strong opinion here, do others?


As far as an agenda, I'd like to accomplish the following:

1) I'd like to hear from those who are currently or /planning to stand up an 
HPC cloud
2) Discussion on the best practices for (1)
3) I'd like to give an update on the HPC extensions we're working on
4) User feedback - what features are missing (low hanging fruit, especially)

This may be more than we can get to in an initial meeting, but it's a start.  
I'm also open to other agenda items.

best,
JP


 Does something like the first Monday of the month at 4:00pm EDT 
 (UTC-4) work?  I'm just throwing out that time as something that 
 seems to broadly work on my end, but I'd welcome any input from 
 others.
 
 That may be problematic for Europeans. Who else would be interested in
 speaking? If we record the chat, listeners can enjoy it any time.
 
 /stef


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [HPC] BoF at SC12

2012-07-06 Thread John Paul Walters
I'm strongly considering putting together a proposal for a BoF (birds of a 
feather) session at this year's Supercomputing in Salt Lake City.  For those of 
you who are likely to attend, is anyone else interested?  It's not a huge 
amount of time invested on my end to put together the proposal, but I'd like to 
gauge the community interest before doing so.  I would likely broaden things a 
bit from being exclusively Openstack and instead turn it into more of an HPC in 
the Cloud session so that we could, perhaps, take some input from other HPC 
cloud projects.   The submissions are due July 31, so we've got a little bit of 
time, but not too much.  Anyone else interested?

best,
JP
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [OpenStack][Nova] Live Migration Error

2012-07-06 Thread Mandar Vaze / मंदार वझे
Not sure if you are able to debug this, but a while ago there was a bug
where instance.id was passed where instance.uuid was expected. This used to
cause some problem.
It looks like you are using distribution package rather than devstack
installation, so it is likely that the issue is now fixed. Can you try
latest packages (and/or try devstack if you can)

I wish I could help more.

-Mandar


On Fri, Jul 6, 2012 at 3:26 PM, Leander Bessa Beernaert leande...@gmail.com
 wrote:

 Hello,

 I've recently setup a system to test out the live migration feature. So
 far i've been able to launch the instances with the shared nfs folder.
 However, when i run the live-migration command i encounter this error in
 the destination compute node:

 2012-07-05 09:33:48 ERROR nova.manager [-] Error during
 ComputeManager.update_available_resource: Domain not found: no domain with
 matching id 2
 2012-07-05 09:33:48 TRACE nova.manager Traceback (most recent call last):
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/manager.py, line 155, in
 periodic_tasks
 2012-07-05 09:33:48 TRACE nova.manager task(self, context)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/compute/manager.py, line 2409, in
 update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager
 self.driver.update_available_resource(context, self.host)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1936, in update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager 'vcpus_used':
 self.get_vcpu_used(),
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1743, in get_vcpu_used
 2012-07-05 09:33:48 TRACE nova.manager dom =
 self._conn.lookupByID(dom_id)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/libvirt.py, line 2363, in lookupByID
 2012-07-05 09:33:48 TRACE nova.manager if ret is None:raise
 libvirtError('virDomainLookupByID() failed', conn=self)
 2012-07-05 09:33:48 TRACE nova.manager libvirtError: Domain not found: no
 domain with matching id 2


 Any ideas on how to solve this?

 Regards,
 Leander

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Matt Joyce
I think that's probably fine.  Might conflict with lunch... but you know
you gotta decide whats important to you =P.

On Fri, Jul 6, 2012 at 10:14 AM, John Paul Walters jwalt...@isi.edu wrote:

 Earlier is totally fine.  I want to strike a balance with the people on
 the west coast.  How about noon EDT or even 11am EDT?  Is that getting too
 early for the west coast?

 JP


 On Jul 6, 2012, at 11:55 AM, Tim Bell wrote:

 
  Would it be possible a bit earlier ? This would be 10pm in Europe so it
  would limit the participation.
 
  Tim
 
  -Original Message-
  From: openstack-bounces+tim.bell=cern...@lists.launchpad.net
  [mailto:openstack-bounces+tim.bell=cern...@lists.launchpad.net] On
 Behalf
  Of Narayan Desai
  Sent: 06 July 2012 17:08
  To: John Paul Walters
  Cc: openstack@lists.launchpad.net (openstack@lists.launchpad.net)
  Subject: Re: [Openstack] [HPC] Openstack HPC telecon
 
  On Fri, Jul 6, 2012 at 9:51 AM, John Paul Walters jwalt...@isi.edu
  wrote:
 
  Does something like the first Monday of the month at 4:00pm EDT (UTC-4)
  work?  I'm just throwing out that time as something that seems to
 broadly
  work on my end, but I'd welcome any input from others.
 
  That generally works fine for me.
  -nld
 
  ___
  Mailing list: https://launchpad.net/~openstack
  Post to : openstack@lists.launchpad.net
  Unsubscribe : https://launchpad.net/~openstack
  More help   : https://help.launchpad.net/ListHelp


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Narayan Desai
On Fri, Jul 6, 2012 at 11:52 AM, Stefano Maffulli stef...@openstack.org wrote:
 On 07/06/2012 07:51 AM, John Paul Walters wrote:
 One of the outputs of the design summit was that folks are
 interested in participating in a monthly (or so) telecon to express
 feature requests, best practices, etc.  I'd like to get this process
 started. For those of you who are interested, what's the preferred
 format? IRC, telephone, something else?

I've been using google hangouts for this sort of thing lately, and I
think it would be a great solution, provided we don't overrun the
maximum group size. (iirc it is 10, but being raised)

There are also provisions for recording hangouts.
 -nld

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] 答复: [OpenStack][Nova] Live Migration + NFSv4 - Permission issues

2012-07-06 Thread Leander Bessa Beernaert
I'm still using nfsv4 so far, still haven't tried with nfs3. I will give it
shot on monday though.

On Fri, Jul 6, 2012 at 6:24 PM, Anne Gentle anne.gen...@rackspace.comwrote:

  Sure, please make a doc bug at
 http://bugs.launchpad.net/Openstack-manuals and we'll triage it by
 linking to the conclusions posted here.

 Anne Gentle
 Content Stacker
 a...@openstack.org


 On Jul 6, 2012, at 1:11 PM, Mandar Vaze / मंदार वझे 
 mandarv...@gmail.com wrote:

So i've managed to get my instances to launch, thx Mandar!


  Does that mean you used nfsv3 ? Based on the comments on the URL,
 several people (all ??) seems to have problem with nfsv4

  *Anne, Is it possible to add this to FAQ (or relevant document(s) )? *(after
 Leander confirms that nfs v3 solved the problem)
 (See https://answers.launchpad.net/nova/+question/164689,
 specifically comment #11)

  -Mandar


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [OpenStack][Nova] Live Migration Error

2012-07-06 Thread Leander Bessa Beernaert
Thanks for the tip, it's a better than nothing :)

Regards,
Leander
On Fri, Jul 6, 2012 at 6:32 PM, Mandar Vaze / मंदार वझे 
mandarv...@gmail.com wrote:

 Not sure if you are able to debug this, but a while ago there was a bug
 where instance.id was passed where instance.uuid was expected. This used
 to cause some problem.
 It looks like you are using distribution package rather than devstack
 installation, so it is likely that the issue is now fixed. Can you try
 latest packages (and/or try devstack if you can)

 I wish I could help more.

 -Mandar


 On Fri, Jul 6, 2012 at 3:26 PM, Leander Bessa Beernaert 
 leande...@gmail.com wrote:

 Hello,

 I've recently setup a system to test out the live migration feature. So
 far i've been able to launch the instances with the shared nfs folder.
 However, when i run the live-migration command i encounter this error in
 the destination compute node:

 2012-07-05 09:33:48 ERROR nova.manager [-] Error during
 ComputeManager.update_available_resource: Domain not found: no domain with
 matching id 2
 2012-07-05 09:33:48 TRACE nova.manager Traceback (most recent call last):
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/manager.py, line 155, in
 periodic_tasks
 2012-07-05 09:33:48 TRACE nova.manager task(self, context)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/compute/manager.py, line 2409, in
 update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager
 self.driver.update_available_resource(context, self.host)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1936, in update_available_resource
 2012-07-05 09:33:48 TRACE nova.manager 'vcpus_used':
 self.get_vcpu_used(),
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py, line
 1743, in get_vcpu_used
 2012-07-05 09:33:48 TRACE nova.manager dom =
 self._conn.lookupByID(dom_id)
 2012-07-05 09:33:48 TRACE nova.manager   File
 /usr/lib/python2.7/dist-packages/libvirt.py, line 2363, in lookupByID
 2012-07-05 09:33:48 TRACE nova.manager if ret is None:raise
 libvirtError('virDomainLookupByID() failed', conn=self)
 2012-07-05 09:33:48 TRACE nova.manager libvirtError: Domain not found:
 no domain with matching id 2


 Any ideas on how to solve this?

 Regards,
 Leander

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [HPC] Openstack HPC telecon

2012-07-06 Thread Alan Kavanagh
Hi Paul

I like the suggestion, first Monday of the month is a good suggestion. A 
telephone conf would be preferable. Timewise im flexible.

Alan

-Original Message-
From: openstack-bounces+alan.kavanagh=ericsson@lists.launchpad.net 
[mailto:openstack-bounces+alan.kavanagh=ericsson@lists.launchpad.net] On 
Behalf Of John Paul Walters
Sent: July-06-12 10:51 AM
To: openstack@lists.launchpad.net (openstack@lists.launchpad.net)
Subject: [Openstack] [HPC] Openstack HPC telecon

Hi All,

One of the outputs of the design summit was that folks are interested in 
participating in a monthly (or so) telecon to express feature requests, best 
practices, etc.  I'd like to get this process started.  For those of you who 
are interested, what's the preferred format?  IRC, telephone, something else?  
Depending on the number of people who are interested, we're (ISI) capable of 
hosting a conference call.  

Does something like the first Monday of the month at 4:00pm EDT (UTC-4) work?  
I'm just throwing out that time as something that seems to broadly work on my 
end, but I'd welcome any input from others.

best,
JP
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] OpenStack Community Weekly Newsletter (June 29 – July 6)

2012-07-06 Thread Stefano Maffulli

Highlights of the week


  Folsom-2 milestone available for Keystone, Glance, Nova, Horizon
  and Quantum http://markmail.org/message/qvqf726fdrteso23

The second milestone of the Folsom cycle is now available for Keystone,
Glance, Nova, Horizon and Quantum ! Note that the corresponding Python
client libraries are no longer shipped as part of the server counterpart
delivery, but follow their own release plan. A *Folsom-2* milestone is
available for Cinder http://markmail.org/message/624ayix7sgmkc7zn, too.


  New nova-rootwrap landing in folsom-2
  
http://fnords.wordpress.com/2012/07/02/new-nova-rootwrap-landing-in-folsom-2/

Thierry Carrez contributed a new, more configurable and extensible
nova-rootwrap implementation. Here is what you should know about it,
depending on whether you’re a Nova user, packager or developer!


  OpenStack “G” naming poll
  http://markmail.org/message/ezvxlqa7xu2pym5j

It’s already time to decide the name of the future OpenStack release.
Participate to the poll.
https://launchpad.net/%7Eopenstack/+poll/g-release-naming


  Best practices for merging common into specific projects
  http://markmail.org/message/qtwrzol6ju35gzlx

Andrew Bogott started a conversation about defining some *best*
*practices* when crossing the boundary between common and other
openstack projects. It developed into a request for leadership for
openstack-common so that it can become a proper library.


  RPC Guarantees in OpenStack
  http://eric.windisch.us/2012/07/06/rpc-guarantees-in-openstack/

Eric Windisch http://planet.openstack.org/ describes the required
guarantees of OpenStack RPC implementations.


  A brief introduction to quantum plugin-Ryu
  
http://cloudcenter.sinaapp.com/2012/07/02/a-brief-introduction-to-quantum-plugin-ryu/?utm_source=rssutm_medium=rssutm_campaign=a-brief-introduction-to-quantum-plugin-ryu

Yaguang Tang reminds us of Ryu, a Quantum plugin developed by NTT. Ryu
aims to provide a logically centralized control and well defined API
that make it easy for operators to create new network management and
control applications. Details on http://osrg.github.com/ryu/


  Tips and tricks

  * By Soren Hansen: If you’re trying to do asymmetric routing in Ubuntu
12.04..

http://blog.linux2go.dk/2012/07/03/if-youre-trying-to-do-asymmetric-routing-in-ubuntu-12-04/
  * By Yaguang Tang: how to use the notification system in openstack

http://cloudcenter.sinaapp.com/2012/07/01/notification-system-in-openstack/?utm_source=rssutm_medium=rssutm_campaign=notification-system-in-openstack


Upcoming Events

  * OSCON
http://www.openstack.org/assets/oscon-pavilion-prospectus-2012.pdf
Jul 16 – 20, 2012 – Portland, OR Sponsor
http://www.openstack.org/assets/oscon-pavilion-prospectus-2012.pdf
  * 13th International Free Software Forum – OpenStack Track
http://wiki.openstack.org/FISL13 Jul 25 – 28, 2012 – Porto Alegre,
Brazil Coordination http://wiki.openstack.org/FISL13
  * 2012 OpenStack APEC Conference
http://openstack.csdn.net/index.html Aug 10 – 11, 2012 –
Bejing+Shanghai, China Details http://openstack.csdn.net/index.html
  * Call for proposals for linux.conf.au 2013
http://markmail.org/message/cbmtzazcefh6d6bw
  * OpenStack Summit http://openstack.org/ Oct 15 – 18, 2012 – San
Diego, CA


Other news

  * OpenStack Project Meeting logs: 2012-07-03: Summary

http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-07-03-21.02.html
and Full log

http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-07-03-21.02.log.html


Welcome new contributors

Celebrating the first patches submitted this week by:

  * chnm-kulkarni
  * Syed Armani

/The weekly newsletter is a way for the community to learn about all the
various activities occurring on a weekly basis. If you would like to add
content to a weekly update or have an idea about this newsletter, please
leave a comment./

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Per host floating ip

2012-07-06 Thread Michael Grosser
Sounds like a solution, but a manual one. A more automatic way would
be great I reckon.

On Fri, Jul 6, 2012 at 7:00 PM, Marnus van Niekerk m...@mjvn.net wrote:
 I have limited knowledge of OpenStack, but I host many servers with Hetzner
 and know their infrastructure well.

 Since nova allows you to assign specific floating IPs to specific instances
 you could do the following.
 Create a floating range include all of the IPs Hetzner has given you.
 Then just associate the IP from the underlying host with a VM running on it
 that host using euca-associate-address.

 On 06/07/2012 18:17, Michael Grosser wrote:

 Hey,

 I would love to hear more on your setup at hetzner, I was looking to
 setup openstack there myself, but I didn't see a solution for the per
 server ip issue.
 How many machines do you use?
 How did you set it up?
 Do you use only nova or swift too?

 I would love to get more insight.

 Thanks for taking the time
 Cheers Michael

 On Fri, Jul 6, 2012 at 12:24 PM, Alessandro Tagliapietra
 tagliapietra.alessan...@gmail.com wrote:

 Hello guys, i've some servers at hetzner,
 i've actually installed essex on those and they're working fine, the step
 i'm missing is that hetzner gives you additional ip fixed to one host or
 failover ip that i can move to one server to another with the api.
 What i want is to assign floating ip to vm, depending on which host the vm
 is running or use a create hook to move the failover ip to the host which is
 running the vm. Is it possible in some way?

 Best Regards
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [Nova] Networking changes and quantum

2012-07-06 Thread Ryan Lane
I'm trying to add support to nova for BGP announcements for floating
IP addresses (as an alternative to subnetting and ARP). The change
currently has a -1, since networking code is moving to quantum. It
seems that quantum doesn't have floating IP support, though. Where
should I be adding this code?

https://review.openstack.org/#/c/9255/

- Ryan

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Nova] Networking changes and quantum

2012-07-06 Thread Dan Wendlandt
Hi Ryan,

L3 + Floating IPs are being added to Quantum in F-3 (got bumped from F-2).


I haven't looked at your patch in detail, but it seems like you're looking
to notice when a floating-ip is allocated or deallocated, and use that to
trigger a change to the configuration of an external BGP daemon.

Assuming that's the case, I'd much rather we take the approach of creating
a notification API that would let you build this functionality as an
external component process that feeds off of notifications about floating
IPs being allocated and deallocated.  We're looking at something similar
for DHCP as well. This let's people implement custom functionality without
having to modify the core code and config files.  We have a blueprint to
add such a notification framework to Quantum (likely based on work in
Nova), but at this point, but its not clear when this will land (likely
depends on whether it is used for DHCP improvements in F-3 or not).  If
you're interested in helping out with it, let me know.

Dan


On Fri, Jul 6, 2012 at 5:09 PM, Ryan Lane rl...@wikimedia.org wrote:

 I'm trying to add support to nova for BGP announcements for floating
 IP addresses (as an alternative to subnetting and ARP). The change
 currently has a -1, since networking code is moving to quantum. It
 seems that quantum doesn't have floating IP support, though. Where
 should I be adding this code?

 https://review.openstack.org/#/c/9255/

 - Ryan

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp




-- 
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.com
twitter: danwendlandt
~~~
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Openstack Compute Node Scalability

2012-07-06 Thread He Shu
Hi,

Could anyone please help on this?

Thanks,
cs

On Wed, Jul 4, 2012 at 10:32 PM, He Shu thecloudst...@gmail.com wrote:

 Hi,

 I'm fresh in OpenStack. I was looking at OpenStack architectures, one
 question comes up to my mind: what is the compute node scalability in
 openstack? What is the max number of compute nodes (hosts) that one cloud
 controller can support?

 I searched quite a while and unfortunately I didn't find anything useful.
 It appears that each compute node (host) advertises it's existence into
 mysql directly. I find this is uncomfortable because it's going to be the
 bottleneck. If the max number of connections the mysql supports is 100,
 then does it mean only 100 compute hosts can be supported at the same time?

 Thanks,
 cs

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Hashing image files

2012-07-06 Thread Michael Still
On 03/07/12 02:33, Alexey Ababilov wrote:
 Hi, Michael!
 
 I am curious to know: is it necessary for nova to save images in file
 which names are sha1 hashes from image IDs (UUIDs)?
 
 Nova saves root image under its sha1 hash:
 https://github.com/openstack/nova/blob/master/nova/virt/libvirt/connection.py#L1214
 but it saves kernel and ramdisk under their original IDs:
 https://github.com/openstack/nova/blob/master/nova/virt/libvirt/connection.py#L1199
 https://github.com/openstack/nova/blob/master/nova/virt/libvirt/connection.py#L1206
 
 Is it a security measure?

That code pre-dates my involvement with openstack. I'm not really sure
why the hash is used, given its the hash of the id not of the contents
of the file.

We could rework all that code if you wanted, but it would be the third
or fourth rewrite in two releases, so I feel a little like we should let
it sit for a bit before changing it again.

Cheers,
Mikal

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp