Re: [Openstack-operators] OPs Midcycle location discussion.

2015-11-18 Thread Jonathan D. Proulx
On Wed, Nov 18, 2015 at 03:44:03PM -0500, Erik McCormick wrote: :I'm still fishing for more specific details, but here is a snapshot of :how the Ceph Development Summit is handled. : :http://tracker.ceph.com/projects/ceph/wiki/CDS_Jewel : :It was previously done via Google Hangouts, but is now

[Openstack-operators] Ops meetup: Ops Guide Working session.

2016-04-23 Thread Jonathan D. Proulx
;tldr Help fix the OPs Guide Monday 11:15am - 11:55am Hilton Austin MR 406 etherpad: https://etherpad.openstack.org/p/AUS-ops-Docs-ops-guide OpenStack operation have grown a lot since the Operations Guide was first written (and even since it's last major revision) both because OpenStack as a

Re: [Openstack-operators] User Survey usage of QEMU (as opposed to KVM) ?

2016-05-11 Thread Jonathan D. Proulx
On Wed, May 11, 2016 at 07:30:45PM -0400, Emilien Macchi wrote: :On Tue, May 3, 2016 at 11:43 AM, Matt Riedemann : wrote: :> Another thought is that deployment tools are just copying what devstack :> does, or what shows up in the configs in our dsvm gate jobs, and

Re: [Openstack-operators] PCI Passthrough issues

2016-07-27 Thread Jonathan D. Proulx
On Tue, Jul 26, 2016 at 05:09:21PM +1000, Blair Bethwaite wrote: :Next question - has anyone figured out how to make GPU P2P work? We :haven't tried very hard yet, but with our current setup we're telling :Nova to pass through the GK210GL "3D controller" and that results in :the guest seeing

[Openstack-operators] Blazar? (Reservations and/or scheduled termination)

2016-08-03 Thread Jonathan D. Proulx
Hi All, As a private cloud operatior who doesn't charge internal users, I'd really like a way to force users to set an exiration time on their instances so if they forget about them they go away. I'd though Blazar was the thing to look at and Chameleoncloud.org seems to be using it (any of you

Re: [Openstack-operators] Blazar? (Reservations and/or scheduled termination)

2016-08-03 Thread Jonathan D. Proulx
involved with Scientific Working Group (at least enough to follow the ongoing discussions) Thanks, -Jon : :Tim : : :On 03/08/16 18:47, "Jonathan D. Proulx" <j...@csail.mit.edu> wrote: : :Hi All, : :As a private cloud operatior who doesn't charge internal users, I'd :r

[Openstack-operators] PCI Passthrough issues

2016-07-06 Thread Jonathan D. Proulx
Hi All, Trying to spass through some Nvidia K80 GPUs to soem instance and have gotten to the place where Nova seems to be doing the right thing gpu instances scheduled on the 1 gpu hypervisor I have and for inside the VM I see: root@gpu-x1:~# lspci | grep -i k80 00:06.0 3D controller: NVIDIA

Re: [Openstack-operators] PCI Passthrough issues

2016-07-06 Thread Jonathan D. Proulx
Jon, : :Do you have the nouveau driver/module loaded in the host by any :chance? If so, blacklist, reboot, repeat. : :Whilst we're talking about this. Has anyone had any luck doing this :with hosts having a PCI-e switch across multiple GPUs? : :Cheers, : :On 6 July 2016 at 23:27, Jonathan D. Proulx

Re: [Openstack-operators] [openstack-community] User Survey - Deadline Feb 20th

2017-02-02 Thread Jonathan D. Proulx
On Thu, Feb 02, 2017 at 04:12:25PM +, Neil Jerram wrote: :I notice that at the end of the survey, when I click on the "SUBMIT YOUR :SURVEY >" button, I just get the same page again, and so could click :"SUBMIT YOUR SURVEY >" again, and so on... : :You might want to look at fixing that; and in

Re: [Openstack-operators] Shelving

2016-08-18 Thread Jonathan D. Proulx
On Fri, Aug 19, 2016 at 06:48:12AM +1000, Michael Still wrote: :Shelved instances still consume IPs and hypervisor disk IIRC, so they're :not free for nova. So, there has to be some form of accounting of shelved :instances to stop resource exhaustion, especially in the IP space. : :I'm not opposed

Re: [Openstack-operators] Shelving

2016-08-18 Thread Jonathan D. Proulx
On Thu, Aug 18, 2016 at 03:24:28PM +, Tim Bell wrote: : :We’re having a look at VM shelving for the CERN community and struggling to find a motivation for a private cloud user to shelve their instances (and free up resources they may be only using infrequently). : :The problem is that

Re: [Openstack-operators] Nova

2016-09-06 Thread Jonathan D. Proulx
On Fri, Sep 02, 2016 at 04:00:17PM -0700, Adam Lawson wrote: :Mike that's just as I suspected. To be super clear, does KVM in particular :know how to distinguish between Ubuntu v12 versus v16? In other words, do I :need to be running a specific version of KVM hypervisor so it can host :guests

Re: [Openstack-operators] [Puppet][Neutron] Mitaka ML2/OVS config file mismatch

2016-09-07 Thread Jonathan D. Proulx
the stable/mitaka branch and see the commit in my working checkout. I hammered a kludge into place in my test env and when on to try and solve other issues, but I'll circle back and look more closely. Thanks, -Jon : :Thank you : :Saverio : : : :2016-09-01 16:32 GMT+02:00 Jonathan D. Proulx &l

Re: [Openstack-operators] Delete cinder service

2016-09-01 Thread Jonathan D. Proulx
On Thu, Sep 01, 2016 at 04:25:25PM +0300, Vladimir Prokofev wrote: :I've used direct database update to achive this in Mitaka: :use cinder; :update services set deleted = '1' where ; I belive the official way is: cinder-manage service remove Which probably more or less does the same thing...

Re: [Openstack-operators] [Puppet][Neutron] Mitaka ML2/OVS config file mismatch

2016-09-01 Thread Jonathan D. Proulx
On Thu, Sep 01, 2016 at 01:50:40PM +0200, Ihar Hrachyshka wrote: :ml2_conf.ini is to be loaded by neutron-server only. The agent should :not load it, instead relying on openvswitch_agent.ini file for :anything agent specific. If for some reason puppet does put agent :configuration options into

Re: [Openstack-operators] Converged infrastructure

2016-08-31 Thread Jonathan D. Proulx
On Wed, Aug 31, 2016 at 01:01:56PM +0100, Matt Jarvis wrote: : Like a lot of others we run Ceph, and we absolutely don't converge our : storage and compute nodes for a variety of performance and management : related reasons. In our experience, the hardware and tuning : characteristics of

[Openstack-operators] [Puppet][Neutron] Mitaka ML2/OVS config file mismatch

2016-08-31 Thread Jonathan D. Proulx
Hi All, I'm woking on testing my jump from Kilo->Mitaka Using puppet on ubuntu 14.04 with cloud archive packages. Puppet seems to be writing the ml2/ovs configs into /etc/neutron/plugins/ml2/ml2_conf.ini which is where the previously were, so I've spent a few day going around on this thinking

[Openstack-operators] [Nova] instance snapshot failure on mitaka

2016-09-12 Thread Jonathan D. Proulx
Hi All, In my continuing sporadic testing of Kilo->Mitaka upgrade I've run into an issue with Snapshotting instances. I'm seeing this Failure on the hypervisor: 2016-09-12 14:14:26.303 24723 ERROR oslo_messaging.rpc.dispatcher libvirtError: internal error: unable to execute QEMU command

Re: [Openstack-operators] Openstack team size vs's deployment size

2016-09-12 Thread Jonathan D. Proulx
I agree this would make a very interesting OPs session. As many have poitned out it's difficult to really quantify in a comparable way given the range of roles and approches. We have 1 region (going on 2) with 100 hypervisors providing a basic IaaS service (agian looking to expand into various

Re: [Openstack-operators] Openstack team size vs's deployment size

2016-09-13 Thread Jonathan D. Proulx
On Mon, Sep 12, 2016 at 03:26:02PM -0700, Clint Byrum wrote: :Excerpts from Mathieu Gagné's message of 2016-09-12 17:55:34 -0400: :> I also think that small team with small deployments has little :> incentive to invest in *heavy* automation (to help themselves) and/or :> tools to delegate its

Re: [Openstack-operators] ML2/OVS odd GRE brokenness

2016-11-09 Thread Jonathan D. Proulx
On Tue, Nov 08, 2016 at 06:27:34PM -0500, George Mihaiescu wrote: :Hi Jonathan, : :The openvswitch-agent is out of sync on compute 4, try restarting it. Nope. Restarted the agent on 4 and when that failed also on 1 they still can't talk. I had previously migrated 4 to a new host to test that

Re: [Openstack-operators] ML2/OVS odd GRE brokenness

2016-11-09 Thread Jonathan D. Proulx
Also I have restarted openvswitch-agent on both sides of the broken link and it made no difference... On Tue, Nov 08, 2016 at 05:43:27PM -0500, Jonathan Proulx wrote: : :I have an odd issue that seems to just be affecting one private :network for one tenant, though I saw a similar thing on a

Re: [Openstack-operators] ML2/OVS odd GRE brokenness

2016-11-09 Thread Jonathan D. Proulx
AM, Jonathan D. Proulx <j...@csail.mit.edu> wrote: :> :> :> Also I have restarted openvswitch-agent on both sides of the broken :> link and it made no difference... :> :> On Tue, Nov 08, 2016 at 05:43:27PM -0500, Jonathan Proulx wrote: :> : :> :I have an odd issue

Re: [Openstack-operators] [tags]Summit session to discuss about maturity of heat

2016-10-22 Thread Jonathan D. Proulx
I'll try and make it. OpsTags a miniscule number of actuve participants (like maybe one and it's not me, but I have been more active in the past so might be of some use) so I'll conter propose attending: Ops: Ops Tags Team Tue 25 5:05pm-5:45pm AC Hotel - P3 - Montjuic

Re: [Openstack-operators] How do you even test for that?

2016-10-18 Thread Jonathan D. Proulx
On Mon, Oct 17, 2016 at 05:45:07PM -0600, Matt Fischer wrote: :This does not cover all your issues but after seeing mysql bugs between I :and J and also J to K we now export and restore production control plane :data into a dev environment to test the upgrades. If we have issues we :destroy this

[Openstack-operators] PCI passthrough trying to use busy resource?

2016-10-18 Thread Jonathan D. Proulx
Hi all, I have a test GPU system that seemed to be working properly under Kilo running 1 and 2 GPU instnace types on an 8GPU server. After Mitaka upgrade it seems to alway try and assing the same Device which is alredy in use rather than pick one of the 5 currently available. Build of

Re: [Openstack-operators] PCI passthrough trying to use busy resource?

2016-10-18 Thread Jonathan D. Proulx
le | NULL | +-+-+-++-+--+---+--+ since it's only really 3 entries I can fix this by hand then head over to bug report land. -Jon On Tue, Oct 18, 2016 at 02:50:11PM -0400, Jonathan D. Proulx wrote: :Hi all, : :I have a test GPU system that seemed to be working properly under Kilo :running 1 and 2 GPU instnace types on an 8G

Re: [Openstack-operators] Setting default MTU for project networks?

2016-11-21 Thread Jonathan D. Proulx
On Sun, Nov 20, 2016 at 02:59:14AM -0800, Kevin Benton wrote: :Sorry about the delay, a couple of questions. No worries "working" was the important bit (which I got). Working correctly, well we can take our time :) :You're not setting network_device_mtu, right? no though maybe I should read

Re: [Openstack-operators] Disable console for an instance

2016-10-27 Thread Jonathan D. Proulx
On Thu, Oct 27, 2016 at 04:08:26PM +0200, Blair Bethwaite wrote: :On 27 October 2016 at 16:02, Jonathan D. Proulx <j...@csail.mit.edu> wrote: :> don't put a getty on the TTY :) : :Do you know how to do that with Windows? ...you can see the desire for :sandboxing now :-). Sigh yes I

Re: [Openstack-operators] Disable console for an instance

2016-10-27 Thread Jonathan D. Proulx
On Thu, Oct 27, 2016 at 02:27:48PM +0200, Blair Bethwaite wrote: : Looks like this is not currently possible. Does anyone else have an : interest in such a feature? : I'm thinking about it from the perspective of a public cloud user who : wants to build highly secure / sandboxed instances.

Re: [Openstack-operators] Disable console for an instance

2016-10-28 Thread Jonathan D. Proulx
That is an interesting angle. There *should* be a way to limit vnc acces to just the owner via RBAC. If you trust everything else to be setup right that's probbaly sufficient. Putting on my paranoid security hat, I wouldn't trust that. VNC access at least is completely unsecured at the

Re: [Openstack-operators] Question about ancient published OPS and Architecture guides

2016-10-31 Thread Jonathan D. Proulx
I always use the HTML versions and can't think of a case where I'd want the epub or mobi. If they are also out dated I definitly think they should be removed just to prevent confusion. If there's a wider desire for these formats (which I doubt) then they'd need to be published much more

Re: [Openstack-operators] Dealing with ITAR in OpenStack private clouds

2017-03-22 Thread Jonathan D. Proulx
On Tue, Mar 21, 2017 at 09:03:36PM -0400, Davanum Srinivas wrote: :Oops, Hit send before i finished : :https://info.massopencloud.org/wp-content/uploads/2016/03/Workshop-Resource-Federation-in-a-Multi-Landlord-Cloud.pdf :https://git.openstack.org/cgit/openstack/mixmatch : :Essentially you can do a

Re: [Openstack-operators] Flavors

2017-03-16 Thread Jonathan D. Proulx
I have always hated flavors and so do many of my users. On Wed, Mar 15, 2017 at 03:22:48PM -0700, James Downs wrote: :On Wed, Mar 15, 2017 at 10:10:00PM +, Fox, Kevin M wrote: :> I think the really short answer is something like: It greatly simplifies scheduling and billing. : :The real

[Openstack-operators] LTS Dreaming ... [was] Help: Liberty installation guide (English).

2017-04-11 Thread Jonathan D. Proulx
Riding the LTS tangent train ... On Tue, Apr 11, 2017 at 03:40:20PM +, Kevin Bringard (kevinbri) wrote: :Chasing trunk just isn’t feasible for larger organizations, and as Edgar mentioned, updating the code every 6 months (or even a year) is a really difficult proposition. : :There’s a

Re: [Openstack-operators] LTS Dreaming ... [was] Help: Liberty installation guide (English).

2017-04-11 Thread Jonathan D. Proulx
it's the Distros (and perhaps some larger users?) -Jon :Edgar : :On 4/11/17, 8:50 AM, "Jonathan D. Proulx" <j...@csail.mit.edu> wrote: : : :Riding the LTS tangent train ... : :On Tue, Apr 11, 2017 at 03:40:20PM +, Kevin Bringard (kevinbri) wrote: : ::Ch

Re: [Openstack-operators] LTS Dreaming ... [was] Help: Liberty installation guide (English).

2017-04-12 Thread Jonathan D. Proulx
On Tue, Apr 11, 2017 at 06:01:00PM -0500, Matt Riedemann wrote: :Right, but the distros aren't interested in funding developers for LTS :upstream work, much less a lot of the stable branch support upstream. It :shouldn't be surprising why, that's where they can make money. No doubt that's their

Re: [Openstack-operators] usage hours

2017-08-03 Thread Jonathan D. Proulx
On Wed, Aug 02, 2017 at 04:56:13PM -0500, Juanjuan Li wrote: :how does OpenStack calculate the vcpu hours, total disk usage hours : : :I created a cirros VM with the flavor of m1.tiny without further operation :on that VM.I created it around 2 hours ago but on the dashboard"Overview", :it shows