Re: [openstack-dev] [nova] nova cellsv2 and DBs / down cells / quotas

2018-10-28 Thread Sam Morrison
> On 26 Oct 2018, at 1:42 am, Dan Smith wrote: > >> I guess our architecture is pretty unique in a way but I wonder if >> other people are also a little scared about the whole all DB servers >> need to up to serve API requests? > > When we started down this path, we acknowledged that this

Re: [openstack-dev] [nova] nova cellsv2 and DBs / down cells / quotas

2018-10-24 Thread Sam Morrison
> On 24 Oct 2018, at 4:01 pm, melanie witt wrote: > > On Wed, 24 Oct 2018 10:54:31 +1100, Sam Morrison wrote: >> Hi nova devs, >> Have been having a good look into cellsv2 and how we migrate to them (we’re >> still on cellsv1 and about to upgrade to queens and sti

[openstack-dev] [nova] nova cellsv2 and DBs / down cells / quotas

2018-10-23 Thread Sam Morrison
Hi nova devs, Have been having a good look into cellsv2 and how we migrate to them (we’re still on cellsv1 and about to upgrade to queens and still run cells v1 for now). One of the problems I have is that now all our nova cell database servers need to respond to API requests. With cellsv1 our

Re: [openstack-dev] [nova][cinder][neutron] Cross-cell cold migration

2018-08-22 Thread Sam Morrison
I think in our case we’d only migrate between cells if we know the network and storage is accessible and would never do it if not. Thinking moving from old to new hardware at a cell level. If storage and network isn’t available ideally it would fail at the api request. There is also ceph

[openstack-dev] [nova] Listing servers with filters and policy

2017-12-11 Thread Sam Morrison
Hi Nova devs, I’m after some feedback on how to give “non-admin” users the ability to list instances using “admin” filters. https://review.openstack.org/#/c/526558/ Basically just trying to be able to do some finer grained permission handling as

Re: [openstack-dev] [Openstack-operators] [nova][glance] Who needs multiple api_servers?

2017-05-01 Thread Sam Morrison
> On 1 May 2017, at 4:24 pm, Sean McGinnis wrote: > > On Mon, May 01, 2017 at 10:17:43AM -0400, Matthew Treinish wrote: >>> >> >> I thought it was just nova too, but it turns out cinder has the same exact >> option as nova: (I hit this in my devstack patch trying to

Re: [openstack-dev] [nova] nova-api-metadata managing firewall

2017-01-16 Thread Sam Morrison
Thanks Jens, Is someone able to change the status of the bug from won’t-fix to confirmed so its visible. Cheers, Sam > On 10 Jan 2017, at 10:52 pm, Jens Rosenboom <j.rosenb...@x-ion.de> wrote: > > 2017-01-10 4:33 GMT+01:00 Sam Morrison <sorri...@gmail.com > <m

[openstack-dev] [nova] nova-api-metadata managing firewall

2017-01-09 Thread Sam Morrison
Hi nova-devs, I raised a bug about nova-api-metadata messing with iptables on a host https://bugs.launchpad.net/nova/+bug/1648643 It got closed as won’t fix but I think it could do with a little more discussion. Currently nova-api-metadata will

[openstack-dev] [cinder] pending review

2016-12-12 Thread Sam Morrison
Hi Cinder devs, I’ve had a review [1] waiting for some eyes for over a month now. What’s the process here, usually I get a response to a review in other projects in a day or two. Is there someone I need to alert or add to the review specifically for cinder patches? Thanks, Sam [1]

Re: [openstack-dev] [gnocchi] influxdb driver gate error

2016-12-01 Thread Sam Morrison
a newer version of influxdb installed. Any idea how to do this? I see they push out a custom ceph repo to install a newer ceph so I guess we’d need to do something similar although influx don’t provide a repo, just a deb. Sam > On 30 Nov. 2016, at 7:35 pm, Sam Morrison <sorri...@gma

Re: [openstack-dev] [gnocchi] influxdb driver gate error

2016-11-30 Thread Sam Morrison
> On 30 Nov. 2016, at 6:23 pm, Mehdi Abaakouk <sil...@sileht.net> wrote: > > > > Le 2016-11-30 08:06, Sam Morrison a écrit : >> 2016-11-30 06:50:14.969302 | + pifpaf -e GNOCCHI_STORAGE run influxdb >> -- pifpaf -e GNOCCHI_INDEXER run mysql -- ./tools/pretty_tox

[openstack-dev] [gnocchi] influxdb driver gate error

2016-11-29 Thread Sam Morrison
Have been working on my influxdb driver [1] and have managed to figure out the gate to get it to install the deps ect. Now I just get this cryptic error 2016-11-30 06:50:14.969302 | + pifpaf -e GNOCCHI_STORAGE run influxdb -- pifpaf -e GNOCCHI_INDEXER run mysql -- ./tools/pretty_tox.sh

Re: [openstack-dev] [Openstack-operators] [puppet][fuel][packstack][tripleo] puppet 3 end of life

2016-11-03 Thread Sam Morrison
> On 4 Nov. 2016, at 1:33 pm, Emilien Macchi <emil...@redhat.com> wrote: > > On Thu, Nov 3, 2016 at 9:10 PM, Sam Morrison <sorri...@gmail.com > <mailto:sorri...@gmail.com>> wrote: >> Wow I didn’t realise puppet3 was being deprecated, is anyone actually us

Re: [openstack-dev] [Openstack-operators] [puppet][fuel][packstack][tripleo] puppet 3 end of life

2016-11-03 Thread Sam Morrison
Wow I didn’t realise puppet3 was being deprecated, is anyone actually using puppet4? I would hope that the openstack puppet modules would support puppet3 for a while still, at lest until the next ubuntu LTS is out else we would get to the stage where the openstack release supports Xenial but

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-09-19 Thread Sam Morrison
Hi Julien, > On 16 Sep 2016, at 7:46 PM, Julien Danjou wrote: > >> I could push it up to gerrit but I think something will need to change >> for it to run the influxdb tests? > > You can use pifpaf like we do for the indexer, InfluxDB is supported. > That should make it

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-09-15 Thread Sam Morrison
as there are a few ways it could be architected. Cheers, Sam [1] gnocchi.tests.test_rest.MetricTest.test_add_measures_back_window > On 6 Sep 2016, at 11:24 AM, Sam Morrison <sorri...@gmail.com> wrote: > > Hi Julien, > >> On 5 Sep 2016, at 5:36 PM, Julien Danjou &l

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-09-06 Thread Sam Morrison
The index lives in gnocchi index much like the other drivers, all that is stored in influx db is the samples (time, metric_id, value) Sam > Max > From: Sam Morrison <sorri...@gmail.com> > Sent: September 5, 2016 9:24:21 PM > To: Julien Danjou > Cc: OpenStack Development Mail

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-09-05 Thread Sam Morrison
Hi Julien, > On 5 Sep 2016, at 5:36 PM, Julien Danjou <jul...@danjou.info> wrote: > > On Mon, Sep 05 2016, Sam Morrison wrote: > > Hi Sam, > >> The issue I’m having are with the tests. Because the continuous queries are >> asynchronous and there is no c

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-09-04 Thread Sam Morrison
failing everything is working quite well. I’m going to start some load testing soon to see what it’s like when pushing in a lot of metrics. Wondering if there would be time to talk about this in Barcelona. Cheers, Sam > On 4 Aug 2016, at 2:59 PM, Sam Morrison <sorri...@gmail.com> wrote

Re: [openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-08-03 Thread Sam Morrison
gt; wrote: > > On Tue, Aug 02 2016, Sam Morrison wrote: > > Hi Sam! > >> We have been using gnocchi for a while now with the influxDB driver >> and are keen to get the influxdb driver back into upstream. >> >> However looking into the code and ho

[openstack-dev] [gnocchi] Support for other drivers - influxdb

2016-08-01 Thread Sam Morrison
Hi Gnocchi Devs, We have been using gnocchi for a while now with the influxDB driver and are keen to get the influxdb driver back into upstream. However looking into the code and how it’s arranged it looks like there are a lot of assumptions that the backend storage driver is carbonara based.

Re: [openstack-dev] [puppet] [desginate] An update on the state of puppet-designate (and designate in RDO)

2016-07-05 Thread Sam Morrison
We (NeCTAR) use puppet-designate on Ubuntu 14.04 with Liberty. Cheers, Sam > On 6 Jul 2016, at 11:47 AM, David Moreau Simard wrote: > > Hi ! > > tl;dr > puppet-designate is going under some significant updates to bring it > up to par right now. > While I will try to ensure

Re: [openstack-dev] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

2016-07-05 Thread Sam Morrison
We had some issues related to this too, we ended up changing our collect_statistics_interval to 30 seconds as opposed to the default which is 5 I think. We also upgraded to 3.6.2 and that version is very buggy and wouldn’t recommend anyone to use it. It has a memory leak and some other nasty

Re: [openstack-dev] [glance] Proposal for a mid-cycle virtual sync on operator issues

2016-05-25 Thread Sam Morrison
I’m hoping some people from the Large Deployment Team can come along. It’s not a good time for me in Australia but hoping someone else can join in. Sam > On 26 May 2016, at 2:16 AM, Nikhil Komawar wrote: > > Hello, > > > Firstly, I would like to thank Fei Long for

Re: [openstack-dev] [Openstack-operators] [glance] glance-registry deprecation: Request for feedback

2016-05-15 Thread Sam Morrison
> On 14 May 2016, at 5:36 AM, Flavio Percoco <fla...@redhat.com> wrote: > >> On 5/12/16 9:20 PM, Sam Morrison wrote: >> >> We find glance registry quite useful. Have a central glance-registry api >> is useful when you have multiple datacenters all w

Re: [openstack-dev] [Openstack-operators] [glance] glance-registry deprecation: Request for feedback

2016-05-12 Thread Sam Morrison
We find glance registry quite useful. Have a central glance-registry api is useful when you have multiple datacenters all with glance-apis and talking back to a central registry service. I guess they could all talk back to the central DB server but currently that would be over the public

Re: [openstack-dev] [Openstack-operators] [cinder] [all] The future of Cinder API v1

2015-09-28 Thread Sam Morrison
Yeah we’re still using v1 as the clients that are packaged with most distros don’t support v2 easily. Eg. with Ubuntu Trusty they have version 1.1.1, I just updated our “volume” endpoint to point to v2 (we have a volumev2 endpoint too) and the client breaks. $ cinder list ERROR: OpenStack

Re: [openstack-dev] [nova][cinder] how to handle AZ bug 1496235?

2015-09-24 Thread Sam Morrison
> On 24 Sep 2015, at 6:19 pm, Sylvain Bauza wrote: > > Ahem, Nova AZs are not failure domains - I mean the current implementation, > in the sense of many people understand what is a failure domain, ie. a > physical unit of machines (a bay, a room, a floor, a datacenter). >

Re: [openstack-dev] [nova][cinder] how to handle AZ bug 1496235?

2015-09-23 Thread Sam Morrison
Just got alerted to this on the operator list. We very much rely on this. We have multiple availability zones in nova and each zone has a corresponding cinder-volume service(s) in the same availability zone. We don’t want people attaching a volume from one zone to another as the network won’t

Re: [openstack-dev] [nova][cinder] how to handle AZ bug 1496235?

2015-09-23 Thread Sam Morrison
> On 24 Sep 2015, at 9:59 am, Andrew Laski wrote: > > I was perhaps hasty in approving that patch and didn't realize that Matt had > reached out for operator feedback at the same time that he proposed it. Since > this is being used in production I wouldn't want it to be

Re: [openstack-dev] [Openstack-operators] [keystone][all] Deprecating slash ('/') in project names

2015-07-06 Thread Sam Morrison
Do you mean project names or project IDs? Sam On 3 Jul 2015, at 12:12 am, Henrique Truta henriquecostatr...@gmail.com wrote: Hi everyone, In Kilo, keystone introduced the concept of Hierarchical Multitenancy[1], which allows cloud operators to organize projects in hierarchies. This

Re: [openstack-dev] [Openstack-operators] [nova] [neutron] Re: How do your end users use networking?

2015-06-17 Thread Sam Morrison
On 17 Jun 2015, at 8:35 pm, Neil Jerram neil.jer...@metaswitch.com wrote: Hi Sam, On 17/06/15 01:31, Sam Morrison wrote: We at NeCTAR are starting the transition to neutron from nova-net and neutron almost does what we want. We have 10 “public networks and 10 “service networks

Re: [openstack-dev] [Openstack-operators] [nova] [neutron] Re: How do your end users use networking?

2015-06-17 Thread Sam Morrison
On 18 Jun 2015, at 2:59 am, Neil Jerram neil.jer...@metaswitch.com wrote: On 17/06/15 16:17, Kris G. Lindgren wrote: See inline. Kris Lindgren Senior Linux Systems Engineer GoDaddy, LLC. On 6/17/15, 5:12 AM, Neil Jerram

Re: [openstack-dev] [Openstack-operators] [nova] [neutron] Re: How do your end users use networking?

2015-06-16 Thread Sam Morrison
On 17 Jun 2015, at 10:56 am, Armando M. arma...@gmail.com wrote: On 16 June 2015 at 17:31, Sam Morrison sorri...@gmail.com mailto:sorri...@gmail.com wrote: We at NeCTAR are starting the transition to neutron from nova-net and neutron almost does what we want. We have 10 “public

Re: [openstack-dev] [Openstack-operators] [nova] [neutron] Re: How do your end users use networking?

2015-06-16 Thread Sam Morrison
We at NeCTAR are starting the transition to neutron from nova-net and neutron almost does what we want. We have 10 “public networks and 10 “service networks and depending on which compute node you land on you get attached to one of them. In neutron speak we have multiple shared externally

[openstack-dev] [nova] Tempest failure help

2015-05-19 Thread Sam Morrison
Hi nova devs, I have a patch https://review.openstack.org/#/c/181776/ https://review.openstack.org/#/c/181776/ where I have a failing tempest job which I can’t figure out. Can anyone help me? Cheers, Sam __ OpenStack

Re: [openstack-dev] [nova] readout from Philly Operators Meetup

2015-03-11 Thread Sam Morrison
On 11 Mar 2015, at 11:59 pm, Sean Dague s...@dague.net wrote: Nova Rolling Upgrades - Most people really like the concept, couldn't find anyone that had used it yet because Neutron doesn't support it, so they had to big bang upgrades anyway. I couldn’t make it to

Re: [openstack-dev] Taking a break..

2014-10-23 Thread Sam Morrison
Thanks for all the help Chris and all the best. Now on the lookout for another cells core I can harass and pass obscure bugs too. It was always reassuring knowing you’d probably already come across the issue and could point me to a review or git branch with a fix. Cheers, Sam On 23 Oct

Re: [openstack-dev] [Nova] Cells conversation starter

2014-10-22 Thread Sam Morrison
On 23 Oct 2014, at 5:55 am, Andrew Laski andrew.la...@rackspace.com wrote: While I agree that N is a bit interesting, I have seen N=3 in production [central API]--[state/region1]--[state/region DC1] \-[state/region DC2] --[state/region2 DC]

Re: [openstack-dev] [Openstack] [nova] Havana - Icehouse upgrades with cells

2014-04-24 Thread Sam Morrison
Hey Chris, On 24 Apr 2014, at 4:28 pm, Chris Behrens cbehr...@codestud.com wrote: On Apr 23, 2014, at 6:36 PM, Sam Morrison sorri...@gmail.com wrote: Yeah I’m not sure what’s going on, I removed my hacks and tried it using the conductor rpcapi service and got what I think is a recursive

Re: [openstack-dev] [Openstack] [nova] Havana - Icehouse upgrades with cells

2014-04-24 Thread Sam Morrison
On 25 Apr 2014, at 12:30 am, Chris Behrens cbehr...@codestud.com wrote: So, does your nova-conductor not have object version 1.13? As I was trying to get at in a previous reply, I think the only way this can possibly work is that you have Icehouse nova-conductor running in ALL cells. OK

Re: [openstack-dev] [Openstack] [nova] Havana - Icehouse upgrades with cells

2014-04-23 Thread Sam Morrison
, at 11:08 PM, Sam Morrison sorri...@gmail.com wrote: Thanks for the info Chris, I’ve actually managed to get things working. Haven’t tested everything fully but seems to be working pretty good. On 19 Apr 2014, at 7:26 am, Chris Behrens cbehr...@codestud.com wrote: The problem here

[openstack-dev] Glance Icehouse RC bugs

2014-04-07 Thread Sam Morrison
Hi, We’ve found a couple of bugs in glance RC. They both have simple fixes that fix some major features, I’m wondering if some glance experts can cast their eye on them and if they qualify for icehouse. glance registry v2 doesn't work (This has got some attention already, thanks)

[openstack-dev] [Nova][Cells] compute api and objects

2013-12-09 Thread Sam Morrison
Hi, I’m trying to fix up some cells issues related to objects. Do all compute api methods take objects now? cells is still sending DB objects for most methods (except start and stop) and I know there are more than that. Eg. I know lock/unlock, shelve/unshelve take objects, I assume there are

Re: [openstack-dev] Shall backward compatibility env. vars be removed from python-clients?

2013-11-08 Thread Sam Morrison
I think you need to do option 2 and print deprecation warnings, then the question becomes for how long. I think there is a policy for this and that it is deprecate in N remove in N+1 Clients are a bit different so maybe keep it for ~6 months? Sam On 8 Nov 2013, at 10:49 am, Leandro

[openstack-dev] [Nova] upgrade_levels and cells

2013-10-27 Thread Sam Morrison
Hey, I’ve been playing with Grizzly - Havana upgrade paths with cells. Having Havana at the api cell with Grizzly compute cells won’t work (don’t think it’s supposed too?) Having Grizzly at api level with Havana compute cell almost works, it seems the only major issue is the

Re: [openstack-dev] [Swift] container forwarding/cluster federation blueprint

2013-10-13 Thread Sam Morrison
Hi, I'd be interested in the differences this has to using swift global clusters? Cheers, Sam On 12/10/2013, at 3:49 AM, Coles, Alistair alistair.co...@hp.com wrote: We’ve just committed a first set of patches to gerrit that address this blueprint:

Re: [openstack-dev] [Ceilometer] Ceilometer and nova compute cells

2013-08-01 Thread Sam Morrison
On 31/07/2013, at 6:45 PM, Julien Danjou jul...@danjou.info wrote: On Wed, Jul 31 2013, Sam Morrison wrote: Hi Sam, Does everything that gets stored in the datastore go through the ceilometer.collector.metering queue? If you only use the RPC publisher (which is the default), yes