Re: [openstack-dev] [oslo][taskflow] Thoughts on moving taskflow out of openstack/oslo

2018-10-17 Thread Joshua Harlow
Dmitry Tantsur wrote: On 10/10/18 7:41 PM, Greg Hill wrote: I've been out of the openstack loop for a few years, so I hope this reaches the right folks. Josh Harlow (original author of taskflow and related libraries) and I have been discussing the option of moving taskflow out of the openstack

Re: [openstack-dev] [oslo][taskflow] Thoughts on moving taskflow out of openstack/oslo

2018-10-15 Thread Joshua Harlow
I'm ok with trying this move out and seeing how it goes (maybe it will be for the better, idk). -Josh On 10/10/2018 10:41 AM, Greg Hill wrote: I've been out of the openstack loop for a few years, so I hope this reaches the right folks. Josh Harlow (original author of taskflow and related

Re: [openstack-dev] [nova] How to debug no valid host failures with placement

2018-08-02 Thread Joshua Harlow
Storage space is a concern; really? If it really is, then keep X of them for some definition of X (days, number, hours, other)? Offload the snapshot asynchronously if snapshotting during requests is a problem. We have the power! :) Chris Friesen wrote: On 08/01/2018 11:34 PM, Joshua Harlow

Re: [openstack-dev] [nova] How to debug no valid host failures with placement

2018-08-01 Thread Joshua Harlow
If I could, I would have something *like* the EXPLAIN syntax for looking at a sql query, but instead of telling me the query plan for a sql query, it would tell me the decisions (placement plan?) that resulted in a given resource being placed at a certain location. And I would be able to say

Re: [openstack-dev] [all] [designate] [heat] [python3] deadlock with eventlet and ThreadPoolExecutor in py3.7

2018-07-25 Thread Joshua Harlow
with futurist 1.6.0). Does ThreadPoolExecutor have better performance than GreenThreadPoolExecutor? Curious if we could just swap out ThreadPoolExecutor for GreenThreadPoolExecutor. Thanks, Corey On Wed, Jul 25, 2018 at 12:54 PM, Joshua Harlow mailto:harlo...@fastmail.com>> wrote: Ha

Re: [openstack-dev] [all] [designate] [heat] [python3] deadlock with eventlet and ThreadPoolExecutor in py3.7

2018-07-25 Thread Joshua Harlow
Have you tried the following instead of threadpoolexecutor (which honestly should work as well, even under eventlet + eventlet patching). https://docs.openstack.org/futurist/latest/reference/index.html#futurist.GreenThreadPoolExecutor If you have the ability to specify which executor your code

Re: [openstack-dev] [StarlingX] StarlingX code followup discussions

2018-06-01 Thread Joshua Harlow
Slightly off topic but, Have you by any chance looked at what kata has forked for qemu: https://github.com/kata-containers/qemu/tree/qemu-lite-2.11.0 I'd be interested in an audit of that code for similar reasons to this libvirt fork (hard to know from my view point if there are new issues in

Re: [openstack-dev] [tc][all] A culture change (nitpicking)

2018-05-29 Thread Joshua Harlow
Jonathan D. Proulx wrote: On Tue, May 29, 2018 at 10:52:04AM -0400, Mohammed Naser wrote: :On Tue, May 29, 2018 at 10:43 AM, Artom Lifshitz wrote: :> One idea would be that, once the meat of the patch :> has passed multiple rounds of reviews and looks good, and what remains :> is only

Re: [openstack-dev] [StarlingX] StarlingX code followup discussions

2018-05-22 Thread Joshua Harlow
Also I am concerned that the repo just seems to have mega-commits like: https://github.com/starlingx-staging/stx-glance/commit/1ec64167057e3368f27a1a81aca294b771e79c5e https://github.com/starlingx-staging/stx-nova/commit/71acfeae0d1c59fdc77704527d763bd85a276f9a (not so mega)

Re: [openstack-dev] [oslo] proposing Ken Giusti for oslo-core

2018-03-26 Thread Joshua Harlow
+1 Ben Nemec wrote: +1! On 03/26/2018 10:52 AM, Doug Hellmann wrote: Ken has been managing oslo.messaging for ages now but his participation in the team has gone far beyond that single library. He regularly attends meetings, including the PTG, and has provided input into several of our team

Re: [openstack-dev] Zuul project evolution

2018-03-16 Thread Joshua Harlow
Awesome! Might IMHO be useful to also start doing this with other projects. James E. Blair wrote: Hi, To date, Zuul has (perhaps rightly) often been seen as an OpenStack-specific tool. That's only natural since we created it explicitly to solve problems we were having in scaling the testing

Re: [openstack-dev] [keystone] [oslo] new unified limit library

2018-03-12 Thread Joshua Harlow
limits: https://etherpad.openstack.org/p/unified-limits-rocky-ptg ## Revision History Introduced in Rocky On 03/07/2018 11:55 PM, Joshua Harlow wrote: So the following was a prior effort: https://github.com/openstack/delimiter Maybe just continue down the path of that and/or take that whole

Re: [openstack-dev] [oslo] Oslo PTG Summary

2018-03-08 Thread Joshua Harlow
Can we get some of those doc links opened. 'You need permission to access this published document.' I am getting for a few of them :( Ben Nemec wrote: Hi, Here's my summary of the discussions we had in the Oslo room at the PTG. Please feel free to reply with any additions if I missed

Re: [openstack-dev] [tc] [all] TC Report 18-10

2018-03-08 Thread Joshua Harlow
Thierry Carrez wrote: Joshua Harlow wrote: Thierry Carrez wrote: The PTG has always been about taking the team discussions that happened at the Ops Summit / Design Summit to have them in a more productive environment. I am just going to say it but can we *please* stop distinguishing between

Re: [openstack-dev] [tc] [all] TC Report 18-10

2018-03-08 Thread Joshua Harlow
Thierry Carrez wrote: Matt Riedemann wrote: I don't get the inward/outward thing. First two days of the old design summit (ops summit?) format was all cross-project stuff (docs, upgrades, testing, ops feedback, etc). That's the same as what happens at the PTG now too. The last three days of the

Re: [openstack-dev] [keystone] [oslo] new unified limit library

2018-03-07 Thread Joshua Harlow
So the following was a prior effort: https://github.com/openstack/delimiter Maybe just continue down the path of that and/or take that whole repo over and iterate (or adjust the prior code, or ...)?? Or if not that's ok to, ya'll get to decide.

Re: [openstack-dev] [automaton] How to extend automaton?

2018-02-13 Thread Joshua Harlow
As far a 1, I'd recommend just use functools.partial or make an object with all the extra stuff u want and have that object provide a __call__ method. As far as 2, you might have to subclass the FSM baseclass and add those into the internal data-structure (same for 3 I think); ie this one @

Re: [openstack-dev] [kolla] Policy regarding template customisation

2018-01-30 Thread Joshua Harlow
Yup, I am hoping to avoid all of these kinds of customizations if possible... But if we have to we'll probably have to make something like that. Or we'll just have to render out files for each host and serve it from the same REST endpoint, ya da ya da... -Josh Michał Jastrzębski wrote:

Re: [openstack-dev] [kolla] Policy regarding template customisation

2018-01-30 Thread Joshua Harlow
I'm ok with #2, Though I would like to show an alternative that we have been experimenting with that avoids the whole needs for a globals.yml and such files in the first place (and feels more naturally inline with how ansible works IMHO). So short explanation first; we have this yaml format

Re: [openstack-dev] [all] Switching to longer development cycles

2017-12-21 Thread Joshua Harlow
projects UI that does something similar). Matt Riedemann wrote: On 12/19/2017 2:29 PM, Joshua Harlow wrote: * Clear workflow state (and transition) 'machine' that is followed in code and can be used by operators/others such as UI developers to get a view on what nova is or is not doing (may fit

Re: [openstack-dev] [requirements][mistral][vitrage][octavia][taskflow][watcher] Networkx version 2.0

2017-12-21 Thread Joshua Harlow
I don't expect it to be a big thing for taskflow, I'll mess around this weekend; afaik most of the changes in networkx 2.0 were around making all the things iterators. Matthew Thode wrote: On 17-12-20 15:51:17, Afek, Ifat (Nokia - IL/Kfar Sava) wrote: Hi, There is an open bug in launchpad

Re: [openstack-dev] [all] Switching to longer development cycles

2017-12-20 Thread Joshua Harlow
Zane Bitter wrote: On 19/12/17 22:15, Fei Long Wang wrote: On 20/12/17 09:29, Joshua Harlow wrote: Zane Bitter wrote: Getting off-topic, but since you walked in to this one ;) On 14/12/17 21:43, Matt Riedemann wrote: What are the real problems that the Nova team is not working

Re: [openstack-dev] [all] Switching to longer development cycles

2017-12-19 Thread Joshua Harlow
Zane Bitter wrote: Getting off-topic, but since you walked in to this one ;) On 14/12/17 21:43, Matt Riedemann wrote: What are the real problems that the Nova team is not working on and apparently is a priority to everyone else in the OpenStack ecosystem but we are somehow oblivious? *

Re: [openstack-dev] [all] Community managed tech/dev blog: Call for opinions and ideas

2017-11-29 Thread Joshua Harlow
Thierry Carrez wrote: Jimmy McArthur wrote: Thierry Carrez wrote: Historically blog.o.o used to be our only blog outlet, so almost anything would go in: "OpenStack Events Sponsorship Webinar" "New Foundation Gold Members& Corporate Sponsors" "HP Announces Private Beta Program for OpenStack

Re: [openstack-dev] [oaktree] Follow up to Multi-cloud Management in OpenStack Summit session

2017-11-28 Thread Joshua Harlow
Small side-question, Why would this just be limited to openstack clouds? Would it be? Monty Taylor wrote: Hey everybody! https://etherpad.openstack.org/p/sydney-forum-multi-cloud-management I've CC'd everyone who listed interest directly, just in case you're not already on the openstack-dev

Re: [openstack-dev] [oaktree] Follow up to Multi-cloud Management in OpenStack Summit session

2017-11-28 Thread Joshua Harlow
Monty Taylor wrote: On 11/28/2017 06:05 PM, Joshua Harlow wrote: > So just curious. > > I didn't think shade had any federation logic in it; so I assume it will > start getting some? It's possible that we're missing each other on the definition of the word 'federation' ...

Re: [openstack-dev] [oaktree] Follow up to Multi-cloud Management in OpenStack Summit session

2017-11-28 Thread Joshua Harlow
So just curious. I didn't think shade had any federation logic in it; so I assume it will start getting some? Has there been any prelim. design around what the APIs of this would be and how they would work and how they would return data from X other clouds in a uniform manner? (I'd really

Re: [openstack-dev] [all] Community managed tech/dev blog: Call for opinions and ideas

2017-11-27 Thread Joshua Harlow
ilto:alli...@openstack.org> On Nov 27, 2017, at 1:44 PM, Joshua Harlow <harlo...@fastmail.com <mailto:harlo...@fastmail.com>> wrote: Doug Hellmann wrote: Excerpts from Joshua Harlow's message of 2017-11-27 10:54:02 -0800: Flavio Percoco wrote: Greetings, Last Thursday[0], at the TC offic

Re: [openstack-dev] [all] Community managed tech/dev blog: Call for opinions and ideas

2017-11-27 Thread Joshua Harlow
Jay Pipes wrote: On 11/27/2017 01:54 PM, Joshua Harlow wrote: I want a place that is like http://blog.kubernetes.io/ You know that's not for developers (only) of k8s, right? That's for users, marketers, product managers, etc. We don't have to exactly copy it (that was not the intention

Re: [openstack-dev] [all] Community managed tech/dev blog: Call for opinions and ideas

2017-11-27 Thread Joshua Harlow
Doug Hellmann wrote: Excerpts from Joshua Harlow's message of 2017-11-27 10:54:02 -0800: Flavio Percoco wrote: Greetings, Last Thursday[0], at the TC office hours, we brainstormed a bit around the idea of having a tech blog. This idea came first from Joshua Harlow and it was then briefly

Re: [openstack-dev] [all] Community managed tech/dev blog: Call for opinions and ideas

2017-11-27 Thread Joshua Harlow
Flavio Percoco wrote: Greetings, Last Thursday[0], at the TC office hours, we brainstormed a bit around the idea of having a tech blog. This idea came first from Joshua Harlow and it was then briefly discussed at the summit too. The idea, we have gathered, is to have a space where

Re: [openstack-dev] [tc] Keynote: Governance and Trust -- from Company Led to Community Led - Sarah Novotny - YouTube

2017-11-15 Thread Joshua Harlow
Doug Hellmann wrote: This keynote talk about the evolution of governance in the kubernetes community and the CNCF more broadly discusses some interesting parallels with our own history. https://m.youtube.com/watch?feature=youtu.be=Apw_fuTEhyA

Re: [openstack-dev] Upstream LTS Releases

2017-11-15 Thread Joshua Harlow
Just a thought, cause I have known/do know what Mathieu is talking about and find the disconnect still oddly weird. Why aren't developer people from other companies coming into to where Mathieu works (or where I work) and seeing how it really works down on the ground here. I mean if we still

Re: [openstack-dev] [nova][neutron] How do you use the instance IP filter?

2017-10-28 Thread Joshua Harlow
Matt Riedemann wrote: On 10/26/2017 10:56 PM, Joshua Harlow wrote: Just the paranoid person in me, but is it safe to say that the filter that you are showing here does not come from user text? Ie these two lines don't come from a user input directly (without going through some filter) do

Re: [openstack-dev] [Openstack-operators] [nova][neutron] How do you use the instance IP filter?

2017-10-26 Thread Joshua Harlow
Further things that someone may want to read/try (if the below is true), https://en.wikipedia.org/wiki/ReDoS Joshua Harlow wrote: Just the paranoid person in me, but is it safe to say that the filter that you are showing here does not come from user text? Ie these two lines don't come from

Re: [openstack-dev] [nova][neutron] How do you use the instance IP filter?

2017-10-26 Thread Joshua Harlow
Just the paranoid person in me, but is it safe to say that the filter that you are showing here does not come from user text? Ie these two lines don't come from a user input directly (without going through some filter) do they?

Re: [openstack-dev] [TripleO][Kolla] Concerns about containers images in DockerHub

2017-10-19 Thread Joshua Harlow
2017 at 13:32, Joshua Harlow<harlo...@fastmail.com> wrote: This reminded me of something I wanted to ask. Is it true to state that only way to get 'fully' shared-base layers is to have `kolla-build` build all the projects (that a person/company/other may use) in one invocation? (in part b

Re: [openstack-dev] [TripleO][Kolla] Concerns about containers images in DockerHub

2017-10-19 Thread Joshua Harlow
This reminded me of something I wanted to ask. Is it true to state that only way to get 'fully' shared-base layers is to have `kolla-build` build all the projects (that a person/company/other may use) in one invocation? (in part because of the jinja2 template generation which would cause

Re: [openstack-dev] Security of Meta-Data

2017-10-03 Thread Joshua Harlow
I would treat the metadata service as not secure. From amazon docs (equivalent can be said about openstack): ''' Important Although you can only access instance metadata and user data from within the instance itself, the data is not protected by cryptographic methods. Anyone who can access

Re: [openstack-dev] [all][oslo] Retiring openstack/pylockfile

2017-10-02 Thread Joshua Harlow
Impossible to list it all, lol Doug Hellmann wrote: Or https://github.com/jazzband Now we need a project to list all of the organizations full of unmaintained software... On Oct 2, 2017, at 12:12 PM, Joshua Harlow <harlo...@fastmail.com <mailto:harlo...@fastmail.com>> wrote: Yup

Re: [openstack-dev] [all][oslo] Retiring openstack/pylockfile

2017-10-02 Thread Joshua Harlow
Yup, +1 from me also, Honestly might just be better to put pylockfile under ownership of: https://github.com/pycontribs I think the above is made for these kinds of things (vs oslo), Thoughts? -Josh Ben Nemec wrote: +1. I believe the work we had originally intended to put into pylockfile

Re: [openstack-dev] patches for simple typo fixes

2017-09-26 Thread Joshua Harlow
Sean Dague wrote: I think the concern is the ascribed motive for why people are putting these up. That's fine to feel that people are stat padding (and that too many things are driven off metrics). But, honestly, that's only important if we make it important. Contributor stats are always going

Re: [openstack-dev] [oslo][oslo.service] looping.RetryDecorator behavior

2017-09-22 Thread Joshua Harlow
42 +0700, Joshua Harlow <harlo...@fastmail.com>, wrote: It does look like is sort of a bug, Though in all honesty I wouldn't be using oslo.service or that looping code in the future for doing retrying... https://pypi.python.org/pypi/tenacity is a much better library with more `natural` sy

Re: [openstack-dev] [oslo][oslo.service] looping.RetryDecorator behavior

2017-09-21 Thread Joshua Harlow
It does look like is sort of a bug, Though in all honesty I wouldn't be using oslo.service or that looping code in the future for doing retrying... https://pypi.python.org/pypi/tenacity is a much better library with more `natural` syntax and works more as one would expect (even under

Re: [openstack-dev] [TripleO] TripleO/Ansible PTG session

2017-09-18 Thread Joshua Harlow
Was there any discussion at the PTG on how the newly released AWX[1] will affect tripleo/ansible (will it?) or ara or such? Thoughts there? [1] https://github.com/ansible/awx James Slagle wrote: On Wednesday at the PTG, TripleO held a session around our current use of Ansible and how to move

[openstack-dev] Anyone know CNCF and how to get their landscape 'tweaked'

2017-09-15 Thread Joshua Harlow
Hi folks, Something that has been bugging me (a tiny bit, not a lot) is the following CNCF landscape picture. https://raw.githubusercontent.com/cncf/landscape/master/landscape/CloudNativeLandscape_v0.9.7.jpg If you look for openstack (for some reason it's under bare metal) in that you may

[openstack-dev] Should we be using subprocess32?

2017-09-12 Thread Joshua Harlow
Hi folks, I know there is a bunch of usage of subprocess in openstack and especially since there is heavy usage of python 2.7 it made me wonder if we should try to move to subprocess32 to avoid some of the bugs that seem to exist (maybe distributors backported them?): For example a major

[openstack-dev] Should we be using subprocess32?

2017-09-12 Thread Joshua Harlow
Hi folks, I know there is a bunch of usage of subprocess in openstack and especially since there is heavy usage of python 2.7 it made me wonder if we should try to move to subprocess32 to avoid some of the bugs that seem to exist (maybe distributors backported them?): For example a major

[openstack-dev] Is shade (and os_client_config) thread safe?

2017-08-07 Thread Joshua Harlow
Hi there folks, I'm doing various scans of our clouds here at godaddy and using shade to do some of the calls. Though when I do stuff like the following sometimes it has issues... http://paste.openstack.org/show/617712/ Typically this causes the following error: Traceback (most recent call

Re: [openstack-dev] [keystone][api] Backwards incompatible changes based on config

2017-08-04 Thread Joshua Harlow
Morgan Fainberg wrote: On Fri, Aug 4, 2017 at 3:09 PM, Kevin L. Mitchell wrote: On Fri, 2017-08-04 at 14:52 -0700, Morgan Fainberg wrote: Maybe not, but please do recall that there are many deployers out there that track master, not fixed releases, so we need to take that

Re: [openstack-dev] [python-openstacksdk] Status of python-openstacksdk project

2017-08-04 Thread Joshua Harlow
Also note that this appears to exist: https://github.com/openstack/python-openstackclient/blob/master/requirements.txt#L10 So even if python-openstacksdk is not a top level project, I would assume that it being a requirement would imply that it is? Or perhaps neither the

Re: [openstack-dev] Tracing (all the places)

2017-08-03 Thread Joshua Harlow
vin...@vn.fujitsu.com wrote: Hello harlowja, I'm really happy to see that you are back in this `tracing` topic [and @boris-42 (too)]. We never left, haha, but ya, I can say (and probably boris would agree) that trying to get OSprofiler started and integrated somewhat 'burned' both of us

[openstack-dev] Tracing (all the places)

2017-08-03 Thread Joshua Harlow
Since I think there was another thread out there around tracing I'd thought I'd send out a few others for folks that show tracing being added to multiple other popular project (interesting to read over the proposals and such). -

Re: [openstack-dev] [oslo][oslo.db] nominating Jay Pipes for oslo-db-core

2017-07-27 Thread Joshua Harlow
+1 from me. -Josh ChangBo Guo wrote: +1000 2017-07-27 22:04 GMT+08:00 Doug Hellmann >: I have noticed that Jay has been very deeply involved in several recent design discussions about oslo.db, and he obviously has a great deal

Re: [openstack-dev] [oslo] PTL nominations

2017-07-18 Thread Joshua Harlow
Thanks much for the service (and time and effort and more) gcb!!! :) ChangBo Guo wrote: Hi oslo folks, The PTL nomination week is fast approaching [0], and as you might have guessed by the subject of this email, I am not planning to run for Queens, I'm still in the team and give some guidance

Re: [openstack-dev] [TripleO] Let's use Ansible to deploy OpenStack services on Kubernetes

2017-07-14 Thread Joshua Harlow
Out of curiosity, since I keep on hearing/reading all the tripleo discussions on how tripleo folks are apparently thinking/doing? redesigning the whole thing to use ansible + mistral + heat, or ansible + kubernetes or ansible + mistral + heat + ansible (a second time!) or ... Seeing all those

Re: [openstack-dev] [Glare][TC] Application for inclusion of Glare in the list of official projects

2017-07-10 Thread Joshua Harlow
Ed Leafe wrote: On Jul 10, 2017, at 5:06 AM, Mikhail Fedosin > wrote: Given all the advantages and features of Glare, I believe that it can become the successful drop-in replacement. Can you clarify this? Let’s assume I have a decent-sized

Re: [openstack-dev] [docs][all][ptl] Contributor Portal and Better New Contributor On-boarding

2017-06-27 Thread Joshua Harlow
Boris Pavlovic wrote: Overall it would take 1-2 days for people not familiar with OpenStack. What about if one make "Sing-Up" page: 1) Few steps: provide Username, Contact info, Agreement, SSH key (and it will do all work for you set Gerrit, OpenStack,...) 2) After one finished form it gets

Re: [openstack-dev] [all] etcd3 as base service - update

2017-06-08 Thread Joshua Harlow
Julien Danjou wrote: On Thu, Jun 08 2017, Mike Bayer wrote: So far I've seen a proposal of etcd3 as a replacement for memcached in keystone, and a new dogpile connector was added to oslo.cache to handle referring to etcd3 as a cache backend. This is a really simplistic / minimal kind of use

Re: [openstack-dev] [all] etcd3 as base service - update

2017-06-07 Thread Joshua Harlow
So just out of curiosity, but do people really even know what etcd is good for? I am thinking that there should be some guidance from folks in the community as to where etcd should be used and where it shouldn't (otherwise we just all end up in a mess). Perhaps a good idea to actually give

[openstack-dev] [mogan] Architecture diagrams

2017-05-31 Thread Joshua Harlow
Hi mogan folks, I was doing some source code examination of mogan and it peaked my interest in how it all is connected together. In part I see there is a state machine, some taskflow usage, some wsgi usage that looks like parts of it are inspired(?) by various other projects. That got me

Re: [openstack-dev] Documenting config drive - what do you want to see?

2017-05-24 Thread Joshua Harlow
Matt Riedemann wrote: Rocky tipped me off to a request to document config drive which came up at the Boston Forum, and I tracked that down to Clark's wishlist etherpad [1] (L195) which states: "Document the config drive. The only way I have been able to figure out how to make a config drive is

Re: [openstack-dev] [oslo] Can we stop global requirements update?

2017-05-19 Thread Joshua Harlow
Mehdi Abaakouk wrote: Not really, I just put some comments on reviews and discus this on IRC. Since nobody except Telemetry have expressed/try to get rid of eventlet. Octavia is using cotyledon and they have gotten rid of eventlet. Didn't seem like it was that hard either to do it (of course

Re: [openstack-dev] [oslo][concurrency] lockutils lock fairness / starvation

2017-05-18 Thread Joshua Harlow
Chris Friesen wrote: On 05/16/2017 10:45 AM, Joshua Harlow wrote: So fyi, If you really want something like this: Just use: http://fasteners.readthedocs.io/en/latest/api/lock.html#fasteners.lock.ReaderWriterLock And always get a write lock. It is a slightly different way of getting those

Re: [openstack-dev] [oslo][concurrency] lockutils lock fairness / starvation

2017-05-16 Thread Joshua Harlow
Chris Friesen wrote: On 05/16/2017 10:45 AM, Joshua Harlow wrote: So fyi, If you really want something like this: Just use: http://fasteners.readthedocs.io/en/latest/api/lock.html#fasteners.lock.ReaderWriterLock And always get a write lock. It is a slightly different way of getting those

Re: [openstack-dev] [tc][infra][release][security][stable][kolla][loci][tripleo][docker][kubernetes] do we want to be publishing binary container images?

2017-05-16 Thread Joshua Harlow
My guess is same with octavia. https://github.com/openstack/octavia/tree/master/diskimage-create#diskimage-builder-script-for-creating-octavia-amphora-images -Josh Fox, Kevin M wrote: +1. ironic and trove have the same issues as well. lowering the bar in order to kick the tires will help

Re: [openstack-dev] [oslo][oslo.messaging] Call to deprecate the 'pika' driver in the oslo.messaging project

2017-05-16 Thread Joshua Harlow
Fine with me, I'd personally rather get down to say 2 'great' drivers for RPC, And say 1 (or 2?) for notifications. So ya, wfm. -Josh Mehdi Abaakouk wrote: +1 too, I haven't seen its contributors since a while. On Mon, May 15, 2017 at 09:42:00PM -0400, Flavio Percoco wrote: On 15/05/17

Re: [openstack-dev] [oslo][concurrency] lockutils lock fairness / starvation

2017-05-16 Thread Joshua Harlow
So fyi, If you really want something like this: Just use: http://fasteners.readthedocs.io/en/latest/api/lock.html#fasteners.lock.ReaderWriterLock And always get a write lock. It is a slightly different way of getting those locks (via a context manager) but the implementation underneath is a

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-10 Thread Joshua Harlow
Dmitry Tantsur wrote: On 05/09/2017 07:59 PM, Joshua Harlow wrote: Matt Riedemann wrote: On 5/8/2017 1:10 PM, Octave J. Orgeron wrote: I do agree that scalability and high-availability are definitely issues for OpenStack when you dig deeper into the sub-components. There is a lot of re

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-09 Thread Joshua Harlow
Matt Riedemann wrote: On 5/8/2017 1:10 PM, Octave J. Orgeron wrote: I do agree that scalability and high-availability are definitely issues for OpenStack when you dig deeper into the sub-components. There is a lot of re-inventing of the wheel when you look at how distributed services are

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-05 Thread Joshua Harlow
Fox, Kevin M wrote: Note, when I say OpenStack below, I'm talking about nova/glance/cinder/neutron/horizon/heat/octavia/designate. No offence to the other projects intended. just trying to constrain the conversation a bit... Those parts are fairly comparable to what k8s provides. I think

Re: [openstack-dev] [kolla] Tags, revisions, dockerhub

2017-04-24 Thread Joshua Harlow
Just for some insight, This is the stuff we are putting into our kolla image(s): {% block openstack_base_header %} ADD additions-archive / # Because we have a internal pip with internal packages. RUN cp /additions/pip/pip.conf /etc/pip.conf ENV PIP_CONFIG_FILE /etc/pip.conf LABEL

Re: [openstack-dev] [oslo] Can we stop global requirements update?

2017-04-20 Thread Joshua Harlow
Doug Hellmann wrote: Excerpts from gordon chung's message of 2017-04-20 17:12:26 +: On 20/04/17 01:32 AM, Joshua Harlow wrote: Wasn't there also some decision made in austin (?) about how we as a group stated something along the line of co-installability isn't as important as it once

Re: [openstack-dev] [oslo] Can we stop global requirements update?

2017-04-19 Thread Joshua Harlow
Doug Hellmann wrote: Excerpts from Clark Boylan's message of 2017-04-19 08:10:43 -0700: On Wed, Apr 19, 2017, at 05:54 AM, Julien Danjou wrote: Hoy, So Gnocchi gate is all broken (agan) because it depends on "pbr" and some new release of oslo.* depends on pbr!=2.1.0. Neither Gnocchi nor

Re: [openstack-dev] [Taskflow] Current state or the project ?

2017-04-19 Thread Joshua Harlow
Robin De-Lillo wrote: Hello Guys, I'm Robin a Software developer for a VFX company based in Canada. As the company grow up, we are currently looking into redesigning our internal processes and workflows in a more nodal/graph based approach. Ideally we would like to start from an existing

Re: [openstack-dev] [shade] help wanted - tons to do, not enough people

2017-04-12 Thread Joshua Harlow
Just a question, not meant as anything bad against shade, But would effort be better spent on openstacksdk? Take the good parts of shade and just move it to openstacksdk, perhaps as a 'higher level api' available in openstacksdk? Then ansible openstack components (which I believe use shade)

Re: [openstack-dev] [architecture] Arch-WG, we hardly knew ye..

2017-04-07 Thread Joshua Harlow
Sad to see it go, but I understand the reasoning about why. Back to the coal mines :-P -Josh Clint Byrum wrote: I'm going to be blunt. I'm folding the Architecture Working Group immediately following our meeting today at 2000 UTC. We'll be using the time to discuss continuity of the

Re: [openstack-dev] ARA - Ansible Run Analysis: Would you like to help ?

2017-03-22 Thread Joshua Harlow
Sounds neat, So this would be similar to what tower or semaphore also have (I would assume they have something very like ARA internally) but instead of providing the whole start/stop/inventory workflow this just provides the viewing component? David Moreau Simard wrote: Hi openstack-dev,

Re: [openstack-dev] [oslo][barbican][castellan] Proposal to rename Castellan to oslo.keymanager

2017-03-16 Thread Joshua Harlow
I'd be fine with it also, not sure it will change much, but meh, worth a shot. We are all happy loving people after all, so might as well try to help others when we can :-P -Josh Davanum Srinivas wrote: +1 from me to bring castellan under Oslo governance with folks from both oslo and

Re: [openstack-dev] [oslo][kolla][openstack-helm][tripleo][all] Storing configuration options in etcd(?)

2017-03-14 Thread Joshua Harlow
Monty Taylor wrote: On 03/14/2017 06:04 PM, Davanum Srinivas wrote: Team, So one more thing popped up again on IRC: https://etherpad.openstack.org/p/oslo.config_etcd_backend What do you think? interested in this work? Thanks, Dims PS: Between this thread and the other one about Tooz/DLM and

Re: [openstack-dev] [oslo][kolla][openstack-helm][tripleo][all] Storing configuration options in etcd(?)

2017-03-14 Thread Joshua Harlow
So just fyi, this has been talked about before (but prob in context of zookeeper or various other pluggable config backends). Some links: - https://review.openstack.org/#/c/243114/ - https://review.openstack.org/#/c/243182/ - https://blueprints.launchpad.net/oslo.config/+spec/oslo-config-db -

Re: [openstack-dev] [oslo][devstack][all] ZooKeeper vs etcd for Tooz/DLM

2017-03-14 Thread Joshua Harlow
Jay Pipes wrote: On 03/14/2017 02:50 PM, Julien Danjou wrote: On Tue, Mar 14 2017, Jay Pipes wrote: Not tooz, because I'm not interested in a DLM nor leader election library (that's what the underlying etcd3 cluster handles for me), only a fast service liveness/healthcheck system, but it

Re: [openstack-dev] What do we want to be when we grow up?

2017-03-13 Thread Joshua Harlow
Thierry Carrez wrote: Joshua Harlow wrote: [...] * Be opinionated; let's actually pick *specific* technologies based on well thought out decisions about what we want out of those technologies and integrate them deeply (and if we make a bad decision, that's ok, we are all grown ups and we'll

Re: [openstack-dev] What do we want to be when we grow up?

2017-03-13 Thread Joshua Harlow
Monty Taylor wrote: On 03/10/2017 11:39 PM, Joshua Harlow wrote: * Interoperability - kept as is (though I can't really say how many public clouds there are anymore to interoperate with). There are plenty. As Dan Smith will tell you, I'm fond of telling people just how many OpenStack Public

Re: [openstack-dev] [oslo][devstack][all] ZooKeeper vs etcd for Tooz/DLM

2017-03-13 Thread Joshua Harlow
Clint Byrum wrote: Excerpts from Fox, Kevin M's message of 2017-03-14 00:09:55 +: With my operator hat on, I would like to use the etcd backend, as I'm already paying the cost of maintaining etcd clusters as part of Kubernetes. Adding Zookeeper is a lot more work. It would probably

[openstack-dev] What do we want to be when we grow up?

2017-03-10 Thread Joshua Harlow
This thread is an extraction of: http://lists.openstack.org/pipermail/openstack-dev/2017-March/thread.html#113362 And is a start of someideas for what we as a group want our vision to be. I'm going to start by taking what Zane put up (see above thread) already and mutate it. * Infinite

Re: [openstack-dev] [tc][appcat][murano][app-catalog] The future of the App Catalog

2017-03-10 Thread Joshua Harlow
Clint Byrum wrote: Excerpts from Thierry Carrez's message of 2017-03-10 16:48:02 +0100: Christopher Aedo wrote: On Thu, Mar 9, 2017 at 4:08 AM, Thierry Carrez wrote: Christopher Aedo wrote: On Mon, Mar 6, 2017 at 3:26 AM, Thierry Carrez wrote:

Re: [openstack-dev] [tc][appcat] The future of the App Catalog

2017-03-10 Thread Joshua Harlow
Clint Byrum wrote: Excerpts from Joshua Harlow's message of 2017-03-09 21:53:58 -0800: Renat Akhmerov wrote: On 10 Mar 2017, at 06:02, Zane Bitter> wrote: On 08/03/17 11:23, David Moreau Simard wrote: The App Catalog, to me, sounds sort of like

Re: [openstack-dev] [tc][appcat] The future of the App Catalog

2017-03-10 Thread Joshua Harlow
gordon chung wrote: On 10/03/17 12:53 AM, Joshua Harlow wrote: I can propose what I would like for a strategy (it's not more VMs and more neutron security groups...), though if it involves (more) design by committee, count me out. I honestly believe we have to do the equivalent

Re: [openstack-dev] [tc][appcat] The future of the App Catalog

2017-03-09 Thread Joshua Harlow
Renat Akhmerov wrote: On 10 Mar 2017, at 06:02, Zane Bitter > wrote: On 08/03/17 11:23, David Moreau Simard wrote: The App Catalog, to me, sounds sort of like a weird message that OpenStack somehow requires applications to be

Re: [openstack-dev] [all] Some information about the Forum at the Summit in Boston

2017-03-09 Thread Joshua Harlow
Ben Swartzlander wrote: I might be the only one who has negative feelings about the PTG/Forum split, but I suspect the foundation is suppressing negative feedback from myself and other developers so I'll express my feelings here. If there's anyone else who feels like me please reply, otherwise

Re: [openstack-dev] Saga of servicec discovery (is it needed?)

2017-03-02 Thread Joshua Harlow
Julien Danjou wrote: On Thu, Mar 02 2017, Joshua Harlow wrote: So before I start to go much farther on this (and start to dive into what people are doing and why the various implementations exist and proposing a cross-project solution, tooz, or etcd, or zookeeper or other...) I wanted to get

Re: [openstack-dev] [kolla][infra] does someone cares about Jenkins? I stopped.

2017-03-02 Thread Joshua Harlow
Marcin Juszkiewicz wrote: I am working on some improvements for Kolla. Part of that work is sending patches for review. Once patch is set for review.openstack.org there is a set of Jenkins jobs started to make sure that patch does not break already working code. And this is good thing. How it

[openstack-dev] Saga of servicec discovery (is it needed?)

2017-03-02 Thread Joshua Harlow
So this is a general start of a large discussion that is similar to the other one I started[1], and this time around I wanted to start this on the mailing instead of a spec first approach. The general question is around something I keep on noticing popping up in various projects and worry

Re: [openstack-dev] [nova] Device tagging: rebuild config drive upon instance reboot to refresh metadata on it

2017-02-27 Thread Joshua Harlow
Not afaik, first time I've heard about this type of device/data. Tim Bell wrote: Is there cloud-init support for this mode or do we still need to mount as a config drive? Tim On 20.02.17, 17:50, "Jeremy Stanley" wrote: On 2017-02-20 15:46:43 + (+), Daniel P.

Re: [openstack-dev] [chef] Making the Kitchen Great Again: A Retrospective on OpenStack & Chef

2017-02-16 Thread Joshua Harlow
Alex Schultz wrote: On Thu, Feb 16, 2017 at 9:12 AM, Ed Leafe wrote: On Feb 16, 2017, at 10:07 AM, Doug Hellmann wrote: When we signed off on the Big Tent changes we said competition between projects was desirable, and that deployers and contributors

Re: [openstack-dev] [chef] Making the Kitchen Great Again: A Retrospective on OpenStack & Chef

2017-02-15 Thread Joshua Harlow
For the cookbooks, every core and non-core project that is supported has to be tracked. In addition to that, each platform that is supported must be tracked, for quirks and idiosyncrasies, because they always have them. Then, there are the cross-project teams that do the packaging, as well as

Re: [openstack-dev] [designate] Status of the project

2017-02-10 Thread Joshua Harlow
so then that's IMHO good. Thanks, Kevin From: Jay Pipes [jaypi...@gmail.com] Sent: Friday, February 10, 2017 9:50 AM To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [designate] Status of the project On 02/10/2017 12:21 PM, Joshua Harlow

Re: [openstack-dev] [designate] Status of the project

2017-02-10 Thread Joshua Harlow
Jay Pipes wrote: On 02/10/2017 12:21 PM, Joshua Harlow wrote: Hayes, Graham wrote: The HTML version of this is here: http://graham.hayes.ie/posts/openstack-designate-where-we-are/ I have been asked a few times recently "What is the state of the Designate project?", "How is De

Re: [openstack-dev] [designate] Status of the project

2017-02-10 Thread Joshua Harlow
Hayes, Graham wrote: The HTML version of this is here: http://graham.hayes.ie/posts/openstack-designate-where-we-are/ I have been asked a few times recently "What is the state of the Designate project?", "How is Designate getting on?", and by people who know what is happening "What are you

  1   2   3   4   5   6   7   8   9   10   >