Re: [openstack-dev] [requirements][neutron] bot bumping patches off gate queue

2017-02-01 Thread Armando M.
On 1 February 2017 at 07:29, Ihar Hrachyshka  wrote:

> Hi all,
>
> lately I see the requirements bot proposing new rebases for its
> patches (and bumping existing patch sets from the gate queue) every
> second hour, at least for Neutron [1], which makes it impossible to
> land the patches, and which only makes gate pre-release situation
> worse. On top of that, the proposed rebases don't really add anything
> material to the sync patch, no new version changes and such.
>
> I think we had some guards against such behavior before, so I wonder
> if they were broken or removed lately? Any plans to fix that?
>
> It would be nice to be able to land the update before RC1 is cut off,
> but at this point, it does not seem realistic.
>
> [1] https://review.openstack.org/#/c/423645/
>
>
Let's stop merging until the bot proposal change lands. That ought to stop
the spurious rebase!

Hard times require hard measures!!


> Thanks for help,
> Ihar
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Neutron CI team meeting

2017-01-31 Thread Armando M.
On 31 January 2017 at 14:47, Morales, Victor <victor.mora...@intel.com>
wrote:

> Howdy,
>
> First of all, thanks for the creation of this space to discuss about
> shouldn’t be something common(in an utopia) but it’s part of our daily
> duties.  I’m not sure if this is the right venue but I discovered today
> that the current implementation of the job for coverage[1] only valides the
> creation of the report and it doesn’t guarantee that the code coverage
> percentage drops (we’re relying on code reviewers to avoid that).  I’m
> wondering if we could propose something to openstack-infra for enabling a
> threshold on the gates.
>

Excellent point. I'll add an open agenda on the meeting page so that people
can bring this type of feedback.


>
> Regards,
> Victor Morales
> irc: electrocucaracha
>
> [1] https://github.com/openstack-infra/project-config/blob/
> master/jenkins/jobs/python-jobs.yaml#L17
>
>
> PS: Congrats Ihar for your new role
>
>
>
> From:  "Armando M." <arma...@gmail.com>
> Reply-To:  "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> Date:  Tuesday, January 31, 2017 at 1:47 PM
> To:  "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> Subject:  [openstack-dev] [neutron] Neutron CI team meeting
>
>
> Hi folks,
>
> Recently [1], a new meeting has been setup to give the neutron team a
> dedicated time to discuss any upstream CI matter (gate issues, testing
> strategies, etc), as well as an overflow space to be used after the main
> team meeting section [3]. Kudos to Ihar
>  for being our first chair.
>
> Needless to say, attendance is welcome.
>
> Cheers,
> Armando
>
> [1] https://review.openstack.org/#/c/426311/
> [2] https://wiki.openstack.org/wiki/Meetings/NeutronCI
> [3] https://wiki.openstack.org/wiki/Network/Meetings#Bugs_and_Gate_issues
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [infra] [gate] [all] openstack services footprint lead to oom-kill in the gate

2017-02-02 Thread Armando M.
On 2 February 2017 at 08:40, Sean Dague  wrote:

> On 02/02/2017 11:16 AM, Matthew Treinish wrote:
> 
> > 
> >
> > We definitely aren't saying running a single worker is how we recommend
> people
> > run OpenStack by doing this. But it just adds on to the differences
> between the
> > gate and what we expect things actually look like.
>
> I'm all for actually getting to the bottom of this, but honestly real
> memory profiling is needed here. The growth across projects probably
> means that some common libraries are some part of this. The ever growing
> requirements list is demonstrative of that. Code reuse is good, but if
> we are importing much of a library to get access to a couple of
> functions, we're going to take a bunch of memory weight on that
> (especially if that library has friendly auto imports in top level
> __init__.py so we can't get only the parts we want).
>
> Changing the worker count is just shuffling around deck chairs.
>
> I'm not familiar enough with memory profiling tools in python to know
> the right approach we should take there to get this down to individual
> libraries / objects that are containing all our memory. Anyone more
> skilled here able to help lead the way?
>

>From what I hear, the overall consensus on this matter is to determine what
actually caused the memory consumption bump and how to address it, but
that's more of a medium to long term action. In fact, to me this is one of
the top priority matters we should talk about at the imminent PTG.

For the time being, and to provide relief to the gate, should we want to
lock the API_WORKERS to 1? I'll post something for review and see how many
people shoot it down :)

Thanks for your feedback!
Cheers,
Armando


>
> -Sean
>
> --
> Sean Dague
> http://dague.net
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] grenade failures in the gate

2017-01-23 Thread Armando M.
Hi neutrinos,

We spotted [1] in the gate. Please wait for its resolution until pushing
patches into the merge queue.

Thanks,
Armando

[1] https://bugs.launchpad.net/neutron/+bug/1658806
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] grenade failures in the gate

2017-01-23 Thread Armando M.
On 23 January 2017 at 13:50, Jeremy Stanley <fu...@yuggoth.org> wrote:

> On 2017-01-23 13:38:58 -0800 (-0800), Armando M. wrote:
> > We spotted [1] in the gate. Please wait for its resolution until pushing
> > patches into the merge queue.
>
> https://review.openstack.org/424323 seems to be the fix, and will
> hopefully merge shortly along with its dependency (they're at the
> top of the gate pipeline now as I write this).
>

Yes, that's the one. It looks like we're out of the woods...for now!

Cheers,
Armando


> --
> Jeremy Stanley
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] PTL Candidacy

2017-01-24 Thread Armando M.
On 24 January 2017 at 12:46, Jeremy Stanley  wrote:

> On 2017-01-24 10:51:39 -0800 (-0800), Ihar Hrachyshka wrote:
> > On Tue, Jan 24, 2017 at 12:50 AM, Kevin Benton  wrote:
> > > I'm on board with getting visibility into the drivers with
> improvements to
> > > driverlog, etc. What I'm uncertain of is providing much in the lines of
> > > 'validation'. Core reviewers don't frequently have access to the
> hardware or
> > > software required to validate these drivers so we can't be sure if the
> > > features really are working as expected.
> > >
> > > If validation is as flexible as you highlighted in the email, we can at
> > > least get it to a point where all recent CI runs are linkable from
> driverlog
> > > and people can see recent tempest runs. I don't foresee the Neutron
> team
> > > getting to a point soon where we vouch for certain drivers though just
> > > because it is so hard to keep up with their changes (even ignoring
> changes
> > > in the vendor hardware itself).
> >
> > Good point. We may guide plugins and drivers on how to set up CI; we
> > may help Foundation to set up Marketplace in such a way that would
> > allow to automatically consume test artifacts from driver owners; we
> > may provide guidance to Foundation about which features are more
> > important to reflect that in Marketplace; but I would hope we don't
> > put the Neutron team on the hook to validate each driver, or even
> > police CI owners to produce consumable results. (The stick in the
> > latter case would be driver not showing up in Marketplace, or showing
> > up with no feature support information.)
>
> I guess the question I have is who, then, can tell our
> operators/users what Neutron drivers are reasonably supported? It
> sounds like you're saying Neutron developers are not well-placed to
> determine that, which leaves us with these other options:
>
> A. Have the OpenStack Foundation as maintainers of the Marketplace
>decide which Neutron drivers are usable (they don't really staff
>for this purpose so would be throwing darts I think)
>
> B. Trust the driver authors to declare whether they're supported and
>what features they provide (maybe that works better than I
>expect?)
>
> C. Identify another party with a vested interest in validating
>driver support (a board of operators from different organizations
>maybe?)
>
> D. Provide links/aggregation of QA/CI and let the consumers attempt
>to divine supportability for themselves (seems a bit downstream
>hostile)
>
> Are any of those options preferable?
>

Even though I am not the one running, I am replying here because I feel
compelled as outgoing PTL and member of the core team to help the soon PTL
elect through this process.

In my opinion, the first thing to address is to lay down the foundations
for an objective comparison across drivers. The neutron team is obviously
best position in doing that. This was started with how we chose to organize
the neutron project, what quality criteria mattered for the team, and how
qualifying neutron features can be tracked across releases (e.g. still work
in progress in [1]).

Only after we have these solid foundations in place, we can go about the
effort of tracking the wider ecosystem of neutron plugins, and identify who
is best positioned to keep that snapshot accurate over time.

My 2c
Armando

[1] https://review.openstack.org/#/c/318192/


> --
> Jeremy Stanley
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Ocata Feature Freeze

2017-01-26 Thread Armando M.
On 26 January 2017 at 12:53, Dariusz Śmigiel 
wrote:

> Dear Neutrinos,
> Feature Freeze day arrived! Ocata-3 has been released, so it means
> that no new features will be allowed to current release... The only
> patches approved to be merged should be: release critical or gate
> blocker.
> All outstanding features, that would need to be landed into Ocata,
> will need to receive "Feature Freeze Exception" status.
>
> From now on, we have one week till RC1.
> Please double check release notes and make sure everything is in order.
>
> Thanks,
> Dariusz
> your Release Liaison
>

Dasm, thanks for the details provided. Let me also add that:

You can find milestone deliverables at [1].

Between now and the official release date (week of Feb 20th, calendar [2]
for more details), we will be busy with the following:

   - cleaning up release notes [3]
   - handling release tasks [4]
   - squashing doc bugs [5]
   - dealing with gate failures [6]
   - apply for FFE on the ocata postmortem [7]
   - for pending efforts that get a FFE granted, there's time until we cut
   an RC1 [8]
   - Pike-1 opens up as soon as RC1 is cut [9] (which I took the liberty to
   seed based on reasonable expectations of the progress we can make on
   outstanding efforts)
   - if you find a RC critical bug, please file it and add bug tag
   'ocata-rc-potential' [10]
   - If you are a subproject maintainer, please check [11], switch to
   release mindset and get ready to prepare an Ocata release.

Be mindful of what you approve for merge (e.g. patches containing DB
migration need special attention), and double check whether it's aimed at
making RC1 solid/complete. If not, please refrain from putting it in the
gate queue, and most of all, *recheck* mindfully.

Many thanks for your help, and when in doubt, reach out!

Cheers,
Armando

[1] https://releases.openstack.org/ocata/index.html
[2] https://releases.openstack.org/ocata/schedule.html
[3] http://docs.openstack.org/releasenotes/neutron/unreleased.html
[4] http://docs.openstack.org/developer/neutron/policies/rel
ease-checklist.html
[5] https://bugs.launchpad.net/neutron/+bugs?field.tag=doc
[6] https://bugs.launchpad.net/neutron/+bugs?field.status%3A
list=NEW%3Alist=CONFIRMED=gate-failure
[7] https://review.openstack.org/#/c/425990
[8] https://launchpad.net/neutron/+milestone/ocata-rc1
[9] https://launchpad.net/neutron/+milestone/pike-1
[10] https://bugs.launchpad.net/neutron/+bugs/?field.tag=ocata-rc-potential
[11] https://review.openstack.org/#/c/389397/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] Ocata postmortem

2017-02-23 Thread Armando M.
Hi folks,

Now that Ocata is officially releases, I'd like to get a moment of your
time to double check our postmortem document [1], and provide as much
information as you can on the state of work assigned to you or work you
have been involved with during the Ocata timeframe.

Your old PTL and consumers/watchers of our project will be immensely
grateful.

Cheers,
Armando

[1] https://review.openstack.org/#/c/425990/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Alternative approaches for L3 HA

2017-02-22 Thread Armando M.
On 13 February 2017 at 23:23, Kosnik, Lubosz 
wrote:

> So from my perspective I can tell that problem is completely in
> architecture and even without something outside of Neutron we cannot solve
> that.
> Two releases ago I started to work on hardening that feature but all my
> ideas was killed by Armando and Assaf. The decided that adding outside
> dependency will open the doors for a new bugs from dependencies into
> Neutron [1].
>

I am pretty sure it wasn't our intentions to 'kill' your ideas, but
otherwise set you on the right path for fixing the bug. I still believe
that a complete and robust L3 HA solution cannot be built solely with
Neutron alone, and that's what I was trying to say with the comment
referenced below.


>
> You need to know that there are two outstanding bugs in this feature.
> There is a internal and outside connectivity split brain. [2] this patch
> made by me is “fixing” part of the problem. It allows you specify
> additional tests to verify connectivity from router to GW.
> Also there is a problem with connectivity between network nodes. It’s more
> problematic and like you said it’s unsolvable in my opinion without using
> external mechanism.
>
> If there will be any need to help with anything I would love to help with
> sharing my knowledge about this feature and what exactly is not working. If
> anyone needs any help with anything about this please ping me on email or
> IRC.
>
> [1] https://bugs.launchpad.net/neutron/+bug/1375625/comments/31
> [2] https://review.openstack.org/#/c/273546/
>
> Lubosz
>
> On Feb 13, 2017, at 4:10 AM, Anna Taraday 
> wrote:
>
> To avoid dependency of data plane on control plane it is possible to
> deploy a separate key-value storage cluster on data plane side, using the
> same network nodes.
> I'm proposing to make some changes to enable experimentation in this
> field, we are yet to come up with any other concrete solution.
>
> On Mon, Feb 13, 2017 at 2:01 PM  wrote:
>
>> Hi,
>>
>>
>>
>>
>>
>> We also operate using Juno with the VRRP HA implementation and at had to
>> patch through several bugs before getting to the Mitaka release.
>>
>> An pluggable, drop-in alternative would be highly appreciated. However
>> our experience has been that the decoupling of VRRP from the control plane
>> is actually a benefit as when the control plane is down the traffic is not
>> affected.
>>
>> In a solution where the L3 HA implementation becomes tied to the
>> availability of the control plane (etcd cluster or any other KV store) then
>> an operator would have to account for extra failure scenarios for the KV
>> store which would affect multiple routers than the outage of a single L3
>> node which is the case we usually have to account now.
>>
>>
>>
>>
>>
>> Just my $.02
>>
>>
>>
>> Cristian
>>
>>
>>
>> *From:* Anna Taraday [mailto:akamyshnik...@mirantis.com]
>> *Sent:* Monday, February 13, 2017 11:45 AM
>> *To:* OpenStack Development Mailing List (not for usage questions)
>> *Subject:* Re: [openstack-dev] [Neutron] Alternative approaches for L3 HA
>>
>>
>>
>> In etcd for each HA router we can store key which will identify which
>> agent is active. L3 agents will "watch" this key.
>> All these tools have leader election mechanism which can be used to get
>> agent which is active for current HA router.
>>
>>
>>
>> On Mon, Feb 13, 2017 at 7:02 AM zhi  wrote:
>>
>> Hi, we are using L3 HA in our production environment now. Router
>> instances communicate to each other by VRRP protocol. In my opinion,
>> although VRRP is a control plane thing, but the real VRRP traffic is using
>> data plane nic so that router namespaces can not talk to each other
>> sometimes when the  data plan is busy. If we were used etcd (or other),
>> does every router instance register one "id" in etcd ?
>>
>>
>>
>>
>>
>> Thanks
>>
>> Zhi Chang
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
>> unsubscribe
>> 
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>> --
>>
>> Regards,
>> Ann Taraday
>>
>> _
>>
>> Ce message et ses pieces jointes peuvent contenir des informations 
>> confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu 
>> ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
>> electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme ou 
>> falsifie. Merci.
>>
>> This message and its attachments 

Re: [openstack-dev] [All] IRC Mishaps

2017-02-09 Thread Armando M.
On 9 February 2017 at 07:43, Morales, Victor 
wrote:

> One  of my favorites is the usage of #undo command during the meetings for
> fixing a quick copy & paste link.  Should be necessary to include more
> information in this wiki entry[1]
>

Yes, I can't count the number of times during a meeting I typed:

#link v
#undo

...that reminds I should get a better keyboard.


>
> Victor Morales
> irc: electrocucaracha
>
> [1] https://wiki.openstack.org/wiki/UsingIRC
>
> From: Rob C 
> Reply-To: "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> Date: Thursday, February 9, 2017 at 6:57 AM
> To: "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> Subject: Re: [openstack-dev] [All] IRC Mishaps
>
> #startmeeting in the wrong channel
>
> #startmeeting in the right channel but at the wrong time
>
> #startmeeting in the right channel and at the right time but someone else
> already started it
>
> I'm basically a pro at meetings.
>
> On Thu, Feb 9, 2017 at 1:14 AM, Lana Brindley 
> wrote:
>
>> On 09/02/17 06:36, Kendall Nelson wrote:
>> > Hello All!
>> >
>> > So I am sure we've all seen it: people writing terminal commands into
>> our project channels, misusing '/' commands, etc. But have any of you
>> actually done it?
>> >
>> > If any of you cores, ptls or other upstanding members of our wonderful
>> community have had one of these embarrassing experiences please reply! I am
>> writing an article for the SuperUser trying to make us all seem a little
>> more human to people new to the community and new to using IRC. It can be
>> scary asking questions to such a large group of smart people and its even
>> more off putting when we make mistakes in front of them.
>> >
>> > So please share your stories!
>>
>> What about the one where you're conducting a private conversation in one
>> window, and watching a group chat in another one, and then drop some deeply
>> personal (or embarrassing!) content in the group chat instead the PM ;)
>>
>> L
>>
>> --
>> Lana Brindley
>> Technical Writer
>> Rackspace Cloud Builders Australia
>> http://lanabrindley.com
>>
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscrib
>> e
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [release][all] HELP NEEDED: test failures blocking requirements ocata branch and opening of pike

2017-02-09 Thread Armando M.
On 9 February 2017 at 05:16, Doug Hellmann  wrote:

> Excerpts from Doug Hellmann's message of 2017-02-08 23:54:06 -0500:
> > The patch to update the XStatic package versions [1] is blocked by a
> > patch to remove nova-docker from the requirements project sync list [2],
> > which is in turn running into issues in the
> > gate-grenade-dsvm-neutron-multinode-ubuntu-xenial job [3].
> >
> > We need some folks who understand these tests and the related
> > projects (nova, cinder, and neutron based on a cursory review of
> > the failed tests) to help with debugging and fixes.
> >
> > Doug
> >
> > [1] https://review.openstack.org/#/c/429753
> > [2] https://review.openstack.org/#/c/431221
> > [3] http://logs.openstack.org/21/431221/1/gate/gate-grenade-
> dsvm-neutron-multinode-ubuntu-xenial/67dd8a4/logs/grenade.sh.txt.gz
> >
>
> These patches landed overnight, so we are ready to proceed. It's not
> clear if there was a fix involved or just the magic of recheck, so if
> you had a hand in helping please post details.
>
>
I had a look at this one but I am baffled by some of the log outputs.
Requests for spawning faulty instances never make to nova-compute service,
but there's no clear smoking gun as to why this happens. I was looking for
oom-kills, but there was no sign of it either.


> Doug
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] PTL Candidacy

2017-01-24 Thread Armando M.
Hi neutrinos,

No, it's not what you might be thinking...I am just delighted to see two
excellent candidates willing to take the reins of the project going forward
[1,2].

I couldn't hope for more enthusiasm; best of luck to both candidates and
anyone else who is going to step up! This is exciting!

Cheers,
Armando

[1] https://review.openstack.org/#/c/423552/
[2] https://review.openstack.org/#/c/424500/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] (dis)Continuation of Neutron VPNaaS

2017-01-19 Thread Armando M.
On 19 January 2017 at 13:41, Bruno L  wrote:

> Hi,
>
> November last year the Neutron team has announced that VPN as a Service
> will be no longer part of Neutron[1].
>
> We run a public cloud based in New Zealand called Catalyst Cloud[2]. Our
> customers find the VPN service extremely useful to integrate their cloud
> tenant's with on-premise infrastructure or even other clouds. We have
> almost one hundred VPNs that were established by customers using it.
>
> While customers could run a compute instance with something like VyOS,
> they are used to the convenience of having a service managed by us that is
> easy to consume via the APIs or dashboard. It would be a step back for us
> to discontinue VPNaaS.
>
> As a result, we are interested in picking up the development of VPNaaS and
> keeping it alive. If like us, you are an organisation that sees value in
> VPNaaS, please get in touch with me to discuss how we can collaborate on it.
>
> As a first step, we would like to ensure that it continue to pass CI and
> it is free of major bugs. Then, we would like to address some of the points
> raised in the VPNaaS scorecard[3] to bring it up to standard with other
> Neutron services. We don't envisage introducing new features during this
> period, but rather focus on stability and maturity.
>
> Could someone from the Neutron team please help us with the questions
> below?
> 1) What would be the process to transfer ownership of the project?
>

Hi Bruno,

That's great to hear. If you have dev resources who are ready to jump in
Gerrit, please point me to their IRCs and Gerrit accounts and I am happy to
engage with them directly. Yamamoto and I have still core rights on the
repo and work on pushing fixes on an occasional basis. Once your devs feel
more confident, we can definitely talk about adding them to the
neutron-vpnaas core team.


> 2) Until we bring it up to standard, would we need to maintain it as a
> separate project, or as part of Neutron?
>

My suggestion is to focus on the technical aspect of things before worrying
about the governance change. Those typically can happen only in certain
time windows of the release and with the Ocata release approaching feature
freeze, we definitely need to postpone the governance discussion until Pike
opens up.

Thanks,
Armando (irc:armax)


> Cheers,
> Bruno
>
> [1] http://lists.openstack.org/pipermail/openstack-dev/2016-
> November/107384.html
> [2] http://catalyst.net.nz/catalyst-cloud
> [3] http://specs.openstack.org/openstack/neutron-specs/specs
> /stadium/ocata/neutron-vpnaas.html
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all] devstack changing to neutron by default RSN

2016-08-05 Thread Armando M.
On 5 August 2016 at 05:59, Sean Dague <s...@dague.net> wrote:

> On 08/04/2016 09:15 PM, Armando M. wrote:
> > So glad we are finally within the grasp of this!
> >
> > I posted [1], just to err on the side of caution and get the opportunity
> > to see how other gate jobs for Neutron might be affected by this change.
> >
> > Are there any devstack-gate changes lined up too that we should be aware
> of?
> >
> > Cheers,
> > Armando
> >
> > [1] https://review.openstack.org/#/c/351450/
>
> Nothing at this point. devstack-gate bypasses the service defaults in
> devstack, so it doesn't impact that at all. Over time we'll want to make
> neutron the default choice for all devstack-gate setups, and nova-net to
> be the exception. But that actually can all be fully orthoginal to this
> change.
>
>
Ack


> The experimental results don't quite look in yet, it looks like one test
> is failing on dvr (which is the one that tests for cross tenant
> connectivity) -
> http://logs.openstack.org/50/350750/5/experimental/gate-
> tempest-dsvm-neutron-dvr/4958140/
>
> That test has been pretty twitchy during this patch series, and it's
> quite complex, so figuring out exactly why it's impacted here is a bit
> beyond me atm. I think we need to decide if that is going to get deeper
> inspection, we live with the fails, or we disable the test for now so we
> can move forward and get this out to everyone.
>
>
Looking at the health trend for DVR [1], the test hasn't failed in a while,
so I wonder if this is induced by the proposed switch, even though I can't
correlate it just yet (still waiting for caffeine to kick in). Perhaps we
can give ourselves today to look into it and pull the trigger for 351450
<https://review.openstack.org/#/c/351450/> on Monday?

[1]
http://status.openstack.org/openstack-health/#/job/gate-tempest-dsvm-neutron-dvr


> -Sean
>
> --
> Sean Dague
> http://dague.net
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all] devstack changing to neutron by default RSN

2016-08-05 Thread Armando M.
On 5 August 2016 at 07:39, Brian Haley <brian.ha...@hpe.com> wrote:

> On 08/05/2016 08:59 AM, Sean Dague wrote:
>
>> On 08/04/2016 09:15 PM, Armando M. wrote:
>>
>>> So glad we are finally within the grasp of this!
>>>
>>> I posted [1], just to err on the side of caution and get the opportunity
>>> to see how other gate jobs for Neutron might be affected by this change.
>>>
>>> Are there any devstack-gate changes lined up too that we should be aware
>>> of?
>>>
>>> Cheers,
>>> Armando
>>>
>>> [1] https://review.openstack.org/#/c/351450/
>>>
>>
>> Nothing at this point. devstack-gate bypasses the service defaults in
>> devstack, so it doesn't impact that at all. Over time we'll want to make
>> neutron the default choice for all devstack-gate setups, and nova-net to
>> be the exception. But that actually can all be fully orthoginal to this
>> change.
>>
>> The experimental results don't quite look in yet, it looks like one test
>> is failing on dvr (which is the one that tests for cross tenant
>> connectivity) -
>> http://logs.openstack.org/50/350750/5/experimental/gate-temp
>> est-dsvm-neutron-dvr/4958140/
>>
>> That test has been pretty twitchy during this patch series, and it's
>> quite complex, so figuring out exactly why it's impacted here is a bit
>> beyond me atm. I think we need to decide if that is going to get deeper
>> inspection, we live with the fails, or we disable the test for now so we
>> can move forward and get this out to everyone.
>>
>
> I took a quick look at this and can't reproduce it yet, here's what the
> test seems to do:
>
> 1a. Create a network/subnet (10.100.0.0/28)
>  b. attach a router interface to the subnet
>  c. boot VM1 on the network
>
> 2a. Create a network/subnet (10.100.0.16/28)
>  b. do NOT attach a router interface to the subnet
>  c. boot VM2 on the network
>
> 3. Ssh to VM1 and ping VM2 - it should fail since there's no route to the
> network, but it succeeds
>
> The only place you should be able to ping that VM2 IP from is the dhcp
> namespace, which does work for me.
>
> So if you are seeing it be flaky it could the VM placement (same host vs
> different host) is impacting it?  In the logs it showed the same hostId,
> but so did my test, so I don't have a good answer.


Test *test_connectivity_between_vms_on_different_networks*  failed on
single node twice in a row. I think that VM placement may have nothing to
do with it.


>
>
> -Brian
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Intermittent gate failures

2016-08-24 Thread Armando M.
On 24 August 2016 at 10:30, Armando M. <arma...@gmail.com> wrote:

>
>
> On 22 August 2016 at 18:25, Armando M. <arma...@gmail.com> wrote:
>
>>
>>
>> On 22 August 2016 at 09:51, Armando M. <arma...@gmail.com> wrote:
>>
>>> Neutrinos,
>>>
>>> Since the merge of test [1], a race has surfaced, which leads to failure
>>> as reported in [2]. A number of Neutron's jobs are affected, and even
>>> though the failure is only intermittent, it is particularly bad for the
>>> linux bridge job.
>>>
>>> If I can ask you to hold your +2/+W until [3] puts the fire out, zuul
>>> will be grateful.
>>>
>>
>> An update:
>>
>> We have [1] in the gate queue, and Kevin is going full steam with [2],
>> which will mitigate the other intermittent issues we're facing in
>> functional and unit tests. Please bear with us.
>>
>> Cheers,
>> Armando
>>
>> [1] https://review.openstack.org/#/c/358753/
>> [2] https://review.openstack.org/#/c/356530/
>>
>>
>>>
>>> Thanks,
>>> Armando
>>>
>>> [1] https://review.openstack.org/#/c/327191/
>>> [2] https://bugs.launchpad.net/neutron/+bug/1615710
>>> [3] https://review.openstack.org/#/c/358753/
>>>
>>
>
> One more update:
>
> We're not quite out of the woods, yet so approve/recheck gently please.
>
> Things have become slightly better but we still have a pending fix for
> Neutron [1]. Recently we also observed zuul nodes dying unexpectedly on the
> OSIC cloud (that runs Neutron on IPv6) and that had an impact on the
> overall sluggishness of the gate [2]. Once all of the fixes are in, we
> should be back in business...until the next fire!
>

Another (final) update:

Changes [1] have merged. That should take care of the infra node resets.

At this point, there's [2] to wrap up, but things look largely recovered
[3,4] (though we need [5] to fully see a current picture). Please keep an
eye on [6], and help report/address critical fixes in the busy times ahead.

Cheers,
Armando

[1]
https://review.openstack.org/#/q/Ia044fff2a1731ab6c04f82aea47096b425e0c0a0,n,z
[2] https://review.openstack.org/#/c/356530/
[3]
http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=3
[4]
http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=5
[5] https://review.openstack.org/#/c/358462/
[6]
https://bugs.launchpad.net/neutron/+bugs?field.status%3Alist=NEW%3Alist=CONFIRMED=gate-failure


>
> Cheers,
> Armando
>
> [1] https://review.openstack.org/#/c/356530/
> [2] https://bugs.launchpad.net/neutron/+bug/1616282
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron][networking-sfc] need help on requesting release for networking-sfc

2016-08-31 Thread Armando M.
On 31 August 2016 at 17:31, Cathy Zhang  wrote:

> CC OpenStack alias.
>
>
>
> *From:* Cathy Zhang
> *Sent:* Wednesday, August 31, 2016 5:19 PM
> *To:* Armando Migliaccio; Ihar Hrachyshka; Cathy Zhang
> *Subject:* need help on requesting release for networking-sfc
>
>
>
> Hi Armando/Ihar,
>
>
>
> I would like to submit a request for a networking-sfc release. I did this for
> previous branch release by submitting a bug request in launchpad before.
> I see that other subproject, such as L2GW, did this in Launchpad for mitaka
> release too.
>
> But the Neutron stadium link http://docs.openstack.org/
> developer/neutron/stadium/sub_project_guidelines.html#sub-
> project-release-process states that “A sub-project owner proposes a patch
> to openstack/releases repository with the intended git hash. The Neutron
> release liaison should be added in Gerrit to the list of reviewers for the
> patch”.
>
>
>
> Could you advise which way I should go or should I do both?
>

Consider the developer documentation the most up to date process, so please
go ahead with a patch against the openstack/releases repo.


>
>
> Thanks,
>
> Cathy
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Team meeting cancelled

2016-09-02 Thread Armando M.
Neutrinos,

Because of holidays in US, it's probably safer to cancel the meeting for
the week starting Monday 5th.

Ask for your FFE, as needed on [1]

[1] https://review.openstack.org/#/c/360207/

Cheers,
Armando
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Cutting milestone 3 deliverables

2016-09-01 Thread Armando M.
Neutrinos,

We are in the process of releasing the deliverables for Newton 3. This
means we are in feature freeze and nothing should be approved for merging
unless it is release critical, gate blocker, targeted for RC1[1] or has
been granted a feature freeze exception [2] on the postmortem.

For any question, please reach out on irc.

Thanks,
Armando

[1] https://launchpad.net/neutron/+milestone/newton-rc1
[2] https://review.openstack.org/#/c/360207/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Cutting milestone 3 deliverables

2016-09-01 Thread Armando M.
Neutrinos,

Milestone 3 deliverables have been published [1].

Please, help us check the release notes to make sure everything in order
and post patches to tidy up the release notes if needed. Some of these
reminders are captured in [2], therefore please feel free to help. [3]
captures a list of documentation related bugs, please let's squash those as
much as we can.

We have time to land RC1 targeted changes between now until the 12th. I did
block a number of changes this morning but I will unblock them in the next
hour.

Be mindful of what you approve for merge (e.g. patches containing DB
migration need special attention), and double check whether it's aimed at
making RC1 solid/complete. If not, please refrain from putting it in the
gate queue.

Many thanks for your help!

Cheers,
Armando

[1] https://releases.openstack.org/newton/index.html
[2]
http://docs.openstack.org/developer/neutron/policies/release-checklist.html
[3] https://bugs.launchpad.net/neutron/+bugs?field.tag=doc

On 1 September 2016 at 11:45, Armando M. <arma...@gmail.com> wrote:

> Neutrinos,
>
> We are in the process of releasing the deliverables for Newton 3. This
> means we are in feature freeze and nothing should be approved for merging
> unless it is release critical, gate blocker, targeted for RC1[1] or has
> been granted a feature freeze exception [2] on the postmortem.
>
> For any question, please reach out on irc.
>
> Thanks,
> Armando
>
> [1] https://launchpad.net/neutron/+milestone/newton-rc1
> [2] https://review.openstack.org/#/c/360207/
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Feature Freeze and Feature Freeze exceptions

2016-09-07 Thread Armando M.
Hi folks,

We are about a week away from cutting our first release candidate [0]. In
preparation for that event, we need to make sure our postmortem [1] and FFE
requests are in good order.

For those of you have not had the chance of commenting on [1], please go
ahead and provide your input. Anything else that lacks feedback will very
likely be deferred to Ocata [2] or killed altogether if I am unable to
trace back any recent development. Also, bear in mind that your pending
specs should be retargeted to the new Ocata spec directory [3].

As soon as we cut RC1 and the newton stable branch is cut, master is open
again. For critical or last minute fixes, please file a bug and target for
RC1 for us to evaluate its release impact.

Many thanks for your collaboration!
Cheers,
Armando

[0]
http://lists.openstack.org/pipermail/openstack-dev/2016-September/102829.html
[1] https://review.openstack.org/#/c/360207/
[2] https://launchpad.net/neutron/ocata
[3] https://github.com/openstack/neutron-specs/tree/master/specs/ocata
[4] https://launchpad.net/neutron/+milestone/newton-rc1
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron][Nova][Infra] Linuxbridge job bump

2016-09-08 Thread Armando M.
Folks,

This morning we merged the switch to Xenial for the Linuxbridge job.
However, we overlooked the fact that the job configuration hardcodes eth0
as one of the variables needed by the Neutron linux bridge driver [2]. That
led to failures like [3].

We have a number of changes in the works to overcome this issue [2,4,5].

Many thanks,
Armando

[1] https://review.openstack.org/#/c/367014/
[2] https://review.openstack.org/#/c/367704/
[3]
http://logs.openstack.org/31/367331/1/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/bdba22e/logs/screen-q-agt.txt.gz
[4] https://review.openstack.org/#/c/367699/
[5] https://review.openstack.org/#/c/367693/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Preparing to cut RC1

2016-09-15 Thread Armando M.
Neutrinos,

In the next 24 hours we will be cutting RC1. Unfortunately we're battling
with a nasty bug, that's causing some instability and we're trying to find
the root cause. Please back off rechecking and merging until we figured out
what's happening.

In the meantime, do not be surprised if patches are given a -2 and their
relative LP entries are moved over to Ocata-1. If you think it's of
paramount importance for those changes to be part of Newton, and you are
actively working on them, please use the tag 'newton-rc-potential' [2], to
draw attention from the Neutron release team.

Thanks,
Armando

[1] https://bugs.launchpad.net/bugs/1623732
[2] https://bugs.launchpad.net/neutron/+bugs?field.tag=newton-rc-potential
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][stadium] Query regarding procedure for inclusion in Neutron Stadium

2016-09-23 Thread Armando M.
On 22 September 2016 at 22:36, Takashi Yamamoto <yamam...@midokura.com>
wrote:

> hi,
>
> On Fri, Sep 23, 2016 at 4:20 AM, Armando M. <arma...@gmail.com> wrote:
> >
> >
> > On 22 September 2016 at 00:46, reedip banerjee <reedi...@gmail.com>
> wrote:
> >>
> >> Dear Neutron Core members,
> >>
> >> I have a query regarding the procedure for inclusion in the Neutron
> >> Stadium.
> >> I wanted to know if a project can apply for Big Tent and Neutron Stadium
> >> together ( means can a project be accepted in the Neutron Stadium and
> as a
> >> result into the Big Tent )
> >>
> >> I was checking out the checklist in  [1], and IMO , I think that we need
> >> to conform to the checklist to be added to the Neutron Stadium ( along
> with
> >> the other requirements  like keeping in sync with the core neutron
> concepts)
> >>
> >> But IIUC, certain items in the checklist would be completed if a project
> >> is already included in the Big Tent.
> >
> >
> > I would not worry about those, as these are rather trivial to implement
> in
> > conjunction with Stadium inclusion. I'd worry about the fork that the
> > project relies on, which is a big show stopper for Stadium inclusion.
> >
> > [1] https://github.com/openstack/tap-as-a-service/blob/master/
> setup.cfg#L50
>
> just a clarification; this is not a fork of ovs-agent. it's a separate
> agent.
>

It may not strictly be a fork, but I am not grasping the technical reason
as to why one needs yet another agent on the node. Besides, this might end
up interfering with the OVS agent as it is handling the same resources [1],
without any level of coordination.

[1]
https://github.com/openstack/tap-as-a-service/blob/master/neutron_taas/services/taas/drivers/linux/ovs_taas.py#L43:L44


> >
> >>
> >>
> >> So my doubt is ,should a project apply for the Big Tent first, and after
> >> inclusion, apply for Neutron Stadium ? Or can a project be integrated to
> >> Neutron Stadium and Big Tent simultaneously ( I am a bit sceptical about
> >> this though)?
> >
> >
> > You are confusing the two things. A project either belongs to list [1] or
> > list [2], and you can't be in both at the same time. To be part of either
> > list a project must comply with a set of criteria. As for the latter, a
> > couple of steps may sound like a catch 22: for instance you can't make
> docs
> > available on docs.o.o unless you are in [2] and you can't be in [2]
> > unless...and here's the trick, unless you are a point where you can
> > successfully demonstrate that the project has substantial documentation
> (of
> > any sort, API included). The process of 'demonstrating'/application for
> > inclusion in list [2] follows the RFE submission process that we have
> > adopted for a while, and that means submitting a spec. Since the request
> > does not require a conventional design process, I was going to prepare an
> > ad-hoc template and make it available soon. So watch the neutron-specs
> repo
> > for updates.
> >
> > In the meantime, I'd urge you to go over the checklist and make sure you
> can
> > address the hard parts.
> >
> > If you ask me, if you go with [1], it makes no sense to go and apply to
> be
> > in [2].
> >
> > HTH
> > Armando
> >
> > [1] http://governance.openstack.org/reference/projects/
> > [2] http://governance.openstack.org/reference/projects/neutron.html
> >
> >>
> >>
> >>
> >> [1]
> >> http://docs.openstack.org/developer/neutron/stadium/
> governance.html#checklist
> >> --
> >> Thanks and Regards,
> >> Reedip Banerjee
> >> IRC: reedip
> >>
> >>
> >>
> >>
> >>
> >> 
> __
> >> OpenStack Development Mailing List (not for usage questions)
> >> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
> unsubscribe
> >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> >>
> >
> >
> > 
> __
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
> unsubscribe
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> >
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Preparing RC2

2016-09-26 Thread Armando M.
Neutrinos,

A this point, please consider the list of fixes for RC2 [1] final. We are
no longer considering adding anything to the list unless it's critical and
preventing merges.

Zuul is pretty backed up so we need to clear the currently backlog before
considering adding anything else. We have a WIP from which we'll release.
Ihar and I will refresh it by EOB Tue Sept 27.

If there is anything else you would like to address, please reach out on
IRC.

Thanks,
Armando

[1] https://launchpad.net/neutron/+milestone/newton-rc2
[2] https://review.openstack.org/#/c/376998/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron][Nova] Expose trunk details over metadata API

2016-10-07 Thread Armando M.
On 7 October 2016 at 06:43, Bence Romsics  wrote:

> Hi,
>
> To follow up on the complications of bringing up trunk subports [1] I
> have written up a small proposal for a tiny new feature affecting
> neutron and nova. That is how to expose trunk details over metadata
> API. To avoid big process overhead I have opened a newton rfe ticket
> [2], plus a nova specless blueprint [3] pointing to it. Please let me
> know if I should have followed a different process.
>
>
Replied on [2]. From a Neutron's standpoint, I suspect you already have
what you need.


> Cheers,
> Bence
>
> [1] http://lists.openstack.org/pipermail/openstack-dev/2016-
> September/104848.html
> [2] https://bugs.launchpad.net/neutron/+bug/1631371
> [3] https://blueprints.launchpad.net/nova/+spec/trunk-details-meta
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Stadium evolution - final stage

2016-10-07 Thread Armando M.
Neutrinos,

As some of you may have noticed, there has been a fresh batch of patches on
topic [1]. After having worked on [2][3] during the span of Newton, we are
approaching now the final stage of this consolidation effort, where I
attempt to define a procedure for transparently letting the Neutron
community assess how a subproject meets the standard of quality that any
Neutron-led effort should have.

I started with fwaas and vpnaas so far, and I'll reach out individually to
the maintainers of projects [4] to accurately capture the rest of the
picture. LBaas/Octavia will not be assessed as it's already been agreed
their spinoff [5]. Please bear in mind that the deadline for completing
this assessment effort is firmly set to be Ocata-1 (Nov 14 2016).

Many thanks,
Armando

[1] https://review.openstack.org/#/q/topic:stadium-implosion+status:open
[2] http://specs.openstack.org/openstack/neutron-specs/
specs/newton/neutron-stadium.html
[3] http://docs.openstack.org/developer/neutron/stadium/index.html
[4] http://governance.openstack.org/reference/projects/neutron.html
[5] https://specs.openstack.org/openstack/neutron-specs/
specs/newton/kill-neutron-lbaas.html
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Newton Postmortem

2016-09-16 Thread Armando M.
Neutrinos,

Now that Ocata is with us, we can almost regain our ability to pronounce
Neutron without confusing it with Newton (at least I know I can).

Before doing that, there is still the postmortem to finalize [1]. I will
keep on touching it between now and the day of the official release to make
sure we captured accurately what's been accomplished in, erm, Newton.

I need your help to make sure everything is in tip-top shape, please keep
an eye and review [1] regularly.

Thanks,
Armando

[1] https://review.openstack.org/#/c/360207/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][neutron] summit cross-project session

2016-09-19 Thread Armando M.
On 18 September 2016 at 11:46, Matt Riedemann 
wrote:

> I want to confirm whether or not we're going to have a nova/neutron
> cross-project fishbowl session in Barcelona, I think we are. Since Thierry
> has the draft slots out I wanted to start looking at what time is going to
> work.
>
Looking at:
>
> https://docs.google.com/spreadsheets/d/1TQ-RSlbiBBEclkonIbfU
> P7R1ExZSJylF1uiEKV2G_Cw/pubhtml?gid=1107826458=true
>
> Anytime on Thursday afternoon would work - agreed? I'd like to pencil
> something in.
>

I asked an extra session on the Neutron side to dedicate to nova/neutron,
and I was hoping to have them back to back, but it doesn't look possible
under the current arrangement. Do you think it's worth trying and tweak
things? If not I guess we can have one on Wed the other on Thu.


>
> As far as topics, I think we'll pull from the neutron midcycle report:
>
> http://lists.openstack.org/pipermail/openstack-dev/2016-August/102366.html
>
> So mainly live migration and API interaction improvements.


>
> --
>
> Thanks,
>
> Matt Riedemann
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][stadium] Query regarding procedure for inclusion in Neutron Stadium

2016-09-22 Thread Armando M.
On 22 September 2016 at 00:46, reedip banerjee  wrote:

> Dear Neutron Core members,
>
> I have a query regarding the procedure for inclusion in the Neutron
> Stadium.
> I wanted to know if a project can apply for Big Tent and Neutron Stadium
> together ( means can a project be accepted in the Neutron Stadium and as a
> result into the Big Tent )
>
> I was checking out the checklist in  [1], and IMO , I think that we need
> to conform to the checklist to be added to the Neutron Stadium ( along with
> the other requirements  like keeping in sync with the core neutron concepts)
>
> But IIUC, certain items in the checklist would be completed if a project
> is already included in the Big Tent.
>

I would not worry about those, as these are rather trivial to implement in
conjunction with Stadium inclusion. I'd worry about the fork that the
project relies on, which is a big show stopper for Stadium inclusion.

[1] https://github.com/openstack/tap-as-a-service/blob/master/setup.cfg#L50


>
> So my doubt is ,should a project apply for the Big Tent first, and after
> inclusion, apply for Neutron Stadium ? Or can a project be integrated to
> Neutron Stadium and Big Tent simultaneously ( I am a bit sceptical about
> this though)?
>

You are confusing the two things. A project either belongs to list [1] or
list [2], and you can't be in both at the same time. To be part of either
list a project must comply with a set of criteria. As for the latter, a
couple of steps may sound like a catch 22: for instance you can't make docs
available on docs.o.o unless you are in [2] and you can't be in [2]
unless...and here's the trick, unless you are a point where you can
successfully demonstrate that the project has substantial documentation (of
any sort, API included). The process of 'demonstrating'/application for
inclusion in list [2] follows the RFE submission process that we have
adopted for a while, and that means submitting a spec. Since the request
does not require a conventional design process, I was going to prepare an
ad-hoc template and make it available soon. So watch the neutron-specs repo
for updates.

In the meantime, I'd urge you to go over the checklist and make sure you
can address the hard parts.

If you ask me, if you go with [1], it makes no sense to go and apply to be
in [2].

HTH
Armando

[1] http://governance.openstack.org/reference/projects/
[2] http://governance.openstack.org/reference/projects/neutron.html


>
>
> [1] http://docs.openstack.org/developer/neutron/stadium/
> governance.html#checklist
> --
> Thanks and Regards,
> Reedip Banerjee
> IRC: reedip
>
>
>
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Broken port rule masking: let's have it fixed?

2016-09-22 Thread Armando M.
On 22 September 2016 at 05:50, Inessa Vasilevskaya <
ivasilevsk...@mirantis.com> wrote:

> Hello,
>
> Apologies for multiple posts, forgot to set proper subject in previous one.
>
> I'd like to turn attention to the broken port rule masking problem [1],
> which affects 2 projects so far:
> neutron (mitaka+ with ovs firewall driver configuration) and
> networking-ovs-dpdk [2].
>
> To keep it short: the existing port masking implementation is broken and
> in several cases it will either leave a range of ports open (causing
> unrestricted access) or make some ports inaccessible (when they should be
> open) because of bad tp_src value being generated.
>
> 2 solutions have been proposed so far:
> * The "low-level one" with O(log n) complexity by IWAMOTO Toshihiro and me
> [2]
> * The "high-level one" with O(n^2) complexity by Jakub Libosvar [3]
>
> As long as the bug looks like a security vulnerability and is kind of
> critical for ovs firewall feature, maybe we should choose one algorithm to
> go on with and have this fixed in Newton?
>
>
We'll try to converge on a path forward during today's Neutron drivers
meeting. Watch the logs.

Cheers,
Armando


> [1] https://bugs.launchpad.net/neutron/+bug/1611991
> [2] https://review.openstack.org/#/c/353782/30
> [3] https://review.openstack.org/#/c/353782/16
>
> Best regards,
> Inessa Vasilevskaya
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Fwd: [release][Neutron] Neutron Newton RC1 available

2016-09-16 Thread Armando M.
Neutrinos,

As per announcement below, we are now past RC1. I'll be going over the
changes that were blocked during the past week and lift the -2s. Even
though master development is open, please consider focusing on Newton with
a great deal of attention [1].

Make sure to give review priority to issues as tracked in [2,3,4].

If you have any question, please reach out to a member of the Neutron
release team [5] on IRC.

Cheers,
Armando

[1]
http://docs.openstack.org/developer/neutron/policies/release-checklist.html
[2] https://bugs.launchpad.net/neutron/+bugs?field.tag=doc
[3] https://bugs.launchpad.net/neutron/+bugs?field.tag=deprecation
[4] https://bugs.launchpad.net/neutron/+bugs?field.tag=newton-rc-potential
[5] https://review.openstack.org/#/admin/groups/150,members

-- Forwarded message --
From: Davanum Srinivas 
Date: 16 September 2016 at 09:27
Subject: [openstack-dev] [release][Neutron] Neutron Newton RC1 available
To: "OpenStack Development Mailing List (not for usage questions)" <
openstack-dev@lists.openstack.org>


Hello everyone,

The release candidate for Neutron for the end of the Newton cycle
is available!  You can find the RC1 source code tarball(s) at:

https://tarballs.openstack.org/neutron/neutron-9.0.0.0rc1.tar.gz
https://tarballs.openstack.org/neutron-fwaas/neutron-fwaas-9.0.0.0rc1.tar.gz
https://tarballs.openstack.org/neutron-dynamic-routing/
neutron-dynamic-routing-9.0.0.0rc1.tar.gz
https://tarballs.openstack.org/neutron-lbaas/neutron-lbaas-9.0.0.0rc1.tar.gz
https://tarballs.openstack.org/neutron-vpnaas/neutron-
vpnaas-9.0.0.0rc1.tar.gz

Unless release-critical issues are found that warrant a release
candidate respin, this RC1 will be formally released as the final
Newton release on 6 October. You are therefore strongly
encouraged to test and validate this tarball!

Alternatively, you can directly test the stable/newton release
branch at:

http://git.openstack.org/cgit/openstack/neutron/log/?h=stable/newton

If you find an issue that could be considered release-critical,
please file it at:

https://bugs.launchpad.net/neutron/+filebug

and tag it *newton-rc-potential* to bring it to the Neutron release
crew's attention.

Note that the "master" branch of Neutron is now open for Ocata
development, and feature freeze restrictions no longer apply there!

Thanks,
Dims (On behalf of the Release Team)


--
Davanum Srinivas :: https://twitter.com/dims

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Adding ihrachys to the neutron-drivers team

2016-09-17 Thread Armando M.
Hi folks,

I would like to propose Ihar to become a member of the Neutron drivers team
[1].

Ihar wide knowledge of the Neutron codebase, and his longstanding duties as
stable core, downstream package whisperer, release and oslo liaison (I am
sure I am forgetting some other capacity he is in) is going to put him at
great comfort in the newly appointed role, and help him grow and become
wise even further.

Even though we have not been meeting regularly lately we will resume our
Thursday meetings soon [2], and having Ihar onboard by then will be highly
beneficial.

Please, join me in welcome Ihar to the team.

Cheers,
Armando

[1] http://docs.openstack.org/developer/neutron/policies/neutron-teams.html#
drivers-team
[2] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron][Nova] Neutron mid-cycle summary report

2016-08-26 Thread Armando M.
Hi Neutrinos,

For those of you who couldn't join in person, please find a few notes below
to capture some of the highlights of the event.

I would like to thank everyone one who helped me put this report together,
and everyone who helped make this mid-cycle a fruitful one.

I would also like to thank IBM, and the individual organizers who made
everything go smoothly. In particular Martin, who put up with our moody
requests: thanks Martin!!

Feel free to reach out/add if something is unclear, incorrect or incomplete.

Cheers,
Armando

~~~

We touched on these topics (as initially proposed on
*https://etherpad.openstack.org/p/newton-neutron-midcycle-workitems
*)


   - Keystone v3 and project-id adoption:
  - dasm and amotoki have been working to making the Neutron server
  process project-id correctly [1]. Looking at the spec [2], we
are half way
  through having completed the DB migration, being Keystone v3
complaint, and
  having updated the client bindings [3].
 - [1] https://review.openstack.org/#/c/357977/
 - [2] https://review.openstack.org/#/c/257362/
 - [3] https://review.openstack.org/#/q/topic:bp/keystone-v3
  - Neutron-lib:
  - HenryG, dougwig and kevinbenton worked out a plan to get the
common_db_mixin
  into neutron-lib. Because of the risk of regression, this is
being deferred
  until Ocata opens up. However, simpler changes like the he model_base
  move to lib was agreed on and merged.
  - A plan to provide test support was discussed. The current strategy
  involves providing test base classes in lib (this reverses the stance
  conveyed in Austin). The usual steps involved require to making
  public the currently private classes, ensure the lib's copies are
  up-to-date with core neutron, and deprecate the ones located in
  Neutron.
  - rtheis and armax worked on having networking-ovn test periodically
  against neutron-lib [1,2,3].
 - [1] https://review.openstack.org/#/c/357086/
 - [2] https://review.openstack.org/#/c/359143/
 - [3] https://review.openstack.org/#/c/357079/
  - A tool (tools/migration_report.sh) helps project team determine the
  level of dependency they have with Neutron. It should be
improved to report
  the exact offending imports.
  - Right now neutron-lib 0.4.0 is released and available in
  global-requirements/upper-constraints.
   - Objects and hitless upgrades:
  - Ihar gave the team an overview and status update [1]
  - There was a fruitful discussion that hopefully set the way forward
  for Ocata. The discussed plan was to start Ocata with the
expectation that
  no new contract scripts are landing in Ocata, and to revisit the
  requirement later if for some reason we see any issue with applying the
  requirement in practice.
  - Some work was done to deliver necessary objects for
  push-notifications. Patches up for review. Some review cycles
were spent to
  work on landing patches moving model definitions under neutron/db/models
  - [1] http://lists.openstack.org/pipermail/openstack-dev/
 2016-August/101838.html
  - OSC transition:


   - rtheis gave an update to the team on the state of the transition. Core
  resources commands are all available through OSC; QoS, Metering and *-aaS
  are still not converted.
  - There is some confusion on how to tackle openstacksdk support. We
  discussed the future goal of python binding of Networking API. OSC uses
  OpenStack SDK for network commands and Neutron OSC plugin uses python
  bindings from python-neutronclient. A question is to which project
  developers who add new features implement, both, openstack SDK or
  python-neutronclient? There was no conclusion at the mid-cycle. It is not
  specific to neutron. Similar situation can happen for nova, cinder and
  other projects and we need to raise it to the community.


   - Ocata is going to be the first release where the neutronclient CLI is
  officially deprecated. It may take us more than the usual two cycles to
  remove it altogether, but that's a signal to developer and users to
  seriously develop against OSC, and report bugs against OSC.
  - Several pending contributions into osc-lib.
  - An update is available on [1,2]


   - [1] https://review.openstack.org/#/c/357844/
 - [2] https://etherpad.openstack.org/p/osc-neutron-support
  - Stability squash:
  - armax was bug deputy for the week of the mid-cycle; nothing
  critical showed up in the gate, however pluggable ipam [1] switch merged,
  which might have some unexpected repercussions down the road.
  - A number of bugs older than a year were made expirable [2].
  - kevinbenton and armax devised a strategy and started working on [3]
  to ensure DB retriable 

[openstack-dev] [nova] [os-vif] [neutron] Race in setting up linux bridge

2016-08-26 Thread Armando M.
Folks,

Today I spotted [1]. It turns out Neutron and Nova might be racing trying
to set up the bridge to provide VM with connectivity/dhcp. In the observed
failure mode, os-vif fails in [2].

I suppose we might need to protect the bridge creation and make it handle
the potential exception. We would need a similar fix for Neutron in [3].

That said, knowing there is a looming deadline [4], I'd invite folks to
keep an eye on the bug.

Many thanks,
Armando

[1] https://bugs.launchpad.net/neutron/+bug/1617447
[2]
https://github.com/openstack/os-vif/blob/master/vif_plug_linux_bridge/linux_net.py#L125
[3]
http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/linux/bridge_lib.py#n58
[4]
http://lists.openstack.org/pipermail/openstack-dev/2016-August/102339.html
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Intermittent gate failures

2016-08-22 Thread Armando M.
Neutrinos,

Since the merge of test [1], a race has surfaced, which leads to failure as
reported in [2]. A number of Neutron's jobs are affected, and even though
the failure is only intermittent, it is particularly bad for the linux
bridge job.

If I can ask you to hold your +2/+W until [3] puts the fire out, zuul will
be grateful.

Thanks,
Armando

[1] https://review.openstack.org/#/c/327191/
[2] https://bugs.launchpad.net/neutron/+bug/1615710
[3] https://review.openstack.org/#/c/358753/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Intermittent gate failures

2016-08-22 Thread Armando M.
On 22 August 2016 at 09:51, Armando M. <arma...@gmail.com> wrote:

> Neutrinos,
>
> Since the merge of test [1], a race has surfaced, which leads to failure
> as reported in [2]. A number of Neutron's jobs are affected, and even
> though the failure is only intermittent, it is particularly bad for the
> linux bridge job.
>
> If I can ask you to hold your +2/+W until [3] puts the fire out, zuul will
> be grateful.
>

An update:

We have [1] in the gate queue, and Kevin is going full steam with [2],
which will mitigate the other intermittent issues we're facing in
functional and unit tests. Please bear with us.

Cheers,
Armando

[1] https://review.openstack.org/#/c/358753/
[2] https://review.openstack.org/#/c/356530/


>
> Thanks,
> Armando
>
> [1] https://review.openstack.org/#/c/327191/
> [2] https://bugs.launchpad.net/neutron/+bug/1615710
> [3] https://review.openstack.org/#/c/358753/
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Drivers team cancelled

2016-08-25 Thread Armando M.
Hi folks,

We have a few absences today, apologies for the short notice but I am going
to cancel the meeting.

If there is anything release related you'd like to discuss please reach out
to me on this thread or IRC.

Cheers,
Armando
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Wrapping up Newton

2016-08-25 Thread Armando M.
Hi Neutrinos,

Newton-3 is almost upon us. We are now in non-client requirement freeze,
and a week away from client requirement/feature freeze. This is the time
where we switch gear...for real:

   - Start focusing on testing and documentation, if you have not done so
   already;
   - Apply for FFE on postmortem [1];
   - For pending efforts that get a FFE granted, there's time until [3].
   - Ocata opens up as soon as RC1 is cut [4], therefore those that get
   denied will have to be pushed back until then.

When in doubt, reach out!

Cheers,
Armando

[1] https://review.openstack.org/#/c/360207/
[2] https://releases.openstack.org/newton/schedule.html
[3] Newton 3 milestone, Sept 1.
[4] Newton RC-1, 15 Sept.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Intermittent gate failures

2016-08-24 Thread Armando M.
On 22 August 2016 at 18:25, Armando M. <arma...@gmail.com> wrote:

>
>
> On 22 August 2016 at 09:51, Armando M. <arma...@gmail.com> wrote:
>
>> Neutrinos,
>>
>> Since the merge of test [1], a race has surfaced, which leads to failure
>> as reported in [2]. A number of Neutron's jobs are affected, and even
>> though the failure is only intermittent, it is particularly bad for the
>> linux bridge job.
>>
>> If I can ask you to hold your +2/+W until [3] puts the fire out, zuul
>> will be grateful.
>>
>
> An update:
>
> We have [1] in the gate queue, and Kevin is going full steam with [2],
> which will mitigate the other intermittent issues we're facing in
> functional and unit tests. Please bear with us.
>
> Cheers,
> Armando
>
> [1] https://review.openstack.org/#/c/358753/
> [2] https://review.openstack.org/#/c/356530/
>
>
>>
>> Thanks,
>> Armando
>>
>> [1] https://review.openstack.org/#/c/327191/
>> [2] https://bugs.launchpad.net/neutron/+bug/1615710
>> [3] https://review.openstack.org/#/c/358753/
>>
>

One more update:

We're not quite out of the woods, yet so approve/recheck gently please.

Things have become slightly better but we still have a pending fix for
Neutron [1]. Recently we also observed zuul nodes dying unexpectedly on the
OSIC cloud (that runs Neutron on IPv6) and that had an impact on the
overall sluggishness of the gate [2]. Once all of the fixes are in, we
should be back in business...until the next fire!

Cheers,
Armando

[1] https://review.openstack.org/#/c/356530/
[2] https://bugs.launchpad.net/neutron/+bug/1616282
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Driver meeting cancelled for Thur Sept 29

2016-09-28 Thread Armando M.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Ocata Design Summit ideas kick-off

2016-09-27 Thread Armando M.
Hi folks,

The summit is less than a month away and it's the time of the year where we
need to plan for design summit sessions.

This time we are going for 10 fishbowl sessions, plus Friday [0].

We will break down sessions in three separate tracks as we did the last two
summits. Each track will have its own theme and more details will be
provided in due course.

I started etherpad [1] to collect inputs and ideas. Please start
brainstorming! I'll reach out to the driver team members individually to
work out a more formal agenda once we get some ideas off the ground.

Cheers,
Armando

[0] http://lists.openstack.org/pipermail/openstack-dev/
2016-September/103851.html
[1] https://etherpad.openstack.org/p/ocata-neutron-summit-ideas
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Retiring stale stadium projects

2016-09-27 Thread Armando M.
Hi Neutrinos,

I wanted to double check with you the state of these following projects:

- networking-ofagent
- python-neutron-pd-driver

It's my understanding that they are ready for retirement or thereabouts.
Please confirm, and I'll kick off the countdown sequence [1].

Cheers,
Armando

[1] http://docs.openstack.org/infra/manual/drivers.html#retiring-a-project
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] dhcp 'Address already in use' errors when trying to start a dnsmasq

2016-09-27 Thread Armando M.
On 27 September 2016 at 11:29, Miguel Angel Ajo Pelayo 
wrote:

> Ack, and thanks for the summary Ihar,
>
> I will have a look on it tomorrow morning, please update this thread
> with any progress.
>
>
>
> On Tue, Sep 27, 2016 at 8:22 PM, Ihar Hrachyshka 
> wrote:
> > Hi all,
> >
> > so we started getting ‘Address already in use’ when trying to start
> dnsmasq
> > after the previous instance of the process is killed with kill -9.
> Armando
> > spotted it today in logs for: https://review.openstack.org/#/c/377626/
> but
> > as per logstash it seems like an error we saw before (the earliest I see
> is
> > 9/20), f.e.:
> >
> > http://logs.openstack.org/26/377626/1/check/gate-tempest-dsv
> m-neutron-full-ubuntu-xenial/b6953d4/logs/screen-q-dhcp.txt.gz
> >
> > Assuming I understand the flow of the failure, it runs as follows:
> >
> > - sync_state starts dnsmasq per network;
> > - after agent lock is freed, some other notification event
> > (port_update/subnet_update/...) triggers restart for one of the
> processes;
> > - the restart is done not via reload_allocations (-SIGHUP) but thru
> > restart/disable (kill -9);
> > - once the old dnsmasq is killed with -9, we attempt to start a new
> process
> > with new config files generated and fail with: “dnsmasq: failed to create
> > listening socket for 10.1.15.242: Address already in use”
> > - surprisingly, after several failing attempts to start the process, it
> > succeeds to start it after a bunch of seconds and runs fine.
> >
> > It looks like once we kill the process with -9, it may hold for the
> socket
> > resource for some time and may clash with the new process we try to
> spawn.
> > It’s a bit weird because dnsmasq should have set REUSEADDR for the
> socket,
> > so a new process should have started just fine.
> >
> > Lately, we landed several patches that touched reload logic for DHCP
> agent
> > on notifications. Among those suspicious in the context are:
> >
> > - https://review.openstack.org/#/c/372595/ - note it requests ‘disable’
> (-9)
> > where it was using ‘reload_allocations’ (-SIGHUP) before, and it also
> does
> > not unplug the port on lease release (maybe after we rip of the device,
> the
> > address clash with the old dnsmasq state is gone even though the ’new’
> port
> > will use the same address?).
> > - https://review.openstack.org/#/c/372236/6 - we were requesting
> > reload_allocations in some cases before, and now we put the network into
> > resync queue
> >
> > There were other related changes lately, you can check history of Kevin’s
> > changes for the branch, it should capture most of them.
> >
> > I wonder whether we hit some long standing restart issue with dnsmasq
> here
> > that was just never triggered before because we were not calling kill -9
> so
> > eagerly as we do now.
> >
> > Note: Jakub Libosvar validated that 'kill -9 && dnsmasq’ in loop does NOT
> > result in the failure we see in gate logs.
> >
> > We need to understand what’s going with the failure, and come up with
> some
> > plan for Newton. We either revert suspected patches as I believe Armando
> > proposed before, but then it’s not clear until which point to do it; or
> we
> > come up with some smart fix for that, that I don’t immediately grasp.
> >
> > I will be on vacation tomorrow, though I will check the email thread to
> see
> > if we have a plan to act on. I really hope folks give the issue a
> priority
> > since it seems like we buried ourselves under a pile of interleaved
> patches
> > and now we don’t have a clear view of how to get out of the pile.
>

Personally I feel there is no time left for us to do anything about this in
RC2. Nothing at this point is going to guarantee that another patch is not
gonna lead us to new potential ripple effects. I am personally okay to cut
RC2 as it stands, and let downstream players have some time vetting the
build and give us a chance to fix one more last minute "disaster".

Rest assured we'll learn from this mistake.

A.

>
> > Cheers,
> > Ihar
> >
> > 
> __
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe: openstack-dev-requ...@lists.op
> enstack.org?subject:unsubscribe
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][neutron] When are subnets needed on a network to create ports?

2016-11-08 Thread Armando M.
On 8 November 2016 at 18:35, Matt Riedemann 
wrote:

> I've been looking at this nova bug:
>
> https://bugs.launchpad.net/nova/+bug/1637118
>
> And the neutronv2 API code in nova and need some help from the neutron
> team on how this should actually work.
>

If I am not mistaken [1] is what we'd need on the nova side.

As for neutron, we implemented [2], which can be leveraged by [1] in order
to implement the non-backward compatible behavior of lifting the constraint
check should a port be required without an address.

Mind you, I said port intentionally, meaning that even with [1], bug
1637118 would still manifest itself (in other words, it would be the
expected behavior). Booting off unaddressed VMs is an advanced use case and
as such it requires to boot by specifying the port ID.

[1] https://blueprints.launchpad.net/neutron/+spec/vm-without-l3-address
[2] https://blueprints.launchpad.net/nova/+spec/vm-boot-with-
unaddressed-port



> The validation code that runs from nova-api when creating a server checks
> the requested/available networks to see if they have subnets and if not
> it's a failure. The original change that added that way back in icehouse
> was because you'd get a security group could not be applied failure when
> trying to create ports on a network with port security enabled but that
> didn't have subnets.
>
> Now the code in nova that creates the port, which happens in nova-compute,
> handles this - it only fails if the network doesn't have subnets if the
> network has port security enabled. If the network doesn't have port
> security enabled, we don't care about subnets before creating the port.
>
> However, that icehouse-era validation code that happens in the API side
> before casting to the compute is still there, and that's what the bug is
> saying is a problem.
>
> So that sounds like a legitimate issue, but I wanted to get confirmation
> from the neutron team first before moving forward with a fix.
>
> --
>
> Thanks,
>
> Matt Riedemann
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [lbaas] [octavia] Ocata LBaaS retrospective and next steps recap

2016-11-09 Thread Armando M.
On 9 November 2016 at 05:50, Gary Kotton  wrote:

> Hi,
> What about neutron-lbaas project? Is this project still alive and kicking
> to the merge is done or are we going to continue to maintain it? I feel
> like we are between a rock and a hard place here. LBaaS is in production
> and it is not clear the migration process. Will Octavia have the same DB
> models as LBaaS or will there be a migration?
> Sorry for the pessimism but I feel that things are very unclear and that
> we cannot even indicate to our community/consumers what to use/expect.
> Thanks
> Gary
>

http://specs.openstack.org/openstack/neutron-specs/specs/newton/kill-neutron-lbaas.html


>
> On 11/8/16, 1:36 AM, "Michael Johnson"  wrote:
>
> Ocata LBaaS retrospective and next steps recap
> --
>
> This session lightly touched on the work in the newton cycle, but
> primarily focused on planning for the Ocata release and the LBaaS spin
> out of neutron and merge into the octavia project [1].  Notes were
> captured on the etherpad [1].
>
> The focus of work for Ocata in neutron-lbaas and octavia will be on
> the spin out/merge and not new features.
>
> Work has started on merging neutron-lbaas into the octavia project
> with API sorting/pagination, quota support, keystone integration,
> neutron-lbaas driver shim, and documentation updates.  Work is still
> needed for policy support, the API shim to handle capability gaps
> (example: stats are by listener in octavia, but by load balancer in
> neturon-lbaas), neutron api proxy, a database migration script from
> the neutron database to the octavia database for existing non-octavia
> load balancers, and adding the "bug for bug" neutron-lbaas v2 API to
> the octavia API server.
>
> The room agreed that since we will have a shim/proxy in neutron for
> some time, updating the OpenStack client can be deferred to a future
> cycle.
>
> There is a lot of concern about Ocata being a short cycle and the
> amount of work to be done.  There is hope that additional resources
> will help out with this task to allow us to complete the spin
> out/merge for Ocata.
>
> We discussed the current state of the active/active topology patches
> and agreed that it is unlikely this will merge in Ocata.  There are a
> lot of open comments and work to do on the patches.  It appears that
> these patches may have been created against an old release and require
> significant updating.
>
> Finally there was a question about when octavia would implement
> metadata tags.  When we dug into the need for the tags we found that
> what was really wanted is a full implementation of the flavors
> framework [3] [4].  Some vendors expressed interest in finishing the
> flavors framework for Octavia.
>
> Thank you to everyone that participated in our design session and
> etherpad.
>
> Michael
>
> [1] https://specs.openstack.org/openstack/neutron-specs/specs/
> newton/kill-neutron-lbaas.html
> [2] https://etherpad.openstack.org/p/ocata-neutron-octavia-
> lbaas-session
> [3] https://specs.openstack.org/openstack/neutron-specs/specs/
> mitaka/neutron-flavor-framework-templates.html
> [4] https://specs.openstack.org/openstack/neutron-specs/specs/
> liberty/neutron-flavor-framework.html
>
> 
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
> unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Transition to Ubuntu Xenial in the gate

2016-11-10 Thread Armando M.
Hi Neutrinos,

Some of you may be aware of our CI jobs have been transitioning to Xenial.
There are a few jobs still left and taking into account mail [1] we need to
accelerate the process a bit, especially for those jobs that affect our
gate queue or are voting.

Ajo put together [2], I also added a provisional 'xenial' launchpad bug tag
[3] to track fixes required to get us in tip-top shape.

Please help out as you can.

Cheers,
Armando

[1]
http://lists.openstack.org/pipermail/openstack-dev/2016-November/106906.html
[2] https://etherpad.openstack.org/p/moving-neutron-jobs-to-xenial
[3] https://bugs.launchpad.net/neutron/+bugs?field.tag=xenial
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] retiring python-neutron-pd-driver

2016-10-19 Thread Armando M.
To whom it may concern,

I have started the procedure [1] to retire project [2]. If you are affected
by this, this is the last opportunity to provide feedback. That said, users
should be able to use the in tree version of dibbler as documented in [3].

Cheers,
Armando

[1]
https://review.openstack.org/#/q/I77099ba826b8c7d28379a823b4dc74aa65e653d8
[2] http://git.openstack.org/cgit/openstack/python-neutron-pd-driver/
[3]
http://docs.openstack.org/newton/networking-guide/config-ipv6.html#configuring-the-dibbler-server
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Team meeting this Monday at 2100 UTC + forthcoming schedule

2016-10-17 Thread Armando M.
Hi neutrinos,

A kind reminder for this week's meeting. More on the agenda [1]. Also, due
to the summit, the next occurrences will be cancelled.

- Oct 25, Tuesday
- Oct 31, Monday

Cheers,
Armando

[1] https://wiki.openstack.org/wiki/Network/Meetings
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Drivers meeting cancelled Oct 27

2016-10-20 Thread Armando M.
Folks,

Just a reminder that due to the ongoing Summit, the drivers team is
cancelled for the week.

We'll meet regularly in the next few hours.

Cheers,
Armando
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] next upgrades meeting is Nov 7th

2016-10-17 Thread Armando M.
On 17 October 2016 at 12:29, Ihar Hrachyshka  wrote:

> Hi all,
>
> due to the summit we cancel the next two upgrades subteam meetings.
>
> We will get back Nov 7th, just in time to close any remaining gaps before
> the world as we know it is destroyed by US elections the next day.
>

Don't even joke about this, it's not funny :)


>
> See you there,
> Ihar
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Transition to Ubuntu Xenial in the gate

2016-11-23 Thread Armando M.
On 10 November 2016 at 17:36, Armando M. <arma...@gmail.com> wrote:

> Hi Neutrinos,
>
> Some of you may be aware of our CI jobs have been transitioning to Xenial.
> There are a few jobs still left and taking into account mail [1] we need to
> accelerate the process a bit, especially for those jobs that affect our
> gate queue or are voting.
>
> Ajo put together [2], I also added a provisional 'xenial' launchpad bug
> tag [3] to track fixes required to get us in tip-top shape.
>
> Please help out as you can.
>
> Cheers,
> Armando
>
> [1] http://lists.openstack.org/pipermail/openstack-dev/2016-
> November/106906.html
> [2] https://etherpad.openstack.org/p/moving-neutron-jobs-to-xenial
> [3] https://bugs.launchpad.net/neutron/+bugs?field.tag=xenial
>

During the past few weeks lots of progress has been made, we're nearly
completed the transition to xenial as far as the neutron queues go (with
functional and fullstack trailing slightly behind). I have a pending patch
to switch neutron-lib's jobs to xenial [1].

The other untouched surface is python-neutronclient, which I'll be tackling
next. I would invite subprojects maintainers to take a look at their infra
settings to ensure that the switch to xenial won't bite them when it comes.
There's plenty of examples in [2] to learn how to switch.

Cheers,
Armando

[1] https://review.openstack.org/#/c/397401/
[2] https://etherpad.openstack.org/p/moving-neutron-jobs-to-xenial
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-23 Thread Armando M.
On 23 November 2016 at 16:42, Joshua Harlow <harlo...@fastmail.com> wrote:

> A suggestion would also to setup something like the following:
>
> https://wiki.openstack.org/wiki/Oslo#Periodic
>
> Get the users of neutron lib being tested against the latest neutron lib
> (at least nightly) and seeing if they will be borked by a new neutron lib
> merge...
>
> http://status.openstack.org/openstack-health/#/?groupKey=bui
> ld_name=hour=-with-oslo
>
> Overall be careful with the APIs u expose and plan out how u will shift
> users from the old API to the new API (without destroying the world during
> that transition).
>
> My 3 cents :-P
>

I take the 3 cents, but we already do that :)

http://status.openstack.org/openstack-health/#/?groupKey=build_name=hour=-with-neutron-lib-master


> -Josh
>
>
> Boden Russell wrote:
>
>> I would encourage anyone working on neutron-lib related changes to have
>> a peek at the recently renovated contributing doc [1] if you haven't
>> already.
>>
>> In particular the 'Phase 4: Consume' section [2] provides some tips on
>> how we see this workflow playing out.
>>
>> Thanks
>>
>> [1]
>> https://github.com/openstack/neutron-lib/blob/master/doc/sou
>> rce/contributing.rst
>> [2]
>> https://github.com/openstack/neutron-lib/blob/master/doc/sou
>> rce/contributing.rst#phase-4-consume
>>
>>
>> On 11/23/16 12:39 PM, Armando M. wrote:
>>
>>> Hi neutrinos,
>>>
>>> In the last few hours a couple of changes landed [1,2] that caused a bit
>>> of a jam in the neutron subproject gates, as they overlapped with
>>> another change [3] having impact on the subprojects.
>>>
>>> This is why it is important to communicate during team meetings and/or
>>> ML that patches with potential impact are in flight in our review
>>> pipeline, so that we do our best to coordinate the merge process without
>>> shooting ourselves in the foot.
>>>
>>> To bring this back to sanity, I issued a temporary revert [4], so that
>>> [5] can land undisturbed. After that, a double revert will be applied,
>>> once subprojects have had the opportunity to deal with the aftermath of
>>> the other breaking change [1,2] (e.g. [6,7]).
>>>
>>>  From now on, I'd strongly encourage people proposing/reviewing patches
>>> with potential impact (any impact) to err on the side of caution, and
>>> take the advised steps to ensure such situations don't happen in the
>>> future.
>>>
>>> Thanks,
>>> Armando
>>>
>>> [1] https://review.openstack.org/#/c/397704/
>>> [2] https://review.openstack.org/#/c/397037/
>>> [3] https://review.openstack.org/#/c/386845/
>>> [4] https://review.openstack.org/#/c/401377/
>>> [5] https://review.openstack.org/#/q/topic:plugin-directory+status:open
>>> [6] https://review.openstack.org/#/c/401263/
>>> [7] https://review.openstack.org/#/c/401355/
>>>
>>>
>>> 
>>> __
>>> OpenStack Development Mailing List (not for usage questions)
>>> Unsubscribe: openstack-dev-requ...@lists.op
>>> enstack.org?subject:unsubscribe
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>
>>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscrib
>> e
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][tacker] Trunk ports in Tacker?

2016-11-23 Thread Armando M.
On 23 November 2016 at 01:47, zhi  wrote:

> Hi, all
>
> Recently I did some research about trunk port in neutron by following
> document[1]. By creating a trunk port, I can use this port ( aka " parent
> port " ) to create a VM. So I can add or remove subports on this "parent
> port" which used by the VM I created.
>
> I want to know how Tacker can use " trunk port ". In Tacker, I can create
> a VNFD template which contains network infos like
> "
> VL1:
>   type: tosca.nodes.nfv.VL
>   properties:
> network_name: net_mgmt
> vendor: Tacker
> "
> So I can use this template to create VNFs with specific network info(
> naming net_mgmt ). Finally VNFs own its normal ports in neutron. So my
> question is:
>
> Can I use trunk ports in Tacker?
>
> I read some document about VLAN transparent in Neutron. In my thought, I
> can create a vlan transparent network in Neutron and using this network in
> VNFD template. At last, every VNF's
> port is " trunk port " and I can add or remove subports on it. Am I right?
>
> In Newton, I enabled the vlan-transparent in neutron server and try to
> create a vlan transparent network. But I failed. I got the error message
> is: " Backend does not support VLAN Transparency ".
>
> VLAN transparent doesn't support in Newton now?
>

VLAN transparency is backend dependent. OVS, if that's the one you were
using, does not support it.


>
>
> Thanks
> Zhi Chang
>
> [1]: https://wiki.openstack.org/wiki/Neutron/TrunkPort
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-24 Thread Armando M.
On 24 November 2016 at 10:16, Neil Jerram <n...@tigera.io> wrote:

> To be clear, when I said 'catching such issues', what I meant was:
> 'letting me know promptly that I now need to update networking-calico'.
>

We're asking folks to take a number of steps to properly communicate
potential issues such as those happened during the past 24 hours:

   - Mark a change's commit message with 'NeutronLibImpact' so that it can
   be caught with gerrit filters [1,2]. This helps folks to check for imminent
   potential impact or past impact that one has to catch up to. We have a
   weekly team meeting discussion about such issues to raise visibility.
   - further raise awareness in ML threads, in case offline discussion is
   required.

Monitoring the usual channels (team meeting logs and ML threads) should
give ample notice to folks and instructions on how to react.

Cheers,
Armando

[1]
https://review.openstack.org/#/q/status:open+message:%22NeutronLibImpact%22
[2]
https://review.openstack.org/#/q/status:merged+message:%22NeutronLibImpact%22


> I absolutely did not mean any kind of delaying or blocking a neutron or
> neutron-lib change.
>
> Thanks,
>  Neil
>
>
>
> On Thu, Nov 24, 2016 at 5:43 PM Kevin Benton <ke...@benton.pub> wrote:
>
>> Yeah, in this case I don't think it would have helped because it was
>> removing several things from neutron simultaneously. The only thing that
>> would have stopped that would have been jobs from all sub projects voting
>> on each neutron change.
>>
>> On Nov 24, 2016 10:02, "Armando M." <arma...@gmail.com> wrote:
>>
>>
>>
>> On 24 November 2016 at 05:27, Neil Jerram <n...@tigera.io> wrote:
>>
>> But I think a periodic check for a Neutron/neutron-lib-using project
>> (such as networking-calico) would still be a decent way of catching such
>> issues, wouldn't it?
>>
>>
>> It depends, and it would. There are many factors at play, as Kevin
>> pointed out.
>>
>>
>>
>>
>> On Thu, Nov 24, 2016 at 12:58 AM Kevin Benton <ke...@benton.pub> wrote:
>>
>> The issue we had is different than breaking changes in neutron-lib. The
>> issue we are running into now is bumps in the road when we are removing
>> deprecated things from Neutron that other projects are still using even
>> though they should be using the neutron-lib version instead.
>>
>> On Wed, Nov 23, 2016 at 5:42 PM, Joshua Harlow <harlo...@fastmail.com>
>> wrote:
>>
>> A suggestion would also to setup something like the following:
>>
>> https://wiki.openstack.org/wiki/Oslo#Periodic
>>
>> Get the users of neutron lib being tested against the latest neutron lib
>> (at least nightly) and seeing if they will be borked by a new neutron lib
>> merge...
>>
>> http://status.openstack.org/openstack-health/#/?groupKey=
>> build_name=hour=-with-oslo
>>
>> Overall be careful with the APIs u expose and plan out how u will shift
>> users from the old API to the new API (without destroying the world during
>> that transition).
>>
>> My 3 cents :-P
>>
>> -Josh
>>
>>
>> Boden Russell wrote:
>>
>> I would encourage anyone working on neutron-lib related changes to have
>> a peek at the recently renovated contributing doc [1] if you haven't
>> already.
>>
>> In particular the 'Phase 4: Consume' section [2] provides some tips on
>> how we see this workflow playing out.
>>
>> Thanks
>>
>> [1]
>> https://github.com/openstack/neutron-lib/blob/master/doc/
>> source/contributing.rst
>> [2]
>> https://github.com/openstack/neutron-lib/blob/master/doc/
>> source/contributing.rst#phase-4-consume
>>
>>
>> On 11/23/16 12:39 PM, Armando M. wrote:
>>
>> Hi neutrinos,
>>
>> In the last few hours a couple of changes landed [1,2] that caused a bit
>> of a jam in the neutron subproject gates, as they overlapped with
>> another change [3] having impact on the subprojects.
>>
>> This is why it is important to communicate during team meetings and/or
>> ML that patches with potential impact are in flight in our review
>> pipeline, so that we do our best to coordinate the merge process without
>> shooting ourselves in the foot.
>>
>> To bring this back to sanity, I issued a temporary revert [4], so that
>> [5] can land undisturbed. After that, a double revert will be applied,
>> once subprojects have had the opportunity to deal with the aftermath of
>> the other breaking change [1,2] (e.g. [6,7]).
>>
&

Re: [openstack-dev] [neutron] stable/newton 'broken'

2016-11-24 Thread Armando M.
On 24 November 2016 at 11:12, Gary Kotton <gkot...@vmware.com> wrote:

> The breakage is due to the fact that the projects do not have
> stable/newton branches cut.
>
This is something that I would have expected the neutron team to take care
> of as long as it was under the stadium/tent or whatever we want to call it.
>

Before [1] and [2] you were pulling from master all the time. You are in
charge of your own project, so you are solely at fault of the issue you're
complaining about.

[1] https://review.openstack.org/#/c/400462/
[2] https://review.openstack.org/#/c/402070/


> The fact that the l2gw was removed may have been an indication that it
> should not have been there. But we have a clear responsibility to the
> community about this. Was there are mail indicating that it is excluded
> from the stadium/tent. I do not recall. I just woke up one morning
> discovering that you did that. There was not much discussion there.
>

LOL, you genuinely made me laugh. If you don't stay plugged, whose fault is
that again? The discussion for the governance update did not happen
overnight.


>
It is really unclear how the patches that you added below would have solved
> the problem.
>
> We have made sure that the vmware-nsx code is back up and running. I just
> hope that others are unaffected by this.
>

My patch specifically would have not solved the problem you claim it's
caused by the recent neutron master changes. I am just highlighting that
prior to that you were always pulling from master. With my change you could
simply set BRANCH=stable/newton in [3] in the appropriate branch and you'd
be good to go.

[3]
https://review.openstack.org/#/c/400462/1/tools/tox_install_project.sh@22

What I would like to see happen:
>
> 1.   L2gw gets a stable branch. At the moment the l2gw release team
> is non existent so community please advise how we can add cores
>
You can get hold of people [1] and ask them to make you join the team.

[1] https://review.openstack.org/#/admin/groups/532,members

> 2.   Tap-as-a-service is added to the stadium and tent.
>
 How is this relevant to this discussion?


>
> A luta continua
>
>
>
> *From: *"Armando M." <arma...@gmail.com>
> *Reply-To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Date: *Thursday, November 24, 2016 at 7:03 PM
> *To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Subject: *Re: [openstack-dev] [neutron] stable/newton 'broken'
>
>
>
>
>
>
>
> On 24 November 2016 at 02:38, Thierry Carrez <thie...@openstack.org>
> wrote:
>
> Gary Kotton wrote:
> > Please see - http://logs.openstack.org/82/401882/1/check/gate-vmware-
> nsx-python27-db-ubuntu-xenial/1ac0686/console.html#_2016-11-
> 24_06_58_38_520273
> > Here we are pulling trunk as there is no stable version to use
>
> Is neutron stable/newton really broken (like your subject seems to
> indicate) ? Or only vmware-nsx stable/newton ? Since networking-l2gw and
> tap-as-a-service are unofficial projects we can't guarantee that they
> will create branches that match the official stable ones, so we should
> try to avoid depending on them if possible...
>
>
>
> This happens because the referenced projects have no newton branch and the
> consuming project's stable newton was pulling from the master branch (and
> [1] is the hack referenced below). The right fix would be to backport [2],
> create the stable branches of the projects to which vmware-nsx depends on
> and set the branch appropriately. This is what the neutron team does for
> the projects we look after.
>
>
>
> This breakage was waiting to happen, and it just did.
>
>
>
> [1] https://github.com/openstack/vmware-nsx/commit/
> 9a455781e4db9fc360c3264b72c381c91dfa6a15
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openstack_vmware-2Dnsx_commit_9a455781e4db9fc360c3264b72c381c91dfa6a15=DgMFaQ=uilaK90D4TOVoH58JNXRgQ=PMrZQUSXojEgJQPh7cZrz1Lvja0OwAstg0U82FalZrw=9RMdQBJlmqlbq0DHIHP9NTT4ot9qb0nfNG5qMMfoE2o=v8Iagz-K729O8YOVJ-6w_1lXYa6UNXJt65nAnaHPBns=>
>
> [2] https://github.com/openstack/vmware-nsx/commit/
> a951f5f9299ffdce268c54dc427a71706b8e41da
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openstack_vmware-2Dnsx_commit_a951f5f9299ffdce268c54dc427a71706b8e41da=DgMFaQ=uilaK90D4TOVoH58JNXRgQ=PMrZQUSXojEgJQPh7cZrz1Lvja0OwAstg0U82FalZrw=9RMdQBJlmqlbq0DHIHP9NTT4ot9qb0nfNG5qMMfoE2o=IjsdHWFgL__ygsTjKpo2YJsfuaX6AIuy4Jn82vkfZQg=>
>
>
>
>
> --
> Thierry Carrez (ttx)
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://l

Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-24 Thread Armando M.
On 24 November 2016 at 05:27, Neil Jerram <n...@tigera.io> wrote:

> But I think a periodic check for a Neutron/neutron-lib-using project (such
> as networking-calico) would still be a decent way of catching such issues,
> wouldn't it?
>

It depends, and it would. There are many factors at play, as Kevin pointed
out.


>
>
> On Thu, Nov 24, 2016 at 12:58 AM Kevin Benton <ke...@benton.pub> wrote:
>
>> The issue we had is different than breaking changes in neutron-lib. The
>> issue we are running into now is bumps in the road when we are removing
>> deprecated things from Neutron that other projects are still using even
>> though they should be using the neutron-lib version instead.
>>
>> On Wed, Nov 23, 2016 at 5:42 PM, Joshua Harlow <harlo...@fastmail.com>
>> wrote:
>>
>> A suggestion would also to setup something like the following:
>>
>> https://wiki.openstack.org/wiki/Oslo#Periodic
>>
>> Get the users of neutron lib being tested against the latest neutron lib
>> (at least nightly) and seeing if they will be borked by a new neutron lib
>> merge...
>>
>> http://status.openstack.org/openstack-health/#/?groupKey=
>> build_name=hour=-with-oslo
>>
>> Overall be careful with the APIs u expose and plan out how u will shift
>> users from the old API to the new API (without destroying the world during
>> that transition).
>>
>> My 3 cents :-P
>>
>> -Josh
>>
>>
>> Boden Russell wrote:
>>
>> I would encourage anyone working on neutron-lib related changes to have
>> a peek at the recently renovated contributing doc [1] if you haven't
>> already.
>>
>> In particular the 'Phase 4: Consume' section [2] provides some tips on
>> how we see this workflow playing out.
>>
>> Thanks
>>
>> [1]
>> https://github.com/openstack/neutron-lib/blob/master/doc/
>> source/contributing.rst
>> [2]
>> https://github.com/openstack/neutron-lib/blob/master/doc/
>> source/contributing.rst#phase-4-consume
>>
>>
>> On 11/23/16 12:39 PM, Armando M. wrote:
>>
>> Hi neutrinos,
>>
>> In the last few hours a couple of changes landed [1,2] that caused a bit
>> of a jam in the neutron subproject gates, as they overlapped with
>> another change [3] having impact on the subprojects.
>>
>> This is why it is important to communicate during team meetings and/or
>> ML that patches with potential impact are in flight in our review
>> pipeline, so that we do our best to coordinate the merge process without
>> shooting ourselves in the foot.
>>
>> To bring this back to sanity, I issued a temporary revert [4], so that
>> [5] can land undisturbed. After that, a double revert will be applied,
>> once subprojects have had the opportunity to deal with the aftermath of
>> the other breaking change [1,2] (e.g. [6,7]).
>>
>>  From now on, I'd strongly encourage people proposing/reviewing patches
>> with potential impact (any impact) to err on the side of caution, and
>> take the advised steps to ensure such situations don't happen in the
>> future.
>>
>> Thanks,
>> Armando
>>
>> [1] https://review.openstack.org/#/c/397704/
>> [2] https://review.openstack.org/#/c/397037/
>> [3] https://review.openstack.org/#/c/386845/
>> [4] https://review.openstack.org/#/c/401377/
>> [5] https://review.openstack.org/#/q/topic:plugin-directory+status:open
>> [6] https://review.openstack.org/#/c/401263/
>> [7] https://review.openstack.org/#/c/401355/
>>
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
>> unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
>> unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
>> unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>> 
&

Re: [openstack-dev] [neutron] stable/newton 'broken'

2016-11-24 Thread Armando M.
On 24 November 2016 at 02:38, Thierry Carrez  wrote:

> Gary Kotton wrote:
> > Please see - http://logs.openstack.org/82/401882/1/check/gate-vmware-
> nsx-python27-db-ubuntu-xenial/1ac0686/console.html#_2016-11-
> 24_06_58_38_520273
> > Here we are pulling trunk as there is no stable version to use
>
> Is neutron stable/newton really broken (like your subject seems to
> indicate) ? Or only vmware-nsx stable/newton ? Since networking-l2gw and
> tap-as-a-service are unofficial projects we can't guarantee that they
> will create branches that match the official stable ones, so we should
> try to avoid depending on them if possible...
>

This happens because the referenced projects have no newton branch and the
consuming project's stable newton was pulling from the master branch (and
[1] is the hack referenced below). The right fix would be to backport [2],
create the stable branches of the projects to which vmware-nsx depends on
and set the branch appropriately. This is what the neutron team does for
the projects we look after.

This breakage was waiting to happen, and it just did.

[1]
https://github.com/openstack/vmware-nsx/commit/9a455781e4db9fc360c3264b72c381c91dfa6a15
[2]
https://github.com/openstack/vmware-nsx/commit/a951f5f9299ffdce268c54dc427a71706b8e41da


> --
> Thierry Carrez (ttx)
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] neutron-lib impact

2016-11-23 Thread Armando M.
Hi neutrinos,

In the last few hours a couple of changes landed [1,2] that caused a bit of
a jam in the neutron subproject gates, as they overlapped with another
change [3] having impact on the subprojects.

This is why it is important to communicate during team meetings and/or ML
that patches with potential impact are in flight in our review pipeline, so
that we do our best to coordinate the merge process without shooting
ourselves in the foot.

To bring this back to sanity, I issued a temporary revert [4], so that [5]
can land undisturbed. After that, a double revert will be applied, once
subprojects have had the opportunity to deal with the aftermath of the
other breaking change [1,2] (e.g. [6,7]).

>From now on, I'd strongly encourage people proposing/reviewing patches with
potential impact (any impact) to err on the side of caution, and take the
advised steps to ensure such situations don't happen in the future.

Thanks,
Armando

[1] https://review.openstack.org/#/c/397704/
[2] https://review.openstack.org/#/c/397037/
[3] https://review.openstack.org/#/c/386845/
[4] https://review.openstack.org/#/c/401377/
[5] https://review.openstack.org/#/q/topic:plugin-directory+status:open
[6] https://review.openstack.org/#/c/401263/
[7] https://review.openstack.org/#/c/401355/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-24 Thread Armando M.
On 24 November 2016 at 09:41, Kevin Benton <ke...@benton.pub> wrote:

> Yeah, in this case I don't think it would have helped because it was
> removing several things from neutron simultaneously. The only thing that
> would have stopped that would have been jobs from all sub projects voting
> on each neutron change.
>

Right, and that's never gonna happen otherwise we might as well put all the
code back into one tree.


>
> On Nov 24, 2016 10:02, "Armando M." <arma...@gmail.com> wrote:
>
>>
>>
>> On 24 November 2016 at 05:27, Neil Jerram <n...@tigera.io> wrote:
>>
>>> But I think a periodic check for a Neutron/neutron-lib-using project
>>> (such as networking-calico) would still be a decent way of catching such
>>> issues, wouldn't it?
>>>
>>
>> It depends, and it would. There are many factors at play, as Kevin
>> pointed out.
>>
>>
>>>
>>>
>>> On Thu, Nov 24, 2016 at 12:58 AM Kevin Benton <ke...@benton.pub> wrote:
>>>
>>>> The issue we had is different than breaking changes in neutron-lib. The
>>>> issue we are running into now is bumps in the road when we are removing
>>>> deprecated things from Neutron that other projects are still using even
>>>> though they should be using the neutron-lib version instead.
>>>>
>>>> On Wed, Nov 23, 2016 at 5:42 PM, Joshua Harlow <harlo...@fastmail.com>
>>>> wrote:
>>>>
>>>> A suggestion would also to setup something like the following:
>>>>
>>>> https://wiki.openstack.org/wiki/Oslo#Periodic
>>>>
>>>> Get the users of neutron lib being tested against the latest neutron
>>>> lib (at least nightly) and seeing if they will be borked by a new neutron
>>>> lib merge...
>>>>
>>>> http://status.openstack.org/openstack-health/#/?groupKey=bui
>>>> ld_name=hour=-with-oslo
>>>>
>>>> Overall be careful with the APIs u expose and plan out how u will shift
>>>> users from the old API to the new API (without destroying the world during
>>>> that transition).
>>>>
>>>> My 3 cents :-P
>>>>
>>>> -Josh
>>>>
>>>>
>>>> Boden Russell wrote:
>>>>
>>>> I would encourage anyone working on neutron-lib related changes to have
>>>> a peek at the recently renovated contributing doc [1] if you haven't
>>>> already.
>>>>
>>>> In particular the 'Phase 4: Consume' section [2] provides some tips on
>>>> how we see this workflow playing out.
>>>>
>>>> Thanks
>>>>
>>>> [1]
>>>> https://github.com/openstack/neutron-lib/blob/master/doc/sou
>>>> rce/contributing.rst
>>>> [2]
>>>> https://github.com/openstack/neutron-lib/blob/master/doc/sou
>>>> rce/contributing.rst#phase-4-consume
>>>>
>>>>
>>>> On 11/23/16 12:39 PM, Armando M. wrote:
>>>>
>>>> Hi neutrinos,
>>>>
>>>> In the last few hours a couple of changes landed [1,2] that caused a bit
>>>> of a jam in the neutron subproject gates, as they overlapped with
>>>> another change [3] having impact on the subprojects.
>>>>
>>>> This is why it is important to communicate during team meetings and/or
>>>> ML that patches with potential impact are in flight in our review
>>>> pipeline, so that we do our best to coordinate the merge process without
>>>> shooting ourselves in the foot.
>>>>
>>>> To bring this back to sanity, I issued a temporary revert [4], so that
>>>> [5] can land undisturbed. After that, a double revert will be applied,
>>>> once subprojects have had the opportunity to deal with the aftermath of
>>>> the other breaking change [1,2] (e.g. [6,7]).
>>>>
>>>>  From now on, I'd strongly encourage people proposing/reviewing patches
>>>> with potential impact (any impact) to err on the side of caution, and
>>>> take the advised steps to ensure such situations don't happen in the
>>>> future.
>>>>
>>>> Thanks,
>>>> Armando
>>>>
>>>> [1] https://review.openstack.org/#/c/397704/
>>>> [2] https://review.openstack.org/#/c/397037/
>>>> [3] https://review.openstack.org/#/c/386845/
>>>> [4] https://review.openstack.org/#/c/401377/
>>>> [5

[openstack-dev] [neutron] oslo liasion

2016-11-22 Thread Armando M.
Hi neutrinos,

I would like to announce Victor Morales, aka electrocucaracha as our oslo
liasion [1].

If you would like to be help in any of the liasion capacities available,
please review [1] and reach out to me.

Cheers,
Armando

[1] https://wiki.openstack.org/wiki/CrossProjectLiaisons#Oslo
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra] [infra][neutron] Intel NFV CI voting permission in Neutron

2016-11-22 Thread Armando M.
On 22 November 2016 at 06:09, Znoinski, Waldemar <
waldemar.znoin...@intel.com> wrote:

>
>
>  >-Original Message-
>  >From: Jeremy Stanley [mailto:fu...@yuggoth.org]
>  >Sent: Monday, November 14, 2016 3:40 PM
>  >To: openstack-in...@lists.openstack.org; openstack-dev@lists.openstack.
> org
>  >Subject: Re: [openstack-dev] [OpenStack-Infra] [infra][neutron] Intel
> NFV CI
>  >voting permission in Neutron
>  >
>  >On 2016-11-14 10:44:42 + (+), Znoinski, Waldemar wrote:
>  >> I would like to acquire voting (+/-1 Verified) permission for our
>  >> Intel NFV CI.
>  >[...]
>  >
>  >The requested permission is configured by addition to
>  >https://review.openstack.org/#/admin/groups/neutron-ci which is
>  >controlled by the members of the
>  >https://review.openstack.org/#/admin/groups/neutron-release group.
>  >The Infra team tries not to be involved in these decisions and instead
> prefers
>  >to leave them up to the project team(s) involved.
> [WZ] thanks for explanation Jeremy, that was my intention - the ask is to
> Neutron(-release) guys, with Infra as FYI
>

done


>
>  >
>  >> This e-mail and any attachments may contain confidential material for
>  >> the sole use of the intended recipient(s). Any review or distribution
>  >> by others is strictly prohibited.
>  >[...]
>  >
>  >This seems wholly inappropriate for a public mailing list. I strongly
>  >recommend not sending messages to our mailing lists in which you strictly
>  >prohibit review or distribution by others, as it is guaranteed to happen
> and
>  >we cannot prevent that (nor would we want to).
> [WZ] requested removal of that footer, thanks
>
>  >--
>  >Jeremy Stanley
>  >
>  >__
>  >
>  >OpenStack Development Mailing List (not for usage questions)
>  >Unsubscribe: OpenStack-dev-
>  >requ...@lists.openstack.org?subject:unsubscribe
>  >http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] Drivers meeting on Nov 24th cancelled

2016-11-22 Thread Armando M.
Happy Thanksgiving!

Armando
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-16 Thread Armando M.
On 16 November 2016 at 10:11, Gary Kotton <gkot...@vmware.com> wrote:

> Hi,
>
> I agree with you on a number of points that you have made below. But you
> are mixing things up. One you state that we should be moving faster and it
> is patches like this that actually hinder us. We are not moving as the core
> team is dwindling down and people are leaving the project. We need to add
> new members to the core team and remove people who are not taking part. We
> are a community and not an autocracy. It is great that you are driving this
> but getting people on board would be helpful. I feel that the cores from
> the subprojects should chime in and review this – at the end of the day it
> affects them too. I have even asked other to base reviews on this code. I
> just think that you need to be aware that there are other people working on
> the project and that they too should be engaged.
>

What's this thread for then if not engaging/inviting people to review? Your
point seems moot.


> Thanks
>
> Gary
>
>
>
> *From: *"Armando M." <arma...@gmail.com>
> *Reply-To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Date: *Wednesday, November 16, 2016 at 6:16 PM
> *To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Subject: *Re: [openstack-dev] [neutron] neutron-lib impact
>
>
>
>
>
>
>
> On 16 November 2016 at 00:55, Gary Kotton <gkot...@vmware.com> wrote:
>
> Hi,
>
> The directory integration will break all of the plugins and neutron
> projects. I do not think that this is something that we should do. It
> breaks the neutron API contract.
>
>
>
> The plugin directory is an implementation internal. Let's be very clear,
> in case you have not realized this already:
>
>
>
> *Neutron is not supposed to be imported directly by projects and we all
> knew it when we started off with the project decomposition.*
>
>
>
> neutron-lib is our response to driving adoption of stable interfaces
> across the neutron ecosystem of repositories. Forcing ourselves to
> introduce artificial deprecation cycles for internal details is not only
> slowing us down but it has proven ineffective so far. We should accelerate
> with the decoupling of projects so that we can all consider these types of
> breakages a thing of the past.
>
>
>
> I think that we should only unblock the patch
> https://review.openstack.org/#/c/386845. I think that due to the fact
> that this patch (very big) will break all plugins, we should only approve
> it once every sub project owner has chimed in.
>
> This will mean that she/he will need to understand that there may be some
> tweaks involved in getting unit tests to pass. CI may automagically work.
>
>
>
> This is impractical and defeats the point of allowing us to go faster. I
> have taken the proactive step of announcing this change publicly and with
> ample notice. I have addressed many subprojects myself and have already
> seen +2/+1 flocking in. I have moved forward without creating busy work for
> myself and the review team.
>
>
>
> I feel that as a core reviewer my responsibility is to make sure that we
> do not break things.
>
>
>
> We are not in a sane situation. It's been two years since we split the
> repo up and very little progress has been made to decouple the projects via
> stable interfaces. I am trying to identify ways to allow us to accelerate
> and you're stifling that effort with your abuse of core rights. I was not
> going to let the patch merge without a final announcement at the next team
> meeting.
>
>
>
> In addition to this we have a responsibility to ensure that things
> continue to work. Hopefully we can find a way to do this in a more friendly
> manner.
>
>
>
> I have taken such a responsibility with [1]. It takes us longer to discuss
> (on something that was already widely agreed on) than either fixing the
> breakage or provide a 'fake' backward compat layer which we'll lead to the
> breakage as soon we take it away [2].
>
>
>
> That said, I am happy to concede if other members of the core team agrees
> with you. As PTL, I have identified a gap that needs to be filled and I am
> proactively stepping up to address the gap. I can't obviously be right all
> the time, but I was under the impression I had the majority of the core
> team on my side.
>
>
>
> At this point, I'd invite other neutron core members to review and vote on
> the patch.
>
>
>
> A.
>
>
>
> [1] https://review.openstack.org/#/q/topic:plugin-directory
> [2]  https://bugs.launchpad.net/vmware-nsx/+bug/1640319
>
>
>
> Thanks
>
> Gary
>
>
>
> *From: *"Armando M.&qu

[openstack-dev] [neutron] neutron-lib impact

2016-11-15 Thread Armando M.
Hi neutrinos,

As mentioned during the last team meeting [1], there is a change [2] in the
works aimed at adopting the neutron plugins directory as provided in
neutron-lib 1.0.0 [3].

As shown in [2], the switch to using the directory is relatively
straightforward. I leave the rest of the affected repos as an exercise for
the reader :)

Cheers,
Armando

[1] http://eavesdrop.openstack.org/meetings/networking/2016/networking.
2016-11-14-21.00.txt
[2] https://review.openstack.org/#/q/topic:plugin-directory
[3] http://docs.openstack.org/releasenotes/neutron-lib/unreleased.html#id3
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] neutron-lib impact

2016-11-16 Thread Armando M.
On 16 November 2016 at 00:55, Gary Kotton <gkot...@vmware.com> wrote:

> Hi,
>
> The directory integration will break all of the plugins and neutron
> projects. I do not think that this is something that we should do. It
> breaks the neutron API contract.
>

The plugin directory is an implementation internal. Let's be very clear, in
case you have not realized this already:

*Neutron is not supposed to be imported directly by projects and we all
knew it when we started off with the project decomposition.*

neutron-lib is our response to driving adoption of stable interfaces across
the neutron ecosystem of repositories. Forcing ourselves to introduce
artificial deprecation cycles for internal details is not only slowing us
down but it has proven ineffective so far. We should accelerate with the
decoupling of projects so that we can all consider these types of breakages
a thing of the past.


> I think that we should only unblock the patch
> https://review.openstack.org/#/c/386845. I think that due to the fact
> that this patch (very big) will break all plugins, we should only approve
> it once every sub project owner has chimed in.
>
This will mean that she/he will need to understand that there may be some
> tweaks involved in getting unit tests to pass. CI may automagically work.
>

This is impractical and defeats the point of allowing us to go faster. I
have taken the proactive step of announcing this change publicly and with
ample notice. I have addressed many subprojects myself and have already
seen +2/+1 flocking in. I have moved forward without creating busy work for
myself and the review team.


> I feel that as a core reviewer my responsibility is to make sure that we
> do not break things.
>

We are not in a sane situation. It's been two years since we split the repo
up and very little progress has been made to decouple the projects via
stable interfaces. I am trying to identify ways to allow us to accelerate
and you're stifling that effort with your abuse of core rights. I was not
going to let the patch merge without a final announcement at the next team
meeting.


> In addition to this we have a responsibility to ensure that things
> continue to work. Hopefully we can find a way to do this in a more friendly
> manner.
>

I have taken such a responsibility with [1]. It takes us longer to discuss
(on something that was already widely agreed on) than either fixing the
breakage or provide a 'fake' backward compat layer which we'll lead to the
breakage as soon we take it away [2].

That said, I am happy to concede if other members of the core team agrees
with you. As PTL, I have identified a gap that needs to be filled and I am
proactively stepping up to address the gap. I can't obviously be right all
the time, but I was under the impression I had the majority of the core
team on my side.

At this point, I'd invite other neutron core members to review and vote on
the patch.

A.

[1] https://review.openstack.org/#/q/topic:plugin-directory
[2]  https://bugs.launchpad.net/vmware-nsx/+bug/1640319


> Thanks
>
> Gary
>
>
>
> *From: *"Armando M." <arma...@gmail.com>
> *Reply-To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Date: *Wednesday, November 16, 2016 at 6:51 AM
> *To: *OpenStack List <openstack-dev@lists.openstack.org>
> *Subject: *[openstack-dev] [neutron] neutron-lib impact
>
>
>
> Hi neutrinos,
>
>
>
> As mentioned during the last team meeting [1], there is a change [2] in
> the works aimed at adopting the neutron plugins directory as provided in
> neutron-lib 1.0.0 [3].
>
>
>
> As shown in [2], the switch to using the directory is relatively
> straightforward. I leave the rest of the affected repos as an exercise for
> the reader :)
>
>
>
> Cheers,
>
> Armando
>
>
>
> [1] http://eavesdrop.openstack.org/meetings/networking/2016/
> networking.2016-11-14-21.00.txt
>
> [2] https://review.openstack.org/#/q/topic:plugin-directory
>
> [3] http://docs.openstack.org/releasenotes/neutron-lib/unreleased.html#id3
>
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] rally failure in the gate

2016-11-17 Thread Armando M.
Hi folks,

Please do not recheck rally failures.

There was a breaking change introduced by aodh [0] that prevented rally to
work on trusty. We are switching to xenial as we speak anyway [1], so the
glitch should be short lived.

Thanks,
Armando

[0] https://review.openstack.org/#/c/372586/
[1] https://review.openstack.org/#/c/398499/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [devstack][neutron] - dropping direct route to VMs (FIXED_RANGE)

2016-11-15 Thread Armando M.
On 15 November 2016 at 15:04, Kevin Benton  wrote:

> Hi all,
>
>
> Right now, we do something in devstack that does not reflect how
> deployments are normally done. We setup a route on the parent host to the
> private tenant network that routes through the tenant's router[1]. This
> behavior originates from a very long time ago[2] and I'm not sure if it
> even works correctly right now (because the tenant router has port address
> translation enabled).
>
> I would like to stop this behavior in devstack for a couple of reasons:
>
> 1. If this works, it works by accident. Neutron doesn't have any
> guarantees of behavior when you are pointing routes to a private network
> via a router that has SNAT enabled.
> 2. This method of accessing the VMs is not how access is gained to VMs in
> normal deployments. If you want a VM to be reachable, either attach to the
> same network with a port, setup a provider network, or assign the VM a
> floating IP.
>
>
> I would like to drop the installation of this route, but I'd like to hear
> if there is anyone relying on this behavior. Reply to this email or comment
> on the patch.[3]
>

Thanks for looking into this. Let me add that this is in relation to bug
[1].

Cheers,
Armando

[1] https://bugs.launchpad.net/devstack/+bug/1629133


>
> 1. https://github.com/openstack-dev/devstack/blob/
> 29d13df1a284f8f1a5973ccc826a475156820d23/lib/neutron_
> plugins/services/l3#L378
> 2. https://review.openstack.org/#/c/13693/
> 3. https://review.openstack.org/397987
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] [vpnaas] vpnaas no longer part of the neutron governance

2016-11-15 Thread Armando M.
Hi

As of today, the project neutron-vpnaas is no longer part of the neutron
governance. This was a decision reached after the project saw a dramatic
drop in active development over a prolonged period of time.

What does this mean in practice?

   - From a visibility point of view, release notes and documentation will
   no longer appear on openstack.org as of Ocata going forward.
   - No more releases will be published by the neutron release team.
   - The neutron team will stop proposing fixes for the upstream CI, if not
   solely on a voluntary basis (e.g. I still felt like proposing [2]).

How does it affect you, the user or the deployer?

   - You can continue to use vpnaas and its CLI via the
   python-neutronclient and expect it to work with neutron up until the newton
   release/python-neutronclient 6.0.0. After this point, if you want a release
   that works for Ocata or newer, you need to proactively request a release
   [5], and reach out to a member of the neutron release team [3] for
   approval. Assuming that the vpnaas CI is green, you can expect to have a
   working vpnaas system upon release of its package in the foreseeable future.
   - Outstanding bugs and new bug reports will be rejected on the basis of
   lack of engineering resources interested in helping out in the typical
   OpenStack review workflow.
   - Since we are freezing the development of the neutron CLI in favor of
   the openstack unified client (OSC), the lack of a plan to make the VPN
   commands available in the OSC CLI means that at some point in the future
   the neutron client CLI support for vpnaas may be dropped (though I don't
   expect this to happen any time soon).

Can this be reversed?

   - If you are interested in reversing this decision, now it is time to
   step up. That said, we won't be reversing the decision for Ocata. There is
   quite a curve to ramp up to make neutron-vpnaas worthy of being classified
   as a neutron stadium project, and that means addressing all the gaps
   identified in [6]. If you are interested, please reach out, and I will work
   with you to add your account to [4], so that you can drive the
   neutron-vpnaas agenda going forward.

Please do not hesitate to reach out to ask questions and/or clarifications.

Cheers,
Armando

[1] https://review.openstack.org/#/c/392010/
[2] https://review.openstack.org/#/c/397924/
[3] https://review.openstack.org/#/admin/groups/150,members
[4] https://review.openstack.org/#/admin/groups/502,members
[5] https://github.com/openstack/releases
[6]
http://specs.openstack.org/openstack/neutron-specs/specs/stadium/ocata/neutron-vpnaas.html
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Summit design summary - a heads up

2016-10-31 Thread Armando M.
Hi folks,

For those of you who missed the summit, I wanted to give a heads up that I
am working with session chairs to provide here a distilled version of any
conclusion/agreement/proposal reached in Barcelona during the Neutron track.

In the meantime, some networking related conference sessions are available
at [1].

Cheers,
Armando

[1] https://www.openstack.org/videos/search?search=networking
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] summit sessions - feedback

2016-11-03 Thread Armando M.
Hi Neutrinos,

You will be noticing a few emails getting into your inbox with subject
 summit recap or similar.

Watch out for those if you're interested in making sense of the discussions
as captured on etherpads [1].

Many thanks to the session chairs for the effort!

Cheers and happy hacking!
Armando

[1] https://wiki.openstack.org/wiki/Design_Summit/Ocata/Etherpads#Neutron
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Centralizing some config options will break many stadium projects

2016-10-28 Thread Armando M.
On 27 October 2016 at 22:18, Brandon Logan 
wrote:

> Hello Neutrinos,
> I've come across an issue that I'd like to get input/opinions on.  I've
> been reviewing some of the centralize config options reviews and have
> come across a few that would cause issues with other projects that are
> importing these options, especially stadium projects.  High level view
> of the issue:
>
> [1] would cause at least 22 projects to need to be fixed based on [2]
>
> [3] would cause at least 12 projects to need to be fixed based on [4]
>
> [5] looks to affect many other projects as well (I'm being lazy and
> not  counting them right now)
>
> Initially, the thinking was that moving the config options around would
> cause some breakage with projects outside of neutron, but that would be
> fine because projects shouldn't really be using neutron as a library
> and using it to register config options.  However, with these 3
> patches, I definitely don't feel comfortable breaking the amount of
> projects these would break.  It also makes me think that maybe these
> options should be in neutron-lib since they're consumed so widely.
> Anyway, I've come up with some possible options to deal with this, but
> would like to hear others' opinions on this:
>
> 1) Let the patches merge and break those projects as a signal that
> importing these shouldn't be done.  The affected projects can choose to
> push fixes that continue importing the neutron config options or
> defining their own config options.
> 2) Deprecate the old locations for some timeframe, and then remove
> later.
> 3) Texas Three-Step: change the neutron patches to keep pointers in the
> old locations to the new, and then push patches to the affected repos
> with Depends-On directives.  Once all patches merge, push up one more
> patch to neutron to remove the old location.
> 4) Abandon these reviews and do nothing.
> 5) Move these config options to neutron-lib so that they can be used by
> any project.  This still requires doing one of the above options,
> however.

6) Any others I can't think of?
>

Slight variation, call it option 6:

1) Identify the most impacted (coupled) project affected by these changes.
2) Fix it in order to provide folks with a recipe for how to address the
breakages.
3) Use the patch and make it needed-by the neutron changes.
4) Evangelize patch 2 one more time on the ML.
5) We'll bring this up at the team meeting, for another form or record.
6) Wait another few days for projects to catch up.
7) Merge the patch in neutron.
8) We all move on.


>
>
> [1] https://review.openstack.org/#/c/343045/
> [2] http://codesearch.openstack.org/?q=from%20neutron.agent.common%20im
> port%20config=nope==
>
> [3] https://review.openstack.org/#/c/340228/
> [4] http://codesearch.openstack.org/?q=neutron.plugins.ml2%20import%20c
> onfig=nope==
>
> [5] https://review.openstack.org/#/c/347867/
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Cloud Provider Security Groups

2016-11-01 Thread Armando M.
On 31 October 2016 at 22:28, David G. Bingham  wrote:

> Yo Neutron devs :-)
>
> I was wondering if something like the following subject has come up:
> "Cloud-provider Security Groups”.
>
> *Goal of this email*: Gauge the community’s need and see if this has come
> up in past.
> *Requirement*: Apply a provider-managed global set of network flows to all
> instances.
> *Use Case*: For our private cloud, have need to dynamically allow network
> traffic flows from other internal network sources across all instances.
> *Basic Idea*: Provide an *admin-only* accessible security group ruleset
> that would persist and apply these "cloud-provider" security group rules to
> all instances of a cloud. This *may* be in the form of new "provider" API
> or an extension to existing API only accessible via "admin". When instances
> are created, this global SG ruleset would be applied to each VM/ironic
> instance. This feature likely should be capable of being enabled/disabled
> depending on the provider's need.
>
> *Real example*: Company security team wants to audit consistent security
> software installations (i.e. HIPS) across our entire fleet of servers for
> compliance reporting. Each vm/ironic instance is required to have this
> software installed and up to date. Security audit team actually audits each
> and every server to ensure it is running, patched and up to date. These
> auditing tools source from a narrow set of internal IPs/ports and each
> instance must allow access to these auditing tools.
>
> --- What we do today to hack a "cloud-provider" flow in a private cloud ---
> 1) We've locked down the default rules (only admins can modify which makes
> effectively kills a lot of canned neutron tools).
> 2) We've written an external script that iterates over all projects in our
> private cloud (~10k projects)
> 3) For each project:
> 3a) Fetch default SGs for that project and do a comparison of its default
> rules against *target* default rules
> 3b) Create any new missing rules, delete any removed rules
> 3c) Next project
> This process is cumbersome, takes 20+ hours to run (over ~10k projects)
> and has to be throttled such that it doesn't over-hammer neutron while its
> still serving production traffic.
>
> --- What we'd like to do in future ---
> 1) Call Security Group API that would modify a "cloud-provider" ruleset.
> 2) When updated, agents on HVs detect the "cloud-provider" change and then
> apply the rules across all instances.
> Naturally there are going to be a lot of technical hurdles to make this
> happen while a cloud is currently in-flight.
>
> Other uses for “Provider SGs":
> * We want to enable new shared features (i.e. monitoring aaS) that all our
> internal projects can take advantage of. When the monitoring team
> adds/modifies IPs to scale, we'd apply these cloud-provider rules on behalf
> of all projects in the private cloud without users having concern
> themselves about the monitoring team's changes.
> * We want to allow access to some internal sites to our VPN users on
> specific ports. These VPN ranges are dynamically changed by the VPN team.
> Our teams should not need to go into individual projects to add a new rule
> when VPN team changes ranges.
> * This list could go on and on and naturally makes much more sense in a
> *private cloud* scenario, but there may be cases for public providers.
>
> I’d be happy to create a spec.
>
> Seen this before? Thoughts? Good, Bad or Ugly? :-)
>

I think this has come up before [1]. The use case is legitimate, but there
is a couple of ways in which this can be accomplished. As pointed out by
others, FWaaS is the solution we suggested to address this particular need.

[1] https://bugs.launchpad.net/neutron/+bug/1592000


>
> Thanks,
> David Bingham (wwriverrat on irc)
> GoDaddy
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Armando M.
On 11 October 2016 at 17:05, Clark Boylan <cboy...@sapwetik.org> wrote:

> On Tue, Oct 11, 2016, at 05:01 PM, Armando M. wrote:
> > On 11 October 2016 at 16:54, Clark Boylan <cboy...@sapwetik.org> wrote:
> >
> > > On Tue, Oct 11, 2016, at 04:51 PM, Armando M. wrote:
> > > > On 11 October 2016 at 16:43, Clark Boylan <cboy...@sapwetik.org>
> wrote:
> > > >
> > > > > On Tue, Oct 11, 2016, at 04:32 PM, Armando M. wrote:
> > > > > > On 11 October 2016 at 14:09, Clark Boylan <cboy...@sapwetik.org>
> > > wrote:
> > > > > >
> > > > > > > Hello everyone,
> > > > > > >
> > > > > > > Currently multinode testing + neutron is broken in clouds that
> use
> > > > > > > portions of 10.0.0.0/8 for their networking due to route
> conflicts
> > > > > with
> > > > > > > devstack + neutron deployments. https://bugs.launchpad.net/bug
> > > > > s/1629133
> > > > > > > is tracking the issue for us. I would like to see this get
> resolved
> > > > > > > properly before we do further work on multinode testing as it
> is
> > > > > > > difficult to review and determine what failures are legit vs
> which
> > > > > > > failures are related to this bug and whether or not a specific
> > > > > multinode
> > > > > > > test has decided to workaround the issue.
> > > > > > >
> > > > > > > The change to use subnet pools in devstack is a non backward
> > > compatible
> > > > > > > change for devstack currently and it doesn't appear to have
> been
> > > > > > > documented in devstack at all. Would be great if we can
> finally fix
> > > > > this
> > > > > > > and get testing back to working and however we fix it ensure
> that
> > > > > > > devstack has the appropriate documentation.
> > > > > > >
> > > > > >
> > > > > > What is holding [1] back? Merging that would resolve the issue,
> then
> > > we
> > > > > > can
> > > > > > drill down into why subnetpools interfere with the underlying
> > > networking
> > > > > > setup. I have asked Carl to look into broken build [2]
> > > > > >
> > > > > > [1] https://review.openstack.org/#/c/379543/
> > > > > > [2]
> > > > > > http://logs.openstack.org/78/381278/2/check/gate-tempest-dsv
> > > > > m-neutron-multinode-full-ubuntu-xenial/7f82862/console.html.gz
> > > > >
> > > > > Yours is one of the two -1's on the change :) I think that devstack
> > > core
> > > > > is probably holding back due to the two -1s there. If we are ok
> with
> > > > > iterating on making it better rather than all in one shot maybe
> that
> > > > > change is good for now and we can update the reviews?
> > > > >
> > > >
> > > > Well, that means the ball is in the contributor's court, who is
> supposed
> > > > to
> > > > address reviewers' concerns :)
> > > >
> > > The comments on the change with -1's are opposed to doing what the
> > > change does. I don't know how I can possibly address them.
> > >
> >
> > Then say so on the review and I am happy to rephrase to make sure I get
> > my
> > message across correctly. If you let the review rot how can you expect it
> > to make progress? That's like Openstack 101
>
> It does say so clearly in the commit itself:
>
> "It turns out that many people have already chosen fixed ranges that
> work for their environments. They have done so to avoid conflicts with
> existing networking ranges and routing. The change to use 10.0.0.0/8 and
> apply routes for this network to neutron interfaces prevents anyone from
> using networks within that range for anything else.
>
> For example imagine you have a cloud provider that provides private IPv4
> addresses allocated out of ranges in 10.0.0.0/8 and they do all public
> networking over ipv6. This change to devstack prevents you from using
> those private networks properly after starting neutron with devstack.
> However, in situations like this FIXED_RANGE should already represent a
> safe range to use so just use it."
>
> The comments both refuse to allow FIX

Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Armando M.
On 11 October 2016 at 16:43, Clark Boylan <cboy...@sapwetik.org> wrote:

> On Tue, Oct 11, 2016, at 04:32 PM, Armando M. wrote:
> > On 11 October 2016 at 14:09, Clark Boylan <cboy...@sapwetik.org> wrote:
> >
> > > Hello everyone,
> > >
> > > Currently multinode testing + neutron is broken in clouds that use
> > > portions of 10.0.0.0/8 for their networking due to route conflicts
> with
> > > devstack + neutron deployments. https://bugs.launchpad.net/bug
> s/1629133
> > > is tracking the issue for us. I would like to see this get resolved
> > > properly before we do further work on multinode testing as it is
> > > difficult to review and determine what failures are legit vs which
> > > failures are related to this bug and whether or not a specific
> multinode
> > > test has decided to workaround the issue.
> > >
> > > The change to use subnet pools in devstack is a non backward compatible
> > > change for devstack currently and it doesn't appear to have been
> > > documented in devstack at all. Would be great if we can finally fix
> this
> > > and get testing back to working and however we fix it ensure that
> > > devstack has the appropriate documentation.
> > >
> >
> > What is holding [1] back? Merging that would resolve the issue, then we
> > can
> > drill down into why subnetpools interfere with the underlying networking
> > setup. I have asked Carl to look into broken build [2]
> >
> > [1] https://review.openstack.org/#/c/379543/
> > [2]
> > http://logs.openstack.org/78/381278/2/check/gate-tempest-dsv
> m-neutron-multinode-full-ubuntu-xenial/7f82862/console.html.gz
>
> Yours is one of the two -1's on the change :) I think that devstack core
> is probably holding back due to the two -1s there. If we are ok with
> iterating on making it better rather than all in one shot maybe that
> change is good for now and we can update the reviews?
>

Well, that means the ball is in the contributor's court, who is supposed to
address reviewers' concerns :)


> Clark
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Armando M.
On 11 October 2016 at 16:54, Clark Boylan <cboy...@sapwetik.org> wrote:

> On Tue, Oct 11, 2016, at 04:51 PM, Armando M. wrote:
> > On 11 October 2016 at 16:43, Clark Boylan <cboy...@sapwetik.org> wrote:
> >
> > > On Tue, Oct 11, 2016, at 04:32 PM, Armando M. wrote:
> > > > On 11 October 2016 at 14:09, Clark Boylan <cboy...@sapwetik.org>
> wrote:
> > > >
> > > > > Hello everyone,
> > > > >
> > > > > Currently multinode testing + neutron is broken in clouds that use
> > > > > portions of 10.0.0.0/8 for their networking due to route conflicts
> > > with
> > > > > devstack + neutron deployments. https://bugs.launchpad.net/bug
> > > s/1629133
> > > > > is tracking the issue for us. I would like to see this get resolved
> > > > > properly before we do further work on multinode testing as it is
> > > > > difficult to review and determine what failures are legit vs which
> > > > > failures are related to this bug and whether or not a specific
> > > multinode
> > > > > test has decided to workaround the issue.
> > > > >
> > > > > The change to use subnet pools in devstack is a non backward
> compatible
> > > > > change for devstack currently and it doesn't appear to have been
> > > > > documented in devstack at all. Would be great if we can finally fix
> > > this
> > > > > and get testing back to working and however we fix it ensure that
> > > > > devstack has the appropriate documentation.
> > > > >
> > > >
> > > > What is holding [1] back? Merging that would resolve the issue, then
> we
> > > > can
> > > > drill down into why subnetpools interfere with the underlying
> networking
> > > > setup. I have asked Carl to look into broken build [2]
> > > >
> > > > [1] https://review.openstack.org/#/c/379543/
> > > > [2]
> > > > http://logs.openstack.org/78/381278/2/check/gate-tempest-dsv
> > > m-neutron-multinode-full-ubuntu-xenial/7f82862/console.html.gz
> > >
> > > Yours is one of the two -1's on the change :) I think that devstack
> core
> > > is probably holding back due to the two -1s there. If we are ok with
> > > iterating on making it better rather than all in one shot maybe that
> > > change is good for now and we can update the reviews?
> > >
> >
> > Well, that means the ball is in the contributor's court, who is supposed
> > to
> > address reviewers' concerns :)
> >
> The comments on the change with -1's are opposed to doing what the
> change does. I don't know how I can possibly address them.
>

Then say so on the review and I am happy to rephrase to make sure I get my
message across correctly. If you let the review rot how can you expect it
to make progress? That's like Openstack 101


>
> Clark
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Design summit schedule

2016-10-11 Thread Armando M.
Neutrinos,

The design summit schedule for Neutron is getting live and into shape at
[1][2].

For questions/suggestions please feel free to reach out.

Cheers,
Armando

[1]
https://www.openstack.org/summit/barcelona-2016/summit-schedule/global-search?t=Neutron%3A
[2] https://wiki.openstack.org/wiki/Design_Summit/Ocata/Etherpads#Neutron
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Armando M.
On 11 October 2016 at 18:20, Sean M. Collins <s...@coreitpro.com> wrote:

> Armando M. wrote:
> > At this point I feel that changing the pool range is even less justified.
> > If I had seen bug [4], I would have been against its fix, because you're
> > absolutely right as the change being not backward compatible.
>
> https://review.openstack.org/#/c/356026 was written by someone on the
> Trove team to
> help them with their CI jobs IIRC.
>
> CC'ing Matthew since he has more context. I went into the Trove channel
> and asked them about reverting 356026. It doesn't seem like an option at
> this point.
>
> http://eavesdrop.openstack.org/irclogs/%23openstack-trove/%
> 23openstack-trove.2016-09-30.log.html#t2016-09-30T17:53:08


A revert with no follow up is clearly not a viable option most of the
times, and we clearly dug ourselves too deep now with [1]. Rather than
making the use of subnet pools conditional as done in [1], IMO we should
have made [2] conditional to preserve the existing provisioning behavior
and let Trove override.

[1] Ic89ceca76afda67da5545111972c3348011f294f
[2] https://review.openstack.org/#/c/356026/


>
>
> --
> Sean M. Collins
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Multinode testing with devstack and neutron broken

2016-10-11 Thread Armando M.
On 11 October 2016 at 14:09, Clark Boylan  wrote:

> Hello everyone,
>
> Currently multinode testing + neutron is broken in clouds that use
> portions of 10.0.0.0/8 for their networking due to route conflicts with
> devstack + neutron deployments. https://bugs.launchpad.net/bugs/1629133
> is tracking the issue for us. I would like to see this get resolved
> properly before we do further work on multinode testing as it is
> difficult to review and determine what failures are legit vs which
> failures are related to this bug and whether or not a specific multinode
> test has decided to workaround the issue.
>
> The change to use subnet pools in devstack is a non backward compatible
> change for devstack currently and it doesn't appear to have been
> documented in devstack at all. Would be great if we can finally fix this
> and get testing back to working and however we fix it ensure that
> devstack has the appropriate documentation.
>

What is holding [1] back? Merging that would resolve the issue, then we can
drill down into why subnetpools interfere with the underlying networking
setup. I have asked Carl to look into broken build [2]

[1] https://review.openstack.org/#/c/379543/
[2]
http://logs.openstack.org/78/381278/2/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial/7f82862/console.html.gz


> Thank you,
> Clark
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Team meeting this Monday at 2100 UTC + forthcoming schedule

2016-10-17 Thread Armando M.
On 17 October 2016 at 11:45, Dariusz Śmigiel <smigiel.dari...@gmail.com>
wrote:

> It means that next Team Meeting will have a place on November 8, Tuesday.
>
> Any cancellations for other Neutron Meetings?
>

I think those should be advertised in emails with their respective subjects.


>
> 2016-10-17 13:28 GMT-05:00 Armando M. <arma...@gmail.com>:
> > Hi neutrinos,
> >
> > A kind reminder for this week's meeting. More on the agenda [1]. Also,
> due
> > to the summit, the next occurrences will be cancelled.
> >
> > - Oct 25, Tuesday
> > - Oct 31, Monday
> >
> > Cheers,
> > Armando
> >
> > [1] https://wiki.openstack.org/wiki/Network/Meetings
> >
> > 
> __
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
> unsubscribe
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> >
>
>
>
> --
> Darek "dasm" Śmigiel
>
> 
> Q: Why is this email five sentences or less?
> A: http://five.sentenc.es
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] broken linuxbridge gate

2016-11-29 Thread Armando M.
Hi folks,

A recent devstack set of changes [0,1] accidentally broke the linuxbridge
job in that bridge_mappings are no longer applied correct. To add insult to
injury, this got applied to both stable and master (with the stable fix
landing first). See [2,3] for a difference.

This is not the first time we accidentally break the job, therefore I would
like to suggest that we add it to the devstack check queue. The job was is
on the experimental queue but it's hardly exercised.

Armando

[0] https://review.openstack.org/#/c/404477/
[1] https://review.openstack.org/#/c/400258/
[2]
http://logs.openstack.org/99/360799/37/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/7a8736b/logs/etc/neutron/plugins/ml2/ml2_conf.ini.txt.gz
[3]
http://logs.openstack.org/13/397913/8/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/3a7c298/logs/etc/neutron/plugins/ml2/ml2_conf.ini.txt.gz
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] broken linuxbridge gate

2016-11-29 Thread Armando M.
On 29 November 2016 at 15:46, Armando M. <arma...@gmail.com> wrote:

> Hi folks,
>
> A recent devstack set of changes [0,1] accidentally broke the linuxbridge
> job in that bridge_mappings are no longer applied correct. To add insult to
> injury, this got applied to both stable and master (with the stable fix
> landing first). See [2,3] for a difference.
>
> This is not the first time we accidentally break the job, therefore I
> would like to suggest that we add it to the devstack check queue. The job
> was is on the experimental queue but it's hardly exercised.
>
> Armando
>
> [0] https://review.openstack.org/#/c/404477/
> [1] https://review.openstack.org/#/c/400258/
> [2] http://logs.openstack.org/99/360799/37/check/gate-tempest-
> dsvm-neutron-linuxbridge-ubuntu-xenial/7a8736b/logs/
> etc/neutron/plugins/ml2/ml2_conf.ini.txt.gz
> [3] http://logs.openstack.org/13/397913/8/gate/gate-tempest-
> dsvm-neutron-linuxbridge-ubuntu-xenial/3a7c298/logs/
> etc/neutron/plugins/ml2/ml2_conf.ini.txt.gz
>


Just to follow up:

I attempted both a revert [1,2] and a possible fix [3,4]. Either way, I
proposed moving the job to the devstack check/gate queue [5].

[1] https://review.openstack.org/#/c/404480/
[2] https://review.openstack.org/#/c/404477/
[3] https://review.openstack.org/#/c/404482/
[4] https://review.openstack.org/#/c/404484/
[5] https://review.openstack.org/#/c/404480/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] trunk api performance and scale measurments

2016-12-10 Thread Armando M.
On 8 December 2016 at 20:55, Armando M. <arma...@gmail.com> wrote:

>
>
> On 5 December 2016 at 07:59, Bence Romsics <bence.roms...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I measured how the new trunk API scales with lots of subports. You can
>> find the results here:
>>
>> https://wiki.openstack.org/wiki/Neutron_Trunk_API_Performance_and_Scaling
>>
>> Hope you find it useful. There are several open ends, let me know if
>> you're interested in following up some of them.
>>
>
> I looked into [1] a little bit as it bothered me :)
>
> Here's my findings:
>
>
>- openstack port list is slower than neutron port-list as it looks
>like the command goes to Nova first [2], which is where the overhead comes
>from.
>- when you have subports the port-list response gets bigger because of
>the bigger response due to the trunk-details extension.
>- However, the bulk of the time is spent in [3], when building the
>payload for a port involved as a parent port. In no other case you will see
>the overhead as in no other case the loop over subports is executed.
>
> The hook should be optimized!
>

Follow up: Kevin and I put together a couple of patches [1,2] to fix and
validate how to speed up the lookup. We'll dig into why sqlalchemy is
acting differently when listing ports with or without filters, but this
should do for now.

Cheers,
Armando

[1] https://review.openstack.org/#/c/409267/
[2] https://review.openstack.org/#/c/408983/


> [1] https://wiki.openstack.org/wiki/Neutron_Trunk_API_Performanc
> e_and_Scaling#surprise_effect_on_filtered_port_listings
> [2] http://paste.openstack.org/show/591882/
> [3] https://github.com/openstack/neutron/blob/master/
> neutron/services/trunk/plugin.py#L42
>
>
>> Cheers,
>> Bence Romsics
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscrib
>> e
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] Proposing Abhishek Raut as neutronclient core

2016-12-13 Thread Armando M.
Hi folks,

Abhishek Raut's recent involvement in OSC and python-neutronclient has
helped moving a few efforts along in the right direction. I would like to
suggest we double down on core firepower for the neutronclient repo
alongside Akihiro [1].

This not only will help speed up our transition to OSC CLI, but also
improve the number of folks who can effectively liasion with the OSC team,
and look after the needs of neutron's client repo.

Many thanks,
Armando

[1] https://review.openstack.org/#/c/410485/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] drivers meeting cancellation today

2016-12-15 Thread Armando M.
Hi folks,

Due to conflicts, we are unable to host the drivers meeting today.

Apologies for the short notice.

Thanks,
Armando
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Proposing Abhishek Raut as neutronclient core

2016-12-15 Thread Armando M.
On 15 December 2016 at 09:50, Akihiro Motoki <amot...@gmail.com> wrote:

> +1
>

Welcome to the team Abhishek!


>
> 2016-12-14 10:22 GMT+09:00 Armando M. <arma...@gmail.com>:
>
>> Hi folks,
>>
>> Abhishek Raut's recent involvement in OSC and python-neutronclient has
>> helped moving a few efforts along in the right direction. I would like to
>> suggest we double down on core firepower for the neutronclient repo
>> alongside Akihiro [1].
>>
>> This not only will help speed up our transition to OSC CLI, but also
>> improve the number of folks who can effectively liasion with the OSC team,
>> and look after the needs of neutron's client repo.
>>
>> Many thanks,
>> Armando
>>
>> [1] https://review.openstack.org/#/c/410485/
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscrib
>> e
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] multinode CI jobs in the gate

2016-12-15 Thread Armando M.
Hi Neutrinos,

Infra patch proposed in [1] got me thinking again about what we shall do
when it comes to multinode testing in the gate and how to focus our testing
and CI efforts upstream going forward. My line of thinking has always been
that multinode resources should be devoted to configurations whose coverage
fully benefit from the inherent nature of the distributed deployment, and
that means giving priority to DVR+HA and demote other configurations that
use centralized routing.

I know that some of you in team have worked on this, but I am a bit behind
on the latest status update. Any good soul willing to bring a strapped (for
time) PTL up to speed?

Cheers,
Armando

[1] https://review.openstack.org/#/c/411263/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [architecture][api][Nova][Neutron][Cinder] nova-compute's architecture/API

2016-12-15 Thread Armando M.
On 16 December 2016 at 00:01, Clint Byrum  wrote:

> So, I've been quietly ranting in hallways about this for a while. I may
> be way way off base here. I want to kick the discussion off, so I've
> submitted a proposal to the arch-wg about it. Please if you're interested
> in how Nova/Neutron/Cinder interact with nova-compute, I think it might
> be worthwhile to read it and get it into a factual state, so the arch-wg
> can do a deeper analysis. Please do rip it to shreds in comments, and
> feel free to revise it and add more details. Thanks very much!
>
> https://review.openstack.org/411527
>
>
Noted! I'll bring this up at the next team meeting. Thanks for spearheading
this!


Cheers,
Armando

__
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] proposing Ryan Tidwell and Nate Johnston as service LTs

2016-12-15 Thread Armando M.
 Hi neutrinos,

I would like to propose Ryan and Nate as the go-to fellows for
service-related patches.

Both are core in their repos of focus, namely neutron-dynamic-routing and
neutron-fwaas, and have a good understanding of the service framework, the
agent framework and other bits and pieces. At this point, entrusting them
with the responsibility is almost a formality.

Cheers,
Armando

[1] https://review.openstack.org/#/c/411536/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] proposing Miguel Lavalle as neutron core and Brian Haley as L3 Lt

2016-12-15 Thread Armando M.
Hi neutrinos,

Miguel Lavalle has been driving the project forward consistently and
reliably. I would like to propose him to be entrusted with +2/+A rights in
the areas he's been most prolific, which are L3 and DHCP.

At the same time, I'd like to propose Brian Haley as our next Chief L3
Officer. Both of them have worked with Carl Baldwin extensively and that
can only be a guarantee of quality.

Cheers,
Armando

[1] https://review.openstack.org/#/c/411531/
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Vlan aware VMs or trunking

2016-12-06 Thread Armando M.
On 6 December 2016 at 08:49, Vasyl Saienko  wrote:

> Hello Neutron Community,
>
>
> I've found that nice feature vlan-aware-vms was implemented in Newton [0].
> However the usage of this feature for regular users is impossible, unless
> I'm missing something.
>
> As I understood correctly it should work in the following way:
>
>1. It is possible to group neutron ports to trunks.
>2. When trunk is created parent port should be defined:
>Only one port can be parent.
>segmentation of parent port is set as native or untagged vlan on the
>trunk.
>3. Other ports may be added as subports to existing trunk.
>When subport is added to trunk *segmentation_type* and *segmentation_id
>*should be specified.
>segmentation_id of subport is set as allowed vlan on the trunk
>
> Non-admin user do not know anything about *segmentation_type* and
> *segmentation_id.*
>

Segmentation type and ID are used to multiplex/demultiplex traffic in/out
of the guest associated to a particular trunk. Aside the fact that the only
supported type is VLAN at the moment (if ever), the IDs are user provided
to uniquely identify the traffic coming in/out of the trunked networks so
that it can reach the appropriate vlan interface within the guest. The
documentation [1] is still in flight, but it clarifies this point.

HTH
Armando

[1] https://review.openstack.org/#/c/361776


> So it is strange that those fields are mandatory when subport is added to
> trunk. Furthermore they may conflict with port's network segmentation_id
> and type. Why we can't inherit segmentation_type and segmentation_id from
> network settings of subport?
>
> References:
> [0] https://blueprints.launchpad.net/neutron/+spec/vlan-aware-vms
> [1] https://review.openstack.org/#/c/361776/15/doc/networking-gu
> ide/source/config-trunking.rst
> [2] https://etherpad.openstack.org/p/trunk-api-dump-newton
>
> Thanks in advance,
> Vasyl Saienko
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] broken rally gate

2016-12-08 Thread Armando M.
On 8 December 2016 at 16:40, Armando M. <arma...@gmail.com> wrote:

> Hi folks
>
> Chasing down why [1] accidentally broke rally. Please do not recheck, and
> the failure is persistent.
>
> Thanks,
> Armando
>
> [1] https://review.openstack.org/#/c/408020
>

https://review.openstack.org/#/c/408870/ should bring sanity back into the
world.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] broken rally gate

2016-12-08 Thread Armando M.
Hi folks

Chasing down why [1] accidentally broke rally. Please do not recheck, and
the failure is persistent.

Thanks,
Armando

[1] https://review.openstack.org/#/c/408020
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] trunk api performance and scale measurments

2016-12-08 Thread Armando M.
On 5 December 2016 at 07:59, Bence Romsics  wrote:

> Hi,
>
> I measured how the new trunk API scales with lots of subports. You can
> find the results here:
>
> https://wiki.openstack.org/wiki/Neutron_Trunk_API_Performance_and_Scaling
>
> Hope you find it useful. There are several open ends, let me know if
> you're interested in following up some of them.
>

I looked into [1] a little bit as it bothered me :)

Here's my findings:


   - openstack port list is slower than neutron port-list as it looks like
   the command goes to Nova first [2], which is where the overhead comes from.
   - when you have subports the port-list response gets bigger because of
   the bigger response due to the trunk-details extension.
   - However, the bulk of the time is spent in [3], when building the
   payload for a port involved as a parent port. In no other case you will see
   the overhead as in no other case the loop over subports is executed.

The hook should be optimized!

Cheers,
Armando

[1] https://wiki.openstack.org/wiki/Neutron_Trunk_API_
Performance_and_Scaling#surprise_effect_on_filtered_port_listings
[2] http://paste.openstack.org/show/591882/
[3]
https://github.com/openstack/neutron/blob/master/neutron/services/trunk/plugin.py#L42


> Cheers,
> Bence Romsics
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] networking-sfc stable/newton branch broken

2017-01-11 Thread Armando M.
Hi,

Please have a look at [1]. The branch has been broken for some time now.

Thanks,
Armando

[1]
https://review.openstack.org/#/q/status:open+project:openstack/networking-sfc+branch:stable/newton
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Confusion around the complexity

2017-01-13 Thread Armando M.
On 13 January 2017 at 10:47, Clint Byrum  wrote:

> Excerpts from Joshua Harlow's message of 2017-01-12 22:38:46 -0800:
> > Kevin Benton wrote:
> > > If you don't want users to specify network details, then use the get me
> > > a network extension or just have them boot to a public (or other
> > > pre-created) network.
> > >
> > > In your thought experiment, why is your iPhone app developer not just
> > > using a PaaS that handles instance scaling, load balancing and HA? Why
> > > would he/she want to spend time managing security updates and log
> > > rotation for an operating system running inside another program
> > > pretending to be hardware? Different levels of abstraction solve
> > > different use cases.
> >
> > Fair point, probably mr/mrs iPhone app developer should be doing that.
> >
>
> I totally disagree. If PaaS was the answer, they'd all be using PaaS.
>
> Maybe some day, but that's no excuse for having an overly complex story
> for the base. I totally appreciate that "Get me a network" is an effort
> to address this. But after reading docs on it, I actually have no idea
> how it works or how to make use of it (I do have a decent understanding
> of how to setup a default subnetpool as an operator).
>

I'd be happy to improve the docs, but your feedback is not very actionable.
Any chance you can elaborate on what you're struggling with?

Thanks,
Armando


>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Confusion around the complexity

2017-01-13 Thread Armando M.
On 13 January 2017 at 15:01, Clint Byrum <cl...@fewbar.com> wrote:

> Excerpts from Armando M.'s message of 2017-01-13 11:39:33 -0800:
> > On 13 January 2017 at 10:47, Clint Byrum <cl...@fewbar.com> wrote:
> >
> > > Excerpts from Joshua Harlow's message of 2017-01-12 22:38:46 -0800:
> > > > Kevin Benton wrote:
> > > > > If you don't want users to specify network details, then use the
> get me
> > > > > a network extension or just have them boot to a public (or other
> > > > > pre-created) network.
> > > > >
> > > > > In your thought experiment, why is your iPhone app developer not
> just
> > > > > using a PaaS that handles instance scaling, load balancing and HA?
> Why
> > > > > would he/she want to spend time managing security updates and log
> > > > > rotation for an operating system running inside another program
> > > > > pretending to be hardware? Different levels of abstraction solve
> > > > > different use cases.
> > > >
> > > > Fair point, probably mr/mrs iPhone app developer should be doing
> that.
> > > >
> > >
> > > I totally disagree. If PaaS was the answer, they'd all be using PaaS.
> > >
> > > Maybe some day, but that's no excuse for having an overly complex story
> > > for the base. I totally appreciate that "Get me a network" is an effort
> > > to address this. But after reading docs on it, I actually have no idea
> > > how it works or how to make use of it (I do have a decent understanding
> > > of how to setup a default subnetpool as an operator).
> > >
> >
> > I'd be happy to improve the docs, but your feedback is not very
> actionable.
> > Any chance you can elaborate on what you're struggling with?
> >
>
> The docs I found are all extremely Neutron-centric. I was told later
> on IRC that once the default subnet pool is setup, Nova would do some
> magic to tell neutron to allocate a subnet from that pool to the user
> when they create an instance.


> Basically, the docs I found were not at all user-centric. They were
> Neutron-centric and they didn't really explain why, as an operator, I'd
> want to allocate a subnet pool. I mean, they do, but because I don't
> really know if I have that problem or what it is, I just wasn't able
> to grasp where this was going. It tells me to go ahead and list default
> subnet pools, and then pass --nic=net-id=$ID from that. Super confusing
> and not really any more friendly than before.
>
>
If you are referring to [1], I wouldn't expect anything less, it's the
OpenStack networking guide after all.


> So what I want is the story from the user's perspective. Something like:
>
> "Without this extension, your users will need to do these steps in order
> to boot servers with networking:..."
>
> and then
>
> "With this extension, your users will not need to perform those steps,
> and the default subnet pools that you setup will be automatically
> allocated to users upon their first server boot."
>

Problem statement from the user's point of view is typically left to the
specs [2,3].
I am sure one can argue that the content there may not be well written or
organized, but it was enough for getting the nova and the neutron team to
have a mutual understanding and agreement on how to design, implement and
test the feature.

>From what I hear, there is a gap in the networking guide in that the
rationale behind the feature is missing. I suppose we can fill that up, and
thus I filed [4].

Thanks.

[1]
http://docs.openstack.org/newton/networking-guide/config-auto-allocation.html
[2]
http://specs.openstack.org/openstack/neutron-specs/specs/mitaka/get-me-a-network.html
[3]
http://specs.openstack.org/openstack/nova-specs/specs/newton/implemented/get-me-a-network.html
[4] https://bugs.launchpad.net/openstack-manuals/+bug/1656447


> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Confusion around the complexity

2017-01-12 Thread Armando M.
On 12 January 2017 at 14:46, Joshua Harlow  wrote:

> So I don't want to start to much of a flame-war and am really just trying
> to understand things that may be beyond me (so treat me nicely, ha).
>
> The basic question that I've been wondering revolves around the following
> kind of 'thought experiment' that asks something along the lines of:
>
> """
> If I am a user of openstack, say I'm an iphone developer, trying to get my
> 'game' and associated 'game APIs' setup in a manner that is HA (say fronted
> by a load-balancer), using my custom image, secure and visible to either an
> intranet or to the large internet then what is the steps I would have to do
> when interacting with openstack to accomplish this and what would the
> provider of openstack have to give to me as endpoints to make this possible.
> """
>
> One of the obvious ones is nova and glance, and the API and usage there
> feels pretty straightforward as is (isn't really relevant to this
> conversation anyway). The one that feels bulky and confusing (at least for
> me) is the things I'd have to do in neutron to create and/or select
> networks, create and/or select subnets, create and/or select ports and
> so-on...


> As a supposed iphone developer (dev/ops, yadayada) just trying to get
> his/her game to market why would I really want to know about selecting
> networks, create and/or selecting subnets, create and/or selecting ports
> and so-on...
>
> It may just be how it is, but I'd like to at least ask if others are
> really happy with the interactions/steps (I guess we could/maybe we should
> ask similar questions around various other projects as well?); if I'm just
> an outlier that's ok, at least I asked :-P
>

Answering your question in a nutshell is very hard, but I'll try
nonetheless.

I bet that if you think really hard, complications may arise even when
dealing with images and compute resources. That's because, in the most
trivial cases you are not thinking about the services that your image must
provide (and if so you may start injecting user-data into your boot phase)
or performance requirements you may have (and if so, you may want your
hypervisors to provide certain optimizations).

IMO, the networking case is inherently complex because the network
architecture required by a non trivial application is itself complex, in
that you may need tiers of security, you need to HA, etc. In the most
trivial case where you just want a single endpoint to which you can talk
to, there's get-me-a-network [1,2]. You can fire boot a VM on of top of a
auto-provisioned network topology and off you go. To get external access
you're only left with a floating IP association, but that's only one API
call away.

Cheers,
Armando

[1]
https://specs.openstack.org/openstack/neutron-specs/specs/liberty/get-me-a-network.html
[2]
http://docs.openstack.org/newton/networking-guide/config-auto-allocation.html


>
> -Josh
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Confusion around the complexity

2017-01-12 Thread Armando M.
On 12 January 2017 at 15:07, Armando M. <arma...@gmail.com> wrote:

>
>
> On 12 January 2017 at 14:46, Joshua Harlow <harlo...@fastmail.com> wrote:
>
>> So I don't want to start to much of a flame-war and am really just trying
>> to understand things that may be beyond me (so treat me nicely, ha).
>>
>> The basic question that I've been wondering revolves around the following
>> kind of 'thought experiment' that asks something along the lines of:
>>
>> """
>> If I am a user of openstack, say I'm an iphone developer, trying to get
>> my 'game' and associated 'game APIs' setup in a manner that is HA (say
>> fronted by a load-balancer), using my custom image, secure and visible to
>> either an intranet or to the large internet then what is the steps I would
>> have to do when interacting with openstack to accomplish this and what
>> would the provider of openstack have to give to me as endpoints to make
>> this possible.
>> """
>>
>> One of the obvious ones is nova and glance, and the API and usage there
>> feels pretty straightforward as is (isn't really relevant to this
>> conversation anyway). The one that feels bulky and confusing (at least for
>> me) is the things I'd have to do in neutron to create and/or select
>> networks, create and/or select subnets, create and/or select ports and
>> so-on...
>
>
>> As a supposed iphone developer (dev/ops, yadayada) just trying to get
>> his/her game to market why would I really want to know about selecting
>> networks, create and/or selecting subnets, create and/or selecting ports
>> and so-on...
>>
>> It may just be how it is, but I'd like to at least ask if others are
>> really happy with the interactions/steps (I guess we could/maybe we should
>> ask similar questions around various other projects as well?); if I'm just
>> an outlier that's ok, at least I asked :-P
>>
>
> Answering your question in a nutshell is very hard, but I'll try
> nonetheless.
>
> I bet that if you think really hard, complications may arise even when
> dealing with images and compute resources. That's because, in the most
> trivial cases you are not thinking about the services that your image must
> provide (and if so you may start injecting user-data into your boot phase)
> or performance requirements you may have (and if so, you may want your
> hypervisors to provide certain optimizations).
>
> IMO, the networking case is inherently complex because the network
> architecture required by a non trivial application is itself complex, in
> that you may need tiers of security, you need to HA, etc. In the most
> trivial case where you just want a single endpoint to which you can talk
> to, there's get-me-a-network [1,2]. You can fire boot a VM on of top of a
> auto-provisioned network topology and off you go. To get external access
> you're only left with a floating IP association, but that's only one API
> call away.
>
> Cheers,
> Armando
>
> [1] https://specs.openstack.org/openstack/neutron-specs/specs/
> liberty/get-me-a-network.html
> [2] http://docs.openstack.org/newton/networking-guide/
> config-auto-allocation.html
>

Forgot to add the nova-side of the spec:

http://specs.openstack.org/openstack/nova-specs/specs/newton/implemented/get-me-a-network.html


>
>
>
>>
>> -Josh
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscrib
>> e
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] Neutron Pike PTG

2017-01-12 Thread Armando M.
Hi neutrinos,

The time for the PTG is approaching and if you are wondering about topics
and various agenda arrangements, you should consider the PTG more like a
mid-cycle on steroids: each project will be working on its own agenda,
usually via etherpads, and publish updates over the ML, up until and during
the week of the PTG.

Therefore, do not expect any published agenda, beyond a daily map of where
teams will be gathering in which rooms. We also need to work out on how to
arrange cross-projects conversations. Please expect to learn more from the
team organizers.

For now, please start collecting ideas on [2]. Once we got critical mass on
[2], I'll work with the drivers team to finalize and sanitize a more formal
agenda, which will then be published on a new etherpad (TBD). For those who
cannot participate in person to the event, we will provide a mid-cycle
report.

Cheers,
Armando

[1] https://www.openstack.org/ptg/
[2] https://etherpad.openstack.org/p/neutron-ptg-pike
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


<    1   2   3   4   5   6   7   >