Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[fumihiko kakuma]

Hi Ryan,

I was trying to add a scenario test for neutron-dynamic-routing
since I have a conversation with Vikram about scenario test.
And I pushed patches to gerrit as I have finished almost making it.

Please check it.

https://review.openstack.org/#/c/407779/

Thank you
kakuma


On Tue, 6 Dec 2016 22:44:18 +
"Tidwell, Ryan" <ryan.tidw...@hpe.com> wrote:

> This is at the top of my list to look at. I've been thinking a lot about how 
> to implement some tests. For instance, do we need to actually stand up a BGP 
> peer of some sort to peer neutron with and assert the announcements somehow? 
> Or should we assume that Ryu works properly and make sure we have solid 
> coverage of the driver interface somehow. I'm open to suggestions as to how 
> to approach this.
> 
> -Ryan
> 
> -Original Message-
> From: Assaf Muller [mailto:as...@redhat.com] 
> Sent: Tuesday, December 06, 2016 2:36 PM
> To: OpenStack Development Mailing List (not for usage questions) 
> <openstack-dev@lists.openstack.org>
> Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario 
> testing?
> 
> Hi all,
> 
> General query - Is there anyone in the Dynamic Routing community that is 
> planning on contributing a scenario test? As far as I could tell, none of the 
> current API tests would fail if, for example, the BGP agent was not running. 
> Please correct me if I'm wrong.
> 
> Thank you.
> 
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
fumihiko kakuma <kak...@valinux.co.jp>


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Tidwell, Ryan]

I just saw this review [1] come in this afternoon. I'm starting to review and 
digest it, but it looks pretty slick. It looks like Ryu may have some test 
helpers that stand up Quagga in a container and allow you to interact with it 
natively in python. This gives us a clean way to set up a BGP peer that we can 
run assertions against to ensure neutron announces the correct routes. I see 
what looks like some decent scenario tests here. So it looks like we do have 
work in flight to address some test gaps in neutron-dynamic-routing.


-Ryan


[1] https://review.openstack.org/#/c/407779


From: Tidwell, Ryan
Sent: Tuesday, December 6, 2016 3:13:17 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario 
testing?

Thanks for the pointer. I'll take a look and see what can be leveraged.

-Ryan


_
From: Armando M. <arma...@gmail.com<mailto:arma...@gmail.com>>
Sent: Tuesday, December 6, 2016 2:57 PM
Subject: Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario 
testing?
To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>




On 6 December 2016 at 14:44, Tidwell, Ryan 
<ryan.tidw...@hpe.com<mailto:ryan.tidw...@hpe.com>> wrote:
This is at the top of my list to look at. I've been thinking a lot about how to 
implement some tests. For instance, do we need to actually stand up a BGP peer 
of some sort to peer neutron with and assert the announcements somehow? Or 
should we assume that Ryu works properly and make sure we have solid coverage 
of the driver interface somehow. I'm open to suggestions as to how to approach 
this.

Thomas Morin et al have had a few ideas and put together [1]. There are some 
similarities between the efforts. Something worth mulling over on.

Cheers,
Armando

[1] https://review.openstack.org/#/c/396967/


-Ryan

-Original Message-
From: Assaf Muller [mailto:as...@redhat.com<mailto:as...@redhat.com>]
Sent: Tuesday, December 06, 2016 2:36 PM
To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

Hi all,

General query - Is there anyone in the Dynamic Routing community that is 
planning on contributing a scenario test? As far as I could tell, none of the 
current API tests would fail if, for example, the BGP agent was not running. 
Please correct me if I'm wrong.

Thank you.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Assaf Muller]

On Tue, Dec 6, 2016 at 5:44 PM, Tidwell, Ryan <ryan.tidw...@hpe.com> wrote:
> This is at the top of my list to look at.

Thanks Ryan that's good to know. I think that gating on some tests
that demonstrates that the project works end to end is a signal of
maturity and will help adoption.

> I've been thinking a lot about how to implement some tests. For instance, do 
> we need to actually stand up a BGP peer of some sort to peer neutron with and 
> assert the announcements somehow? Or should we assume that Ryu works properly 
> and make sure we have solid coverage of the driver interface somehow. I'm 
> open to suggestions as to how to approach this.
>
> -Ryan
>
> -Original Message-
> From: Assaf Muller [mailto:as...@redhat.com]
> Sent: Tuesday, December 06, 2016 2:36 PM
> To: OpenStack Development Mailing List (not for usage questions) 
> <openstack-dev@lists.openstack.org>
> Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario 
> testing?
>
> Hi all,
>
> General query - Is there anyone in the Dynamic Routing community that is 
> planning on contributing a scenario test? As far as I could tell, none of the 
> current API tests would fail if, for example, the BGP agent was not running. 
> Please correct me if I'm wrong.
>
> Thank you.
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Tidwell, Ryan]

Thanks for the pointer. I'll take a look and see what can be leveraged.

-Ryan


_
From: Armando M. <arma...@gmail.com<mailto:arma...@gmail.com>>
Sent: Tuesday, December 6, 2016 2:57 PM
Subject: Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario 
testing?
To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>




On 6 December 2016 at 14:44, Tidwell, Ryan 
<ryan.tidw...@hpe.com<mailto:ryan.tidw...@hpe.com>> wrote:
This is at the top of my list to look at. I've been thinking a lot about how to 
implement some tests. For instance, do we need to actually stand up a BGP peer 
of some sort to peer neutron with and assert the announcements somehow? Or 
should we assume that Ryu works properly and make sure we have solid coverage 
of the driver interface somehow. I'm open to suggestions as to how to approach 
this.

Thomas Morin et al have had a few ideas and put together [1]. There are some 
similarities between the efforts. Something worth mulling over on.

Cheers,
Armando

[1] https://review.openstack.org/#/c/396967/


-Ryan

-Original Message-
From: Assaf Muller [mailto:as...@redhat.com<mailto:as...@redhat.com>]
Sent: Tuesday, December 06, 2016 2:36 PM
To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

Hi all,

General query - Is there anyone in the Dynamic Routing community that is 
planning on contributing a scenario test? As far as I could tell, none of the 
current API tests would fail if, for example, the BGP agent was not running. 
Please correct me if I'm wrong.

Thank you.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Armando M.]

On 6 December 2016 at 14:44, Tidwell, Ryan <ryan.tidw...@hpe.com> wrote:

> This is at the top of my list to look at. I've been thinking a lot about
> how to implement some tests. For instance, do we need to actually stand up
> a BGP peer of some sort to peer neutron with and assert the announcements
> somehow? Or should we assume that Ryu works properly and make sure we have
> solid coverage of the driver interface somehow. I'm open to suggestions as
> to how to approach this.
>

Thomas Morin et al have had a few ideas and put together [1]. There are
some similarities between the efforts. Something worth mulling over on.

Cheers,
Armando

[1] https://review.openstack.org/#/c/396967/


>
> -Ryan
>
> -Original Message-
> From: Assaf Muller [mailto:as...@redhat.com]
> Sent: Tuesday, December 06, 2016 2:36 PM
> To: OpenStack Development Mailing List (not for usage questions) <
> openstack-dev@lists.openstack.org>
> Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario
> testing?
>
> Hi all,
>
> General query - Is there anyone in the Dynamic Routing community that is
> planning on contributing a scenario test? As far as I could tell, none of
> the current API tests would fail if, for example, the BGP agent was not
> running. Please correct me if I'm wrong.
>
> Thank you.
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Tidwell, Ryan]

This is at the top of my list to look at. I've been thinking a lot about how to 
implement some tests. For instance, do we need to actually stand up a BGP peer 
of some sort to peer neutron with and assert the announcements somehow? Or 
should we assume that Ryu works properly and make sure we have solid coverage 
of the driver interface somehow. I'm open to suggestions as to how to approach 
this.

-Ryan

-Original Message-
From: Assaf Muller [mailto:as...@redhat.com] 
Sent: Tuesday, December 06, 2016 2:36 PM
To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org>
Subject: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

Hi all,

General query - Is there anyone in the Dynamic Routing community that is 
planning on contributing a scenario test? As far as I could tell, none of the 
current API tests would fail if, for example, the BGP agent was not running. 
Please correct me if I'm wrong.

Thank you.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Armando M.]

On 6 December 2016 at 14:36, Assaf Muller  wrote:

> Hi all,
>
> General query - Is there anyone in the Dynamic Routing community that
> is planning on contributing a scenario test? As far as I could tell,
> none of the current API tests would fail if, for example, the BGP
> agent was not running. Please correct me if I'm wrong.
>

You are correct, I am working with Ryan to figure this gap out as
identified in [1]

[1] https://review.openstack.org/#/c/389397/15/specs/stadium/ocata.rst@105


>
> Thank you.
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Neutron][Dynamic Routing] Plans for scenario testing?

[Assaf Muller]

Hi all,

General query - Is there anyone in the Dynamic Routing community that
is planning on contributing a scenario test? As far as I could tell,
none of the current API tests would fail if, for example, the BGP
agent was not running. Please correct me if I'm wrong.

Thank you.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev