Hi,

The Nokia lab architecture is on 
https://wiki.opnfv.org/display/pharos/Nokia+Hosting.

You can run TRex on the jump host unless you want to do some custom 
installation. The NICs are standard Intel 82599's aka Niantics, so dpdk should 
just work.

I do not know how TRex works but I have had some difficulties with Moongen with 
the ToR switches. Moongen uses timing packets and these do not go cleanly 
through the ToRs, but everything works with a direct connection. Let me know if 
you need something unusual.

-Tapio

________________________________________
From: Alec Hothan (ahothan) <ahot...@cisco.com>
Sent: Thursday, March 29, 2018 12:25:00 AM
To: Yuyang (Gabriel); 'Fatih Degirmenci'; 'cedric.olliv...@orange.com'; 
Tallgren, Tapio (Nokia - FI/Espoo); 'Tim Irnich'; 'BLAISONNEAU David IMT/OLN'; 
'sridhar....@spirent.com'; 'ross.b.bratt...@intel.com'; 'mark.bei...@emc.com'; 
'Jose Lausuch'; 'Georg Kunz'
Cc: 'trevor.coo...@intel.com'; Kosonen, Juha (Nokia - FI/Espoo); 
'acmor...@att.com'; Wangwulin (Linda); 'rp...@linuxfoundation.org'; 
'opnfv-tech-discuss@lists.opnfv.org'; 'test...@lists.opnfv.org'
Subject: Re: LDT breakout session summary //Re: ONS Discussion //RE: NFVbench 
requirements //RE: check xci pike tags //RE: Update on long duration test


Just want to add the ETA for getting bare metal installation automated by 
script would have to be before this summer – which is not that far away (3 
months).
To avoid any last minute surprise and further delay, it would be great if Tapio 
could identify which jump host to use to run Trex and whether/when it will have 
the proper NIC by then. Also note that we should be able to verify the proper 
connectivity from TRex to the TOR and back without requiring a bare metal 
openstack installation.
Once we get Trex operational, we will be able to run any test that relies on 
Trex.

Thanks

   Alec



From: "Yuyang (Gabriel)" <gabriel.yuy...@huawei.com>
Date: Tuesday, March 27, 2018 at 7:07 PM
To: "Alec Hothan (ahothan)" <ahot...@cisco.com>, 'Fatih Degirmenci' 
<fatih.degirme...@ericsson.com>, "'cedric.olliv...@orange.com'" 
<cedric.olliv...@orange.com>, "'Tallgren, Tapio (Nokia - FI/Espoo)'" 
<tapio.tallg...@nokia.com>, 'Tim Irnich' <tim.irn...@ericsson.com>, 
'BLAISONNEAU David IMT/OLN' <david.blaisonn...@orange.com>, 
"'sridhar....@spirent.com'" <sridhar....@spirent.com>, 
"'ross.b.bratt...@intel.com'" <ross.b.bratt...@intel.com>, 
"'mark.bei...@emc.com'" <mark.bei...@emc.com>, 'Jose Lausuch' 
<jalaus...@suse.com>, 'Georg Kunz' <georg.k...@ericsson.com>
Cc: "'trevor.coo...@intel.com'" <trevor.coo...@intel.com>, "'Kosonen, Juha 
(Nokia - FI/Espoo)'" <juha.koso...@nokia.com>, "'acmor...@att.com'" 
<acmor...@att.com>, "Wangwulin (Linda)" <wangwu...@huawei.com>, 
"'rp...@linuxfoundation.org'" <rp...@linuxfoundation.org>, 
"'opnfv-tech-discuss@lists.opnfv.org'" <opnfv-tech-discuss@lists.opnfv.org>, 
"'test...@lists.opnfv.org'" <test...@lists.opnfv.org>
Subject: LDT breakout session summary //Re: ONS Discussion //RE: NFVbench 
requirements //RE: check xci pike tags //RE: Update on long duration test

Hi,

It is really nice to have us gather around and to move things forward!
I have made a brief summary of our discussion today. Please find it below and 
comment if there is anything missing or misleading, thanks!

Brief summary LDT breakout discussion

1.         SUT deployment

a)         We should have a transition solution for SUT deployment, so that 
test projects could adapt their test cases

                                                 i.              Currently, 
deploy xci-virtual first on another POD

                                               ii.              It could be 
triggered through jenkin

                                             iii.              Gabriel send the 
name list to Fatih to gain access of the deployment

b)        It would best to have a script for deploy xci baremetal, so that we 
can manually do deployment on Nokia POD

2.         LDT CI requirements and set-up

a)         For transition solution, we only support job triggering

b)        For all the Jenkins requirements, Fatih will come with a solution 
later

3.         Hardware configurations for Traffic generator

a)         NFVbench need bare metal deployment

b)        Need to confirm with Tapio about the support for traffic generators

For yesterday’s presentation, please refer to 
https://wiki.opnfv.org/display/testing/Long+Duration+Testing.

Thanks,
Gabriel

发件人: Yuyang (Gabriel)
发送时间: 2018年3月16日 10:07
收件人: Alec Hothan (ahothan) <ahot...@cisco.com>; Fatih Degirmenci 
<fatih.degirme...@ericsson.com>; cedric.olliv...@orange.com; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com>; Tim Irnich 
<tim.irn...@ericsson.com>; BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com>; sridhar....@spirent.com; 
ross.b.bratt...@intel.com; mark.bei...@emc.com; Jose Lausuch 
<jalaus...@suse.com>; Georg Kunz <georg.k...@ericsson.com>
抄送: trevor.coo...@intel.com; Kosonen, Juha (Nokia - FI/Espoo) 
<juha.koso...@nokia.com>; acmor...@att.com; Wangwulin (Linda) 
<wangwu...@huawei.com>; rp...@linuxfoundation.org; 
'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org>; 
test...@lists.opnfv.org
主题: ONS Discussion //RE: NFVbench requirements //RE: check xci pike tags //RE: 
Update on long duration test

Hi,

Thanks for the suggestion. I agree we should have discussion w.r.t. timeline, 
clarifications, etc., according the newly changes.
In the Infra group meeting, it’s discussed that Fatih will help us with the 
requirements of long duration CI.
As our POD is provided by Nokia, I think Tapio could help us with hardware 
requirements for traffic generators.
The only thing that is not clear is when could we have xci-bare metal deployed.

It would be the best we have a round table F2F meeting about how to move it 
forward as you suggested, based on which we could also have our report ready 
for TSC and the community.

Best,
Gabriel

From: Alec Hothan (ahothan) [mailto:ahot...@cisco.com]
Sent: Thursday, March 15, 2018 10:47 PM
To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: Re: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test


I am not seeing any movement on this front and was expecting questions from the 
owners/admin of the long duration test lab… Should we (test wg) actively engage 
the lab owners to check for hardware requirements?
I personally have no urgency to get NFVbench working on that particular testbed 
but it is more for the long duration test planning 😉 I think it would be good 
to put some timeline in place (even tentative) and secure participation from 
the lab owners.
I will be at the ONS summit dev forum in 2 weeks, perhaps we should have a 
discussion about how to move this forward?

Thanks

  Alec



From: "Yuyang (Gabriel)" 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>
Date: Wednesday, February 21, 2018 at 7:43 PM
To: "Alec Hothan (ahothan)" <ahot...@cisco.com<mailto:ahot...@cisco.com>>, 
Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>, 
"cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>" 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>, "Tallgren, 
Tapio (Nokia - FI/Espoo)" 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>, Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>, BLAISONNEAU David 
IMT/OLN <david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>, 
"sridhar....@spirent.com<mailto:sridhar....@spirent.com>" 
<sridhar....@spirent.com<mailto:sridhar....@spirent.com>>, 
"ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>" 
<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>, 
"mark.bei...@emc.com<mailto:mark.bei...@emc.com>" 
<mark.bei...@emc.com<mailto:mark.bei...@emc.com>>, Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>, Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: "trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>" 
<trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>, "Kosonen, Juha 
(Nokia - FI/Espoo)" <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>, 
"acmor...@att.com<mailto:acmor...@att.com>" 
<acmor...@att.com<mailto:acmor...@att.com>>, "Wangwulin (Linda)" 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>, 
"rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>" 
<rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>
Subject: RE: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test

Hi,

I have summarized our discussion in 
https://wiki.opnfv.org/display/testing/Long+Duration+Testing.
Please take a look at it to check if there is something missing or incorrect.

Best,
Gabriel

From: Yuyang (Gabriel)
Sent: Tuesday, February 06, 2018 4:43 PM
To: 'Alec Hothan (ahothan)' <ahot...@cisco.com<mailto:ahot...@cisco.com>>; 
Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: RE: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test

Okay then, thanks!
I will try my best summarizing the requirements/actions first and send it out 
for further review/modification.

Best,
Gabriel

From: Alec Hothan (ahothan) [mailto:ahot...@cisco.com]
Sent: Tuesday, February 06, 2018 2:39 AM
To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: Re: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test


The main impediment to any traffic generation (VSPERF or NFVbench) is the 
proper hardware configuration and wiring.
From what I have seen the PDF does not address any of the config related to 
data plane connectivity to outside the pod.
For the short term, we should focus on this particular pod and try to nail down 
the HW setup so we can pass traffic. I can also deploy the NFVbench container 
on the jump host manually (and worry about Jenkins deployment later).
I added the instructions/requirements in the etherpad and those should be a 
sufficient for the admin of that pod to get going – in case of any question, 
please contact me.

The tech talk for vsperf/nfvbench is just my suggestion since a lot of people 
have questions on vsperf and nfvbench (will see with Trevor/Sridhar).
The testing-wg meeting is not an easy time slot for me which is why I can’t 
make it every week (7am PST – I may be blocked in traffic)

Thanks

  Alec



From: "Yuyang (Gabriel)" 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>
Date: Sunday, February 4, 2018 at 7:17 PM
To: "Alec Hothan (ahothan)" <ahot...@cisco.com<mailto:ahot...@cisco.com>>, 
Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>, 
"cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>" 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>, "Tallgren, 
Tapio (Nokia - FI/Espoo)" 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>, Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>, BLAISONNEAU David 
IMT/OLN <david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>, 
"sridhar....@spirent.com<mailto:sridhar....@spirent.com>" 
<sridhar....@spirent.com<mailto:sridhar....@spirent.com>>, 
"ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>" 
<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>, 
"mark.bei...@emc.com<mailto:mark.bei...@emc.com>" 
<mark.bei...@emc.com<mailto:mark.bei...@emc.com>>, Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>, Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: "trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>" 
<trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>, "Kosonen, Juha 
(Nokia - FI/Espoo)" <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>, 
"acmor...@att.com<mailto:acmor...@att.com>" 
<acmor...@att.com<mailto:acmor...@att.com>>, "Wangwulin (Linda)" 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>, 
"rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>" 
<rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>
Subject: RE: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test

Hi Alec,

Thanks a lot for the clarification, really appreciate it! It’s much more clear 
now.
In the meantime, since NFVbench, VSPERF and Storperf share a time slot for 3 
weeks, how we can schedule these tests properly.
I see Mark suggested that run VSPERF first, then Storperf, then both at the 
same time. That is before NFVbench joining in.
Is it simply adding NFVbench into the sequence enough, i.e., VSPERF -> NFVbench 
->  Storperf -> VSPERF&NFVbench&Storperf

It is great that you are planning a lighting talk for VSPERF and NFVbench. 
Could you also present this talk in Testperf meeting as input or part of the 
discussion for the long duration CI. Thanks in advance!

Please my other comments inline

From: Alec Hothan (ahothan) [mailto:ahot...@cisco.com]
Sent: Sunday, February 04, 2018 12:47 AM
To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: Re: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test

Hi Gabriel,

In a nutshell, NFVbench is a traffic generator wrapper that has extra features 
to facilitate the measurement of NFV type of data plane workloads on any 
OpenStack based NFVi platform.
It has the particularity to be self-contained (does not need an external 
traffic generator), portable (docker container), relatively efficient and 
trivial to use.
It is targeting a completely different use case than VSPERF in that it 
considers the NFVi stack to measure as a black box. We could probably have a 
session on that comparison in one of the coming OPNFV lightning talk by VSPRF 
and NFVbench teams.

See inline…


From: "Yuyang (Gabriel)" 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>
Date: Friday, February 2, 2018 at 10:35 PM
To: "Alec Hothan (ahothan)" <ahot...@cisco.com<mailto:ahot...@cisco.com>>, 
Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>, 
"cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>" 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>, "Tallgren, 
Tapio (Nokia - FI/Espoo)" 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>, Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>, BLAISONNEAU David 
IMT/OLN <david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>, 
"sridhar....@spirent.com<mailto:sridhar....@spirent.com>" 
<sridhar....@spirent.com<mailto:sridhar....@spirent.com>>, 
"ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>" 
<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>, 
"mark.bei...@emc.com<mailto:mark.bei...@emc.com>" 
<mark.bei...@emc.com<mailto:mark.bei...@emc.com>>, Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>, Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: "trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>" 
<trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>, "Kosonen, Juha 
(Nokia - FI/Espoo)" <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>, 
"acmor...@att.com<mailto:acmor...@att.com>" 
<acmor...@att.com<mailto:acmor...@att.com>>, "Wangwulin (Linda)" 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>, 
"rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>" 
<rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>
Subject: RE: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test

Hi Alec,

Thanks for feed backing your requirements. I have some questions which are 
elaborated below.

1.       I see you mentioned that duration of NFVbench test could be configured 
as long as needed. In our current testing, apart from supporting long duration 
traffic, all the long duration tests have their purpose. For example, for 
VSPERF has defined its tests for Max Forwarding Rate stability under different 
settings and etc.: 
https://gerrit.opnfv.org/gerrit/#/c/50951/4/docs/testing/developer/devguide/requirements/vswitchperf_ltd.rst;
 For Bottlenecks&Yardstick, it tests for the capabilities of management plane, 
data plane, etc.: 
https://wiki.opnfv.org/display/bottlenecks/Stress+Testing+over+OPNFV+Platform; 
for Functest, it tests for the repeatability of the functions of SUT and 
validate the functionality of SUT under long term usage. Could you provide some 
pointers that documents the purpose of long duration tests in NFVbench? So that 
we could better introduce our tests to the community.
[Alec]
NFVbench supports 2 modes of measurements: drop rate measurement at fixed rate 
throughput, and NDR/PDR measurement. In the first mode, you specify the 
parameters of the traffic (rate, frame size, flow profile…), duration and it 
will measure the drop rate during that run.
In the second mode, you provide the drop rate thresholds and it will measure 
the highest throughput achievable within that drop rate threshold.
When you issue any measurement request, a lot of things happen behind the 
scenes that you as a user do not have to worry about: loading a VM image to 
glance, creating the necessary neutron networks, launching the VM image in the 
appropriate number of instances, configuring the embedded traffic generator, 
verifying packets are passing in both directions, starting the traffic 
generation, then collect all the stats and dispose all resources at the end of 
the run.

For NFVbench a “long duration test” would generally mean that you run say 1Mpps 
at 64B for 1 hour, then at the end of the hour, it will tell you exactly how 
many packets were sent, received along with the drop rate and latency.

It would be very easy to combine an NFVbench run with some other activity 
running concurrently (e.g. storage perf, control plane) and measure the impact 
(you might see more drops or different latency). I believe the bottleneck 
project was designed for orchestrating such combined test?

[Gabriel]
Thanks Alec! It is very clear now.
It would be better you also present the lightning talk in Testperf meeting for 
some details. In addition, orchestrating tests from NFVbench for Bottlenecks is 
a great idea too ☺.


2.       I also notice that there are hardware requirements that  2 available 
10G links connected to the TOR from jump server and the 2 links must be 
configured as trunk port. Do you mean the 2 links are all connected to the 
internal network? According to 
https://wiki.opnfv.org/display/pharos/Nokia+Hosting, only 1 internal link (P3) 
connected to jumber server (P5 is for storage). Could @Tapio elaborate more on 
the physical connections from jump server to TOR? Thanks

[Alec]
Well it looks like the jump host has 4x10G links (which could be an Intel X710 
NIC), In general 1 of the port would be used for management purpose so it would 
be great if we could reserve 2 of the unused ports for traffic generation.
The 2 ports just need to be wired to the TOR and the VLAN switching will take 
care of directing the traffic to the right compute node/VM.
You can have a look at the entire packet path in the packet path diagrams in 
the NFVbench documentation, they show clearly the 2 phys interfaces connecting 
the traffic generator and the TOR switch 
http://docs.opnfv.org/en/latest/submodules/nfvbench/docs/testing/user/userguide/readme.html#supported-packet-paths

The current version of NFVbench only supports VLAN based tenant networks (which 
is the most widely deployed neutron configuration) and can be easily extended 
to support VLAN based provider network (in case the deployed pod does not 
support tenant networks which is unlikely). Overlays such as VxLAN are not 
currently supported.

[Gabriel]
I guess we should ask for @Tapio for help here.




3.       There is a requirement about DPDK. However, currently, we only 
consider os-nosdn-nofeature-ha scenario for xci-baremetal. I do not know if 
xci-baremetal support DPDK yet. Could @david.blaisonneau provide some 
informations ? If DPDK is not supported, you probably need to install DPDK-OVS 
by yourself. However, this is not recommended unless you could make it a 
automation. Does NFVbench has long duration tests aiming only for OVS?

[Alec]
As mentioned above, the system under test is a black box for NFVbench. As such, 
it does not care about the exact Neutron mechanism driver used, it does not 
care about how the data plane wiring is done on the compute nodes, all it cares 
is that Neutron uses VLAN as the encapsulation.
So any NFVi platform based on VLAN will work: OVS, OVS-DPDK, VPP… You can run 
it on an OVS based NFVi, it will just show you that packets will start to drop 
at a much lower rate than a DPDK based NFVi. You can still run long duration on 
OVS, you just use a lower rate (well you could also blast at full line rate on 
an OVS system – just don’t expect many packets to come back).

The DPDK requirement is solely on the jump host because the embedded traffic 
generator (TRex) requires a DPDK interface to send/receive packets.
That is why the NIC on the jump host must support DPDK.


[Gabriel]
As to the DPDK on jump server, it seems like a one time job. Should NFVbench 
team take care of this?
- if you do not have the priviledge to install DPDK after you get the access to 
the POD, we should resort to Tapio then
Moreover, as to my knowledge, VSPERF will install DPDK before tests. If 
NFVbench run after VSPERF, it probably does not to need install DPDK again.

Thanks

  Alec



Thanks,
Gabriel
From: Alec Hothan (ahothan) [mailto:ahot...@cisco.com]
Sent: Friday, February 02, 2018 11:53 PM
To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: Re: NFVbench requirements //RE: check xci pike tags //RE: Update on 
long duration test


I have added the requirements for NFVbench. The only thing new compared to 
other testing tools is that we’re spec’ing for data plane traffic injection so 
there will be some hardware requirements (see etherpad) on the jump host (where 
the NFVbench container runs) and on the TOR (configuration of the ports used 
for traffic injection).

I’m not sure if testing tool containers deployments are inside VM? As discussed 
previously with Fatih, NFVbench must run natively on bare metal because it 
needs to access the NIC card using DPDK. So the deployment of NFVbench 
container might be different than the other testing tools.

Thanks

  Alec




From: "Yuyang (Gabriel)" 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>
Date: Thursday, February 1, 2018 at 5:14 PM
To: "Alec Hothan (ahothan)" <ahot...@cisco.com<mailto:ahot...@cisco.com>>, 
Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>, 
"cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>" 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>, "Tallgren, 
Tapio (Nokia - FI/Espoo)" 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>, Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>, BLAISONNEAU David 
IMT/OLN <david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>, 
"sridhar....@spirent.com<mailto:sridhar....@spirent.com>" 
<sridhar....@spirent.com<mailto:sridhar....@spirent.com>>, 
"ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>" 
<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>, 
"mark.bei...@emc.com<mailto:mark.bei...@emc.com>" 
<mark.bei...@emc.com<mailto:mark.bei...@emc.com>>, Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>, Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: "trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>" 
<trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>, "Kosonen, Juha 
(Nokia - FI/Espoo)" <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>, 
"acmor...@att.com<mailto:acmor...@att.com>" 
<acmor...@att.com<mailto:acmor...@att.com>>, "Wangwulin (Linda)" 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>, 
"rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>" 
<rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>
Subject: NFVbench requirements //RE: check xci pike tags //RE: Update on long 
duration test

Hi Alec,

Please find etherpad link below for inputting NFVbench requirements according 
to yesterday's meeting.
https://etherpad.opnfv.org/p/long_duration_ci


Best,
Gabriel

-----Original Message-----
From: Yuyang (Gabriel)
Sent: Tuesday, January 30, 2018 4:41 PM
To: 'Fatih Degirmenci' 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: RE: check xci pike tags //RE: Update on long duration test

Hi Fatih,

Thanks for the explanation!
I guess we could try to run tests over Queen first to see if there is any gap.
After all, our tests should be adaptive regarding at least a few latest 
versions of OpenStack and be able to find bugs timely.

Thanks,
Gabriel

-----Original Message-----
From: Fatih Degirmenci [mailto:fatih.degirme...@ericsson.com]
Sent: Tuesday, January 30, 2018 4:28 PM
To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>; Georg Kunz 
<georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>
Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
Subject: Re: check xci pike tags //RE: Update on long duration test

Hi Gabriel,

We don't have a tag on XCI repo pointing to Pike since it was released at the 
very early phases of XCI development.
We intend to start tagging the repo once we have Functest running as part of CI 
and will definitely have a tag pointing to Queens in few weeks when it gets 
released by OpenStack and tested by XCI.

But you can still deploy Pike by changing one variable - it is important to 
highlight that this is not officially supported. If something doesn't work, we 
might not be able to support you.

http://docs.opnfv.org/en/latest/submodules/releng-xci/docs/xci-user-guide.html#how-to-use

See the advanced usage section. If you set OPENSTACK_OSA_VERSION to stable/pike 
before starting the deployment, you should get stable/pike.

/Fatih

On 2018-01-26, 05:59, "Yuyang (Gabriel)" 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>> wrote:

    Hi Fatih,

    As discussed in the Testperf meeting yesterday, we want to know that if XCI 
has tags for Pike release already.
    Since our testing projects are still based on Pike, we probably stick to 
Pike when XCI bump into Queen.

    Thanks,
    Gabriel

    -----Original Message-----
    From: Yuyang (Gabriel)
    Sent: Thursday, January 25, 2018 5:26 PM
    To: 'Fatih Degirmenci' 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; Tallgren, Tapio 
(Nokia - FI/Espoo) <tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; 
Tim Irnich <tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; 
BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>
    Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
    Subject: RE: Update on long duration test

    Hi,

    I also agree that it make sense to use the latest stable versions as the 
SUT.
    Just to add that, our initial plan is for os-nosdn-nofeature scenario and 
do not have test cases that need to be run several weeks. Only the ones that 
will run hours, or 1 or 2 days (correct me if I am wrong).
    So bugs that found by our tests might be able to be feedback in time.
    However, if the tests could run for weeks or even months, that's the part I 
am not sure if the bug could be feedback to upstream effectively for the target 
stable version.

    Thanks,
    Gabriel


    -----Original Message-----
    From: Fatih Degirmenci [mailto:fatih.degirme...@ericsson.com]
    Sent: Thursday, January 25, 2018 4:43 PM
    To: cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; 
Tallgren, Tapio (Nokia - FI/Espoo) 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>>; Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com>>; BLAISONNEAU David 
IMT/OLN <david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>
    Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Kosonen, Juha 
(Nokia - FI/Espoo) <juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
    Subject: Re: Update on long duration test

    Hi,

    Here is how I think things could work and this is just a quick thought and 
you are welcomed to disagree.

    As we all know, XCI aims to work against the master since we have many 
other ways to get stable versions of the platform.
    But this doesn't mean XCI is not useful for the purposes you've been 
discussing; long duration test, feature/test project support, and so on.

    The way I see this is that, while we continue chasing master on XCI, we 
will hit the official versions on the way when they happen.

    For example, we will bump XCI to Queens release around the end of February, 
when OpenStack releases it.
    We will take those versions in to XCI like any other version and test them 
as usual with all the scenarios/features we either support or work on 
supporting. (os-nosdn-nofeature, os-odl-nofeature, os-odl-sfc, os-odl-bgpvpn, 
congress, promise/blazar, ha/masakari and anything else that might be ready by 
then.) We will promote/tag versions that use official Queens if/once they pass 
our testing and continue as usual, bumping to later versions when we deem 
needed.

    But XCI moving on doesn't mean you won't be able to use XCI. You will have 
possibility to specify certain versions/tags of XCI Framework and scenarios to 
deploy and test, for example the tags that correspond to the Queens which gives 
you stable release of OpenStack.
    At the same time makes it possible for you to provide feedback to upstream 
which might be incorporated to Rocky development. (we will not support Queens 
maintenance release in XCI obviously.)

    /Fatih

    On 2018-01-25, 09:31, 
"cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>" 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>> wrote:

        Hello,

        I fully agree it makes sense to deploy via XCI the latest stable 
versions of OpenStack.
        As discussed Portland, it would allow improving OPNFV by introducing 
Functional gating via the referent platform (at least in case of Functest).
        Then this platform should be ready from day 0 of the next OPNFV release 
(stable/pike for F release).
        My point is still to create a referent platform (such as devstack for 
OpenStack) what XCI could be.

        Then XCI could target master but we could (at least) freeze versions 
according to OpenStack releases.

        Cédric


        -----Message d'origine-----
        De : Tallgren, Tapio (Nokia - FI/Espoo) 
[mailto:tapio.tallg...@nokia.com]
        Envoyé : jeudi 25 janvier 2018 08:26
        À : Yuyang (Gabriel); Tim Irnich; BLAISONNEAU David IMT/OLN; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; OLLIVIER Cédric 
IMT/OLN; ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch
        Cc : trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Fatih 
Degirmenci; Kosonen, Juha (Nokia - FI/Espoo); 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda); 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
        Objet : Re: Update on long duration test

        Hi,

        I would like to understand better the idea of running XCI on long-term 
testing and with feature projects. First of all, it makes sense to test feature 
projects with XCI, but I am not sure how far that is. So the first step would 
be to run feature projects on latest OpenStack on XCI with short-term testing 
(which is probably what you meant).

        What do we do if something fails after one week of testing with 
OpenStack? It does not make sense to make the long-term testing as part of the 
gating process, which means that it is always an old version of master that has 
failed. Who will analyze the results and report the errors to upstream? Would 
it make more sense to test with XCI the latest stable versions of OpenStack etc?

        -Tapio

        ________________________________________
        From: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>
        Sent: Thursday, January 25, 2018 4:29:08 AM
        To: Tim Irnich; 
david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>; Tallgren, 
Tapio (Nokia - FI/Espoo); 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; OLLIVIER Cédric 
IMT/OLN; ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch
        Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Fatih 
Degirmenci; Kosonen, Juha (Nokia - FI/Espoo); 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda); 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
        Subject: RE: Update on long duration test

        Hi Tim,

        Thanks for your suggestion!
        In my mind, it’d be better we could report the progress and collect 
comments/requirements to/from TSC within 3 weeks.
        There is a big holiday (Spring Festival) in China from Feb. 15 – 21, 
however, people tend to rest for more days (may be Feb. 13-23).
        So I guess we need to initiate the discussion in TSC on Feb. 6 with the 
basic set-ups:

        1.       XCI-Baremetal deployed on the POD

        2.       Projects adapt their tests over XCI-Baremetal preliminarily

        3.       Basic requirements collected for the long duration CI

        Best,
        Gabriel

        From: Tim Irnich [mailto:tim.irn...@ericsson.com]
        Sent: Wednesday, January 24, 2018 9:12 PM
        To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; 
david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com>; 
tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com>; 
sridhar....@spirent.com<mailto:sridhar....@spirent.com>; OLLIVIER Cédric 
IMT/OLN <cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>; 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Jose Lausuch 
<jalaus...@suse.com<mailto:jalaus...@suse.com>>
        Cc: trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>; Fatih 
Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com>>; 
juha.koso...@nokia.com<mailto:juha.koso...@nokia.com>; 
acmor...@att.com<mailto:acmor...@att.com>; Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com>>; 
rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>
        Subject: RE: Update on long duration test

        Hi Gabriel, all,

        It would be helpful to bring this up in the TSC for information & 
comments once the WG has homed in on how to move forward. When do you think 
would be a good time to do this?

        Btw, I’m including Jose’s new email address here as well.

        Regards, Tim

        From: Yuyang (Gabriel) [mailto:gabriel.yuy...@huawei.com]
        Sent: Wednesday, January 24, 2018 03:07
        To: 
david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com>;
 
tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com>;
 
sridhar....@spirent.com<mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com>;
 OLLIVIER Cédric IMT/OLN 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com%3e>>;
 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com>;
 mark.bei...@emc.com<mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com>; 
jose.laus...@ericsson.com<mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com>
        Cc: 
trevor.coo...@intel.com<mailto:trevor.coo...@intel.com><mailto:trevor.coo...@intel.com>;
 Fatih Degirmenci 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com%3e>>;
 
juha.koso...@nokia.com<mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com>;
 acmor...@att.com<mailto:acmor...@att.com><mailto:acmor...@att.com>; Wangwulin 
(Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com%3e>>;
 Tim Irnich 
<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com><mailto:tim.irn...@ericsson.com><mailto:tim.irn...@ericsson.com%3e>>
        Subject: RE: Update on long duration test

        HI Tapio,

        I was on a travel and will start collecting requirements for the long 
duration CI in the Testperf meeting and then our mailing list during the next 2 
weeks.
        Sorry for the delay!

        Best,
        Gariel

        From: 
david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com>
 [mailto:david.blaisonn...@orange.com]
        Sent: Monday, January 22, 2018 11:32 PM
        To: 
tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com>;
 
sridhar....@spirent.com<mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com>;
 Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com%3e>>;
 OLLIVIER Cédric IMT/OLN 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com%3e>>;
 
ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com>;
 mark.bei...@emc.com<mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com>; 
jose.laus...@ericsson.com<mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com>
        Cc: 
trevor.coo...@intel.com<mailto:trevor.coo...@intel.com><mailto:trevor.coo...@intel.com>;
 
fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com>;
 
juha.koso...@nokia.com<mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com>;
 acmor...@att.com<mailto:acmor...@att.com><mailto:acmor...@att.com>; Wangwulin 
(Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com%3e>>;
 
tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com><mailto:tim.irn...@ericsson.com>
        Subject: Re: Update on long duration test

        Hi Tapio,

        the patch allowing deployment on baremetal is still in 
review/correction phase. I will use this pod as soon as the patch will be 
stabilized (i hope at the end of the week or the next one)

        BR

        David

        --
        --
        David BLAISONNEAU
        NFV platforms - OPNFV and ONAP contributor Orange - IMT / OLN / CNC / 
NCA / SINA

        tel: +33 (0)2 96 07 27 93
        email: 
david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com>
        2, avenue Pierre Marzin 22307 LANNION Cedex - France

        Le lundi 22 janvier 2018 à 08:46 +0000, Tallgren, Tapio (Nokia - 
FI/Espoo) a écrit :

        Hi all,



        Any updates on the Long Duration Testing? The pod seems to be pretty 
vacant at the moment.



        -Tapio



        ________________________________________

        From: 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com>
 
<cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com%3e>>

        Sent: Wednesday, November 29, 2017 6:36:22 PM

        To: Sridhar Rao; BLAISONNEAU David IMT/OLN; Ross B' 'Brattain; 
mark.beierl; Jose Lausuch; Yuyang (Gabriel)

        Cc: Fatih Degirmenci; Tallgren, Tapio (Nokia - FI/Espoo); Kosonen, Juha 
(Nokia - FI/Espoo); Wangwulin (Linda); MORTON, ALFRED C (AL); Tim Irnich; 
Cooper, Trevor

        Subject: RE: Update on long duration test



        I confirm that we can't raise this side effects because the OpenStack 
resource garbage collector mentioned had been updated then removed for tempest 
based testcases.



        Yes we can discuss on that topic next week.



        Thank you,

        Cédric



        ---- Yuyang (Gabriel) a écrit ----



        Hi Cedric,



        For the SUT, currently we choose XCI-baremetal.

        As to each testing project, I don't recall we have emposed restrictions 
on the branches.

        I am opt to choose master since we are adding new features and in this 
way we could avoid maintaining different branches.



        Anyway, I would also suggest we could have a discussion on this during 
plugfest due to different needs from projects.



        Best,

        Gabriel



        发件人: cedric.ollivier

        收件人: Sridhar 
Rao<sridhar....@spirent.com<mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com>>;BLAISONNEAU<mailto:sridhar....@spirent.com%3e%3cmailto:sridhar....@spirent.com%3e%3e;BLAISONNEAU>
 David 
IMT/OLN<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com>>;Ross<mailto:david.blaisonn...@orange.com%3e%3cmailto:david.blaisonn...@orange.com%3e%3e;Ross>
 B' 
'Brattain<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com>>;mark.beierl<mark.bei...@emc.com<mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com>>;Jose<mailto:ross.b.bratt...@intel.com%3e%3cmailto:ross.b.bratt...@intel.com%3e%3e;mark.beierl%3cmark.bei...@emc.com%3cmailto:mark.bei...@emc.com%3e%3cmailto:mark.bei...@emc.com%3e%3e;Jose>
 
Lausuch<jose.laus...@ericsson.com<mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com>>;Yuyang<mailto:jose.laus...@ericsson.com%3e%3cmailto:jose.laus...@ericsson.com%3e%3e;Yuyang>
 
(Gabriel)<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com%3e%3cmailto:gabriel.yuy...@huawei.com%3e>>

        抄送: Fatih 
Degirmenci<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com>>;Tapio<mailto:fatih.degirme...@ericsson.com%3e%3cmailto:fatih.degirme...@ericsson.com%3e%3e;Tapio>
 Tallgren, (Nokia - 
FI/Espoo)<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com>>;juha.kosonen<juha.koso...@nokia.com<mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com>>;Wangwulin<mailto:tapio.tallg...@nokia.com%3e%3cmailto:tapio.tallg...@nokia.com%3e%3e;juha.kosonen%3cjuha.koso...@nokia.com%3cmailto:juha.koso...@nokia.com%3e%3cmailto:juha.koso...@nokia.com%3e%3e;Wangwulin>
 
(Linda)<wangwu...@huawei.com<mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com>>;MORTON<mailto:wangwu...@huawei.com%3e%3cmailto:wangwu...@huawei.com%3e%3e;MORTON>,
 ALFRED C 
(AL)<acmor...@att.com<mailto:acmor...@att.com><mailto:acmor...@att.com><mailto:acmor...@att.com>>;'Tim<mailto:acmor...@att.com%3e%3cmailto:acmor...@att.com%3e%3e;'Tim>
 
Irnich'<tim.irn...@ericsson.com<mailto:tim.irn...@ericsson.com><mailto:tim.irn...@ericsson.com><mailto:tim.irn...@ericsson.com>>;Cooper<mailto:tim.irn...@ericsson.com%3e%3cmailto:tim.irn...@ericsson.com%3e%3e;Cooper>,
 
Trevor<trevor.coo...@intel.com<mailto:trevor.coo...@intel.com><mailto:trevor.coo...@intel.com><mailto:trevor.coo...@intel.com><mailto:trevor.coo...@intel.com%3e%3cmailto:trevor.coo...@intel.com%3e>>

        主题: RE: Update on long duration test

        时间: 2017-11-29 15:28:59



        Hello,



        Both options are fine and allow running our functest-components 
container multiple times in a row.



        I would prefer the most challenging option and then to run functest + 
bottlenecks + yardstick.

        We rewrote our OpenStack resource garbage collector for E but we must 
ensure that our tests can't raise side effects to the 2 other projects. I will 
double check internally.



        Could you please confirm we select E and/or master for long duration 
tests?



        Cédric



        ---- Yuyang (Gabriel) a écrit ----



        Hi Cedric,



        Thanks for the update. Currently each two projects share a 2-weeks time 
slot, i.e., Bottlenecks and Yardstick share a time slot, Vsperf and Storperf 
share a time slot.

        For functest, I have 2 proposals: 1) functest could along have a time 
slot with 1 week long; 2) Bottlenecks, Yardstick and Functest share a time slot 
with 3 weeks’ long.

        What do you think of it?



        Thanks,

        Gabriel



        From: 
cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com><mailto:cedric.olliv...@orange.com>
 [mailto:cedric.olliv...@orange.com]

        Sent: Tuesday, November 28, 2017 9:27 PM

        To: Yuyang (Gabriel) 
<gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com><mailto:gabriel.yuy...@huawei.com%3e>>;
 Rao, Sridhar 
<sridhar....@spirent.com<mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com><mailto:sridhar....@spirent.com%3e>>;
 BLAISONNEAU David IMT/OLN 
<david.blaisonn...@orange.com<mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com><mailto:david.blaisonn...@orange.com%3e>>;
 'Brattain, Ross B' 
<ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com><mailto:ross.b.bratt...@intel.com%3e>>;
 mark.bei...@emc.com<mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com>; 
Jose Lausuch 
<jose.laus...@ericsson.com<mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com><mailto:jose.laus...@ericsson.com%3e>>

        Cc: 'Fatih Degirmenci' 
<fatih.degirme...@ericsson.com<mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com><mailto:fatih.degirme...@ericsson.com%3e>>;
 Tallgren, Tapio (Nokia - FI/Espoo) 
<tapio.tallg...@nokia.com<mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com><mailto:tapio.tallg...@nokia.com%3e>>;
 
juha.koso...@nokia.com<mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com>;
 Wangwulin (Linda) 
<wangwu...@huawei.com<mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com><mailto:wangwu...@huawei.com%3e>>

        Subject: RE: Update on long duration test



        Hello,



        About Functest, we could run tempest_smoke_serial (<30 minutes) several 
times in a row and expect the same good result.

        If the duration is quite long, we could also consider the components 
suites (> 4 hours) which includes full rally and tempest testcases.

        https://wiki.opnfv.org/display/functest/Run+Alpine+Functest+containers



        By the way, it could be interesting to disable the Functest garbage 
collector to check if they are remaining OpenStack resources after all runs.



        Cédric



        De : Yuyang (Gabriel) [mailto:gabriel.yuy...@huawei.com]

        Envoyé : lundi 27 novembre 2017 02:27

        À : Rao, Sridhar; BLAISONNEAU David IMT/OLN; 'Brattain, Ross B'; 
OLLIVIER Cédric IMT/OLN; 
mark.bei...@emc.com<mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com><mailto:mark.bei...@emc.com<mailto:mark.bei...@emc.com%3e%3cmailto:mark.bei...@emc.com>>;
 Jose Lausuch

        Cc : 'Fatih Degirmenci'; Tallgren, Tapio (Nokia - FI/Espoo); 
juha.koso...@nokia.com<mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com><mailto:juha.koso...@nokia.com<mailto:juha.koso...@nokia.com%3e%3cmailto:juha.koso...@nokia.com>>

        Objet : Update on long duration test



        Hi,



        It’s been 4 weeks since we got the POD from Nokia for the long duration 
test.

        We’d better make an update on the progress/info for Infra group. i.e., 
in Infra meeting.

        According to https://jira.opnfv.org/browse/INFRA-154, only David and I 
have got the credentials. Please apply for the access if you don’t.



        Another information regarding the test cases should be updated.

        Bottlenecks currently plans 2-3 test cases for the long duration test, 
regarding the capability of the SUT simultaneously creates/destroy/verification 
stacks/VMs, long duration traffic for co-existing stacks/VMs, limit testing for 
baseline traffic for NIC/ovs…

        Is there any update/plan on the test cases from 
vsperf/storperf/yardstick/functest?



        I also expect that we could have a short discussion on the XCI 
deployment and CI chain set-up in the meeting as base for plugfest.



        Thanks,

        Gabriel



        
_________________________________________________________________________________________________________________________







        Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc



        pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
recu ce message par erreur, veuillez le signaler



        a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration,



        Orange decline toute responsabilite si ce message a ete altere, deforme 
ou falsifie. Merci.







        This message and its attachments may contain confidential or privileged 
information that may be protected by law;



        they should not be distributed, used or copied without authorisation.



        If you have received this email in error, please notify the sender and 
delete this message and its attachments.



        As emails may be altered, Orange is not liable for messages that have 
been modified, changed or falsified.



        Thank you.



        
_________________________________________________________________________________________________________________________



        Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

        pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
recu ce message par erreur, veuillez le signaler

        a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration,

        Orange decline toute responsabilite si ce message a ete altere, deforme 
ou falsifie. Merci.



        This message and its attachments may contain confidential or privileged 
information that may be protected by law;

        they should not be distributed, used or copied without authorisation.

        If you have received this email in error, please notify the sender and 
delete this message and its attachments.

        As emails may be altered, Orange is not liable for messages that have 
been modified, changed or falsified.

        Thank you.





        
_________________________________________________________________________________________________________________________



        Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

        pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
recu ce message par erreur, veuillez le signaler

        a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration,

        Orange decline toute responsabilite si ce message a ete altere, deforme 
ou falsifie. Merci.



        This message and its attachments may contain confidential or privileged 
information that may be protected by law;

        they should not be distributed, used or copied without authorisation.

        If you have received this email in error, please notify the sender and 
delete this message and its attachments.

        As emails may be altered, Orange is not liable for messages that have 
been modified, changed or falsified.

        Thank you.



        
_________________________________________________________________________________________________________________________



        Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

        pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
recu ce message par erreur, veuillez le signaler

        a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration,

        Orange decline toute responsabilite si ce message a ete altere, deforme 
ou falsifie. Merci.



        This message and its attachments may contain confidential or privileged 
information that may be protected by law;

        they should not be distributed, used or copied without authorisation.

        If you have received this email in error, please notify the sender and 
delete this message and its attachments.

        As emails may be altered, Orange is not liable for messages that have 
been modified, changed or falsified.

        Thank you.

        
_________________________________________________________________________________________________________________________

        Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
        pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
recu ce message par erreur, veuillez le signaler
        a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration,
        Orange decline toute responsabilite si ce message a ete altere, deforme 
ou falsifie. Merci.

        This message and its attachments may contain confidential or privileged 
information that may be protected by law;
        they should not be distributed, used or copied without authorisation.
        If you have received this email in error, please notify the sender and 
delete this message and its attachments.
        As emails may be altered, Orange is not liable for messages that have 
been modified, changed or falsified.
        Thank you.






_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Reply via email to