Re: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-21 Thread MORTON, ALFRED C (AL) 
Hi Trevor,
one more reply (glad to see so many),
Al

1.   How do you use VSPERF or plan to use VSPERF?
I've used VSPERF test capabilities to examine detailed questions
about NFVI dataplane benchmarking. The question of RFC2544
Back to Back Frame test stability has been looming for some time.
We have some good results, and still some work to do.
2.   Why do you think VSPERF is an important project in OPNFV, what are the 
main benefits of the project that you foresee?
VSPERF provides a platform where the entire Industry can learn more
about NFVI dataplane benchmarking, and try-out new techniques
together. The project has already contributed to IETF Benchmarking
Methodology Working Group on the topics of test configuration for
improving repeatability and recommended NFVI test setups (Deployment
Scenarios). The value of good specifications in the Open Source
community is clear.
3.   What are major gaps or features that you would like to see in VSPERF 
that are not there today?
VSPERF could become an implementation of new NFVI benchmarking specifications
as they emerge, and help to drive the specification development (as the
recent work http://nfvprivatewiki.etsi.org/index.php?title=NFVI_Benchmarking
has already done: There are some trade-offs to make when using "free"
test traffic generators, especially if results integrity and ability
to compare with others are critical aspects of the test campaign).

4.   Anything else?
This project provides a useful OS tool that is unique in many aspects.
It's very worthwhile to continue the work, IMO.


From: opnfv-tech-discuss-boun...@lists.opnfv.org 
[mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] On Behalf Of Cooper, Trevor
Sent: Monday, June 19, 2017 12:22 PM
To: opnfv-tech-discuss@lists.opnfv.org
Subject: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

I am collecting feedback about VSPERF from users and contributors ... the main 
purpose is to help me motivate for our ongoing investment in the project. I 
already approached a few people ... even if you have already given feedback 
feel free to add anything else.


1.   How do you use VSPERF or plan to use VSPERF?



2.   Why do you think VSPERF is an important project in OPNFV, what are the 
main benefits of the project that you foresee?



3.   What are major gaps or features that you would like to see in VSPERF 
that are not there today?



4.   Anything else?


Thanks

/Trevor

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-21 Thread Tapio Tallgren 
On Wed, Jun 21, 2017 at 07:31:07AM +0200, Christo Kleu wrote:
> Comments inline
> Note: some of these comments might already be outdated
> 
> Regards,
> Christo Kleu
> 
> On Mon, Jun 19, 2017 at 6:22 PM, Cooper, Trevor 
> wrote:
> 
> 
> I am collecting feedback about VSPERF from users and contributors … the
> main purpose is to help me motivate for our ongoing investment in the
> project. I already approached a few people … even if you have already 
> given
> feedback feel free to add anything else.
> 
>  
> 
> 1.   How do you use VSPERF or plan to use VSPERF?
> 

Not currently using. Planned use is to compare OVS with smart NICs, and
to verify that the OVS settings from OpenStack are not too far from
optimal.

> 
> 2.   Why do you think VSPERF is an important project in OPNFV, what 
> are
> the main benefits of the project that you foresee?
> 

Virtual switching is the main bottleneck in NFV, so it is worth spending
extra effort on it. Using a VIM to configure the virtual switch leaves
the possibility that the configuration is non-optimal. Finally, it is
difficult to run a representative set of tests without VSPERF, since the
performance of a virtual switch can depend heavily on eg the number of
flows, number of source MACs/IPs, port numbers etc.

> 
> 3.   What are major gaps or features that you would like to see in
> VSPERF that are not there today?
> 

I think we all would like to know how much time a packet spends on the
NIC, in the vswitch, vNIC, VM, etc. Not sure if this is realistic.

> 
> 4.   Anything else?
> 
>  
> 
>  
> 
> Thanks
> 
>  
> 
> /Trevor
> 
>  
> 
>
> ___
> opnfv-tech-discuss mailing list
> opnfv-tech-discuss@lists.opnfv.org
> https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
> 
> 
> 

> ___
> opnfv-tech-discuss mailing list
> opnfv-tech-discuss@lists.opnfv.org
> https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-20 Thread Christo Kleu 
Comments inline
Note: some of these comments might already be outdated

Regards,
*Christo Kleu*

On Mon, Jun 19, 2017 at 6:22 PM, Cooper, Trevor 
wrote:

> I am collecting feedback about VSPERF from users and contributors … the
> main purpose is to help me motivate for our ongoing investment in the
> project. I already approached a few people … even if you have already given
> feedback feel free to add anything else.
>
>
>
> 1.   How do you use VSPERF or plan to use VSPERF?
>
Not currently using
Goal: use as tool to present offload benefits for Smart NIC


>
>
> 2.   Why do you think VSPERF is an important project in OPNFV, what
> are the main benefits of the project that you foresee?
>
1.
Assist in consistent testing methodology for OVS (as well as vocabulary for
testing scenarios!)
2.
Allow faster "hands-on" comparisons for people wanting to verify unbiased
test results
3.
Using an open-source tool, with open-source software traffic generators to
quickly setup and automate tests

>
>
> 3.   What are major gaps or features that you would like to see in
> VSPERF that are not there today?
>
1.
Smarts NIC support
2.
Tunneling: VXLAN, MPLSoGRE, MPLSoUDP (OpenStack options)
3.
>10G support
4.
Latency

>
>
> 4.   Anything else?
>
>
>
>
>
> Thanks
>
>
>
> /Trevor
>
>
>
> ___
> opnfv-tech-discuss mailing list
> opnfv-tech-discuss@lists.opnfv.org
> https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
>
>
___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-20 Thread Beierl, Mark 
Answers inline.

Regards,
Mark

Mark Beierl
SW System Sr Principal Engineer
Dell EMC | Office of the CTO
mobile +1 613 314 8106
mark.bei...@dell.com

On Jun 19, 2017, at 12:22, Cooper, Trevor 
mailto:trevor.coo...@intel.com>> wrote:

I am collecting feedback about VSPERF from users and contributors … the main 
purpose is to help me motivate for our ongoing investment in the project. I 
already approached a few people … even if you have already given feedback feel 
free to add anything else.


1.   How do you use VSPERF or plan to use VSPERF?

Do not currently use VSPERF.  Plan to use it to verify upcoming reference 
architectures for various platforms.

2.   Why do you think VSPERF is an important project in OPNFV, what are the 
main benefits of the project that you foresee?

Being able to independently quantify the overhead of switching, including being 
able to demonstrate the differences in acceleration technologies (i.e. DPDK, 
SR-IOV) is a key benefit for me in my plans for OpenStack architecture 
validation.

3.   What are major gaps or features that you would like to see in VSPERF 
that are not there today?



4.   Anything else?

At the risk of perhaps repeating what was talked about at the summit: I think 
starting to combing the different traffic and load testing projects to show 
stress points in a fully deployed system is something that is greatly needed.  
My simple example is running VSPERF and StorPerf at the same time.  Do the 
tenant and storage networks overlap, or is the system architected in a way to 
isolate them?  Does CPU load on a hypervisor (noisy neighbour) affect vswitch 
or storage performance, etc?



Thanks

/Trevor

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-20 Thread morgan.richomme 

Hi

see answers below

/Morgan

On 19/06/2017 18:22, Cooper, Trevor wrote:


I am collecting feedback about VSPERF from users and contributors … 
the main purpose is to help me motivate for our ongoing investment in 
the project. I already approached a few people … even if you have 
already given feedback feel free to add anything else.


1.How do you use VSPERF or plan to use VSPERF?


plan to use VSPERF to qualify vswitch in Orange Integration Center


2.Why do you think VSPERF is an important project in OPNFV, what are 
the main benefits of the project that you foresee?


vswitch is a key element of NFV and somehow a potential Achilles heel of 
such infrastructure.
It is us critical to qualify the performance of such component and to 
get reference on testing on other PODs.


3.What are major gaps or features that you would like to see in VSPERF 
that are not there today?


I would like to see a deeper integration with yardstick/test reporting 
in order to trigger vsperf as part of yardstick scenario and integrate 
vsperf figures as other infrastructure figures (sla, comparison with 
community results,..)
It should also be possible to use free software traffic generator (TRex) 
in order to ease the integratio in CI chains


4.Anything else?

Thanks

/Trevor



___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss



--
Morgan Richomme
Orange/ IMT/ OLN/ CNC/ NCA/ SINA

Network architect for innovative services
Future of the Network community member
Open source Orange community manager


tel. +33 (0) 296 072 106
mob. +33 (0) 637 753 326
morgan.richo...@orange.com


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

[opnfv-tech-discuss] [vsperf] Survey of VSPERF Users and Contributors

2017-06-19 Thread Cooper, Trevor 
I am collecting feedback about VSPERF from users and contributors ... the main 
purpose is to help me motivate for our ongoing investment in the project. I 
already approached a few people ... even if you have already given feedback 
feel free to add anything else.


1.   How do you use VSPERF or plan to use VSPERF?



2.   Why do you think VSPERF is an important project in OPNFV, what are the 
main benefits of the project that you foresee?



3.   What are major gaps or features that you would like to see in VSPERF 
that are not there today?



4.   Anything else?


Thanks

/Trevor

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss