Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2017-01-04 Thread Yujun Zhang 
I'm glad that we are pulling this discussion back to technical track.

Some additional comments about QTIP inline.

On Thu, Jan 5, 2017 at 7:09 AM Cooper, Trevor 
wrote:

I am glad we will discuss this in the Test Working Group meeting tomorrow …
the testing projects have evolved quite a bit since the first plugfest. We
should evolve wherever possible to normalize and avoid duplication BUT also
give projects autonomy they deserve to decide their interests and drive
their objectives. This seems to be what is emerging?



Functional testing

VIM + NFVI -> Functest

MANO -> ?

Compliance -> Dovetail



Performance testing

NFVI (+ VNF) characterization -> Yardstick

Compute, memory, storage sub-system (platform) performance -> Qtip


This is the major application of QTIP. A synthesis evaluation of platform
performance by benchmarking test.

As a companion delivery, QTIP is also developing a platform for performance
benchmarking, including common utility modules, base templates and
benchmark result sharing (possibly on opnfv testresult site)

Data-plane performance (switching technology, virtual and physical
networks) -> VSPERF

Storage performance -> Storperf

Controller performance -> CPerf

Performance trend analysis -> Bottleneck

/Trevor



*From:* Yujun Zhang [mailto:zhangyujun+...@gmail.com]
*Sent:* Wednesday, December 21, 2016 6:36 AM
*To:* Gaoliang (kubi) ; test-wg <
test...@lists.opnfv.org>
*Cc:* TECH-DISCUSS OPNFV ; Morgan
Richomme (morgan.richo...@orange.com) ; Jose
Lausuch ; Cooper, Trevor ;
mark.bei...@emc.com; Yuyang (Gabriel) 
*Subject:* Re: [test-wg] [all] TestPerf EcoSystem diagram now editable



Thanks for the detail explanation. As many test-wg members are on holiday,
I think we may not able to arrive at a consensus on the process soon.



The modification is actually not affecting any other projects but yardstick
and QTIP. It reflects my understanding of QTIP projects, for the past and
also for the future. And I didn't see any objection on the modification
content (not the process) in the past week. Reverting it to previous
version will mislead the community.



So I would like to keep the modified version unless we have a scope change
requested from the working group and approved by TSC. Do you think it will
work?



We may discuss about process in testperf meeting. But to my understanding,
community wiki is open for editing unless locked. This is a way to show
open spirit and improve efficiency. Of course that people who abuse this
right shall be banned. My two cents.



On Wed, Dec 21, 2016 at 4:50 PM Gaoliang (kubi) 
wrote:

Hi Yujun,

To my knowledge, the Draft Testperf Ecosystem Diagram was discussed and
published at the first plugfest. Its orientation is to avoid overlap works
between our testing projects and also to reflect the relations. Then after
a lot of discussion within the community which leads to common consensus,
the Diagram was updated during the OPNFV Berlin Summit (please refer to the
presentation "Conversation with the Testing community"[1]).

Now, the Updated Diagram has been published in WIKI page for 6 months and
perceived stable community-wide. I believe if some modifications of the
Diagram are expected, we should discuss first, then we do the changes.
After all, we are working as a community.

In addition, since any change to the Diagram may result in different
relations between our testing projects, direct changes to the original
Diagram will make things more complicated. It's better to have our
discussion based on the summit version of our Testperf Ecosystem Diagram
for changes.

I'd like to work together with you to improve the modification process and
keeping things in order. For this purpose, I would like help add a topic in
the Testperf Weekly Meeting. I believe we can make further progress
together!

 [1]
https://gerrit.opnfv.org/gerrit/gitweb?p=functest.git;a=blob;f=docs/com/img/OPNFV_testing_group.png;h=4b8c2c053e0143b1a9abc7e54fd9e7671ccfcee8;hb=HEAD

Thanks,

Kubi





*发件人**:* Yujun Zhang [mailto:zhangyujun+...@gmail.com]

*发送时间**:* 2016年12月16日 16:43

*收件人**:* Gaoliang (kubi); test-wg
*抄送**:* TECH-DISCUSS OPNFV; Morgan Richomme (morgan.richo...@orange.com);
Jose Lausuch; trevor.coo...@intel.com; mark.bei...@emc.com; Yuyang (Gabriel)
*主**题**:* Re: [test-wg] [all] TestPerf EcoSystem diagram now editable



See my replies inline.

On Fri, Dec 16, 2016 at 3:43 PM Gaoliang (kubi) 
wrote:

Hi Yujun,

 Thanks for  your timely reply!



First, it is a very praiseworthy effort of you on making the diagram
editable!

What I concerned is the process of  the modification of the Testperf
Ecosystem Diagram. As you know, Testperf Ecosystem Diagram is not only to
show what the one project will do , but also the relationship

Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2016-12-16 Thread Yujun Zhang 
See my replies inline.

On Fri, Dec 16, 2016 at 3:43 PM Gaoliang (kubi) 
wrote:

> Hi Yujun,
>
>
>
>  it may delivers misleading information to the whole community.
>

This is exactly my motivation of the modification.

I hope we can find out the original agreement so we can know why it is
delivering a misleading message and we can work together to improve the
process to keep things in order.
___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2016-12-15 Thread Yujun Zhang 
Hi Kubi

Could you remind me record of the previous agreement? I may not be member
of QTIP project at that moment.

I made some correction on QTIP to make it closer to facts. Comments are
welcome.
Gaoliang (kubi) 于2016年12月15日 周四22:20写道：

> Hi Yunjun,
>
>
>
> Thanks for your work to make the TestPerf Ecosystem image editable. But I
> ‘m a little confused with the rule of the TestPerf EcoSystem Diagram
> modification.
>
> It seems that you have modified the  TestPerf Ecosystem structure.  I ‘m
> not sure if it is a good way to modify the Ecosystem Diagram without
> agreement of whole testing community.
>
> All the performance test projects are involved in Benchmark area. I guess
> what Qtip want to do is to calculate the score from the Yardstick test
> result. So I guess we still need to have a discussion with test projects
> about the structure and the key words of each area. Thanks.
>
>
>
> Regards,
>
> Kubi
>
>
>
> *发件人:* test-wg-boun...@lists.opnfv.org [mailto:
> test-wg-boun...@lists.opnfv.org] *代表 *Yujun Zhang
> *发送时间:* 2016年12月15日 21:05
> *收件人:* test-wg
> *抄送:* TECH-DISCUSS OPNFV
> *主题:* [test-wg] [all] TestPerf EcoSystem diagram now editable
>
>
>
> Hi testers,
>
>
>
> I have replaced the previous image of TestPerf EcoSystem with an editable
> diagram in the overview section of testperf wiki page[1]. Please review and
> amend if something is missing.
>
>
>
> https://wiki.opnfv.org/display/testing/TestPerf
>
___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2016-12-15 Thread Gaoliang (kubi) 
Hi Yunjun,

Thanks for your work to make the TestPerf Ecosystem image editable. But I ‘m a 
little confused with the rule of the TestPerf EcoSystem Diagram modification.
It seems that you have modified the  TestPerf Ecosystem structure.  I ‘m not 
sure if it is a good way to modify the Ecosystem Diagram without agreement of 
whole testing community.
All the performance test projects are involved in Benchmark area. I guess what 
Qtip want to do is to calculate the score from the Yardstick test result. So I 
guess we still need to have a discussion with test projects about the structure 
and the key words of each area. Thanks.

Regards,
Kubi

发件人: test-wg-boun...@lists.opnfv.org [mailto:test-wg-boun...@lists.opnfv.org] 
代表 Yujun Zhang
发送时间: 2016年12月15日 21:05
收件人: test-wg
抄送: TECH-DISCUSS OPNFV
主题: [test-wg] [all] TestPerf EcoSystem diagram now editable

Hi testers,

I have replaced the previous image of TestPerf EcoSystem with an editable 
diagram in the overview section of testperf wiki page[1]. Please review and 
amend if something is missing.

https://wiki.opnfv.org/display/testing/TestPerf
___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2016-12-15 Thread morgan.richomme 
cool
thanks Yujun

Le 15/12/2016 à 14:05, Yujun Zhang a écrit :
> Hi testers,
>
> I have replaced the previous image of TestPerf EcoSystem with an
> editable diagram in the overview section of testperf wiki page[1].
> Please review and amend if something is missing.
>
> https://wiki.opnfv.org/display/testing/TestPerf 
>
>
> ___
> test-wg mailing list
> test...@lists.opnfv.org
> https://lists.opnfv.org/mailman/listinfo/test-wg


-- 
Morgan Richomme
Orange/ IMT/ OLN/ CNC/ NCA/ SINA 

Network architect for innovative services
Future of the Network community member
Open source Orange community manager


tel. +33 (0) 296 072 106
mob. +33 (0) 637 753 326
morgan.richo...@orange.com


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Re: [opnfv-tech-discuss] [test-wg] [all] TestPerf EcoSystem diagram now editable

2016-12-15 Thread Jose Lausuch 
Hi Yujun,

That looks good. It’s a great idea to have diagrams and pictures editable so 
that we can change it when we see the need.
Maybe we should apply the same for the other pictures/graphs.

Thanks,
Jose

From: test-wg-boun...@lists.opnfv.org [mailto:test-wg-boun...@lists.opnfv.org] 
On Behalf Of Yujun Zhang
Sent: Thursday, December 15, 2016 14:05 PM
To: test-wg
Cc: TECH-DISCUSS OPNFV
Subject: [test-wg] [all] TestPerf EcoSystem diagram now editable

Hi testers,

I have replaced the previous image of TestPerf EcoSystem with an editable 
diagram in the overview section of testperf wiki page[1]. Please review and 
amend if something is missing.

https://wiki.opnfv.org/display/testing/TestPerf
___
opnfv-tech-discuss mailing list
opnfv-tech-discuss@lists.opnfv.org
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss