Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
Thanks Morgan, Kubi. Something I missed is: Can I extract the results of yardstick based on the release Danube 1.0, 2.0,3.0 now ? Need not be a report rather various performance benchmarks of yardstick of a specific release. Please let me know. Thanks -Venkat From: Gaoliang (kubi) [mailto:jean.gaoli...@huawei.com] Sent: Monday, August 28, 2017 3:12 PM To: morgan.richo...@orange.com Cc: vven...@codeaurora.org; Lvjing (Jing Lu) <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org Subject: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Thanks Morgan . I’m clear about that now. Regards, Kubi 发件人: morgan.richo...@orange.com <mailto:morgan.richo...@orange.com> [mailto:morgan.richo...@orange.com] 发送时间: 2017年8月28日 15:47 收件人: Gaoliang (kubi) <jean.gaoli...@huawei.com <mailto:jean.gaoli...@huawei.com> > 抄送: vven...@codeaurora.org <mailto:vven...@codeaurora.org> ; Lvjing (Jing Lu) <lvji...@huawei.com <mailto:lvji...@huawei.com> >; opnfv-tech-discuss@lists.opnfv.org <mailto:opnfv-tech-discuss@lists.opnfv.org> ; opnfv-us...@lists.opnfv.org <mailto:opnfv-us...@lists.opnfv.org> 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? the trend line can cover a long period, it is based on the local file storing all the results but a trend line is associated with a scenario and the list of scenarios is built based on the results over the last 10 days that is why if there is no run since 10 days, we have an empty page In deed we have fortunately results for all the installers [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep compass |wc -L 57 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep fuel |wc -L 63 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep apex |wc -L 53 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep joid |wc -L 54 but last run on - compass: 28/8 - fuel: 11/8 - apex: 20/5 - joid: 3/8 The reporting page really reflects the CI activity, we could amend the reporting to consider all the scenarios stored in the local file rather than considering the scneario over the last 10 days...but empty pages mean something (no CI activity) In Euphrates we introduced the scenario in the test API. It is not used yet but it should replace the local file /Morgan On 28/08/2017 09:33, Gaoliang (kubi) wrote: "In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo" That's a best practice for reporting. We should followed that at E release :) By the way, Is it possible to show the Trend picture even if there is no data in last 10 days. we may don't need to see the score and status which are calculated by last 10 day's result but a trend from one or two month result for each scenario. Such as compass page, we can see the trend from April to August http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html Regards, Kubi -邮件原件- 发件人: opnfv-tech-discuss-boun...@lists.opnfv.org <mailto:opnfv-tech-discuss-boun...@lists.opnfv.org> [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] 代表 morgan.richo...@orange.com <mailto:morgan.richo...@orange.com> 发送时间: 2017年8月28日 14:47 收件人: vven...@codeaurora.org <mailto:vven...@codeaurora.org> ; Lvjing (Jing Lu) <mailto:lvji...@huawei.com> <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org <mailto:opnfv-tech-discuss@lists.opnfv.org> ; opnfv-us...@lists.opnfv.org <mailto:opnfv-us...@lists.opnfv.org> 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? regarding the reporting link, it always deals with a sliding windows processing the results from the last 10 days if no results since 10 days for the given version => no results so currently no Danube results, some runs on master => http://testresults.opnfv.org/reporting/yardstick/release/master/index-status-fuel.html In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo it is possible to rebuild the status assuming that we save the scores in a local files but it will be just a "release status" and it will not be as detailed as the first link you mentioned. /Morgan On 26/08/2017 09:46, vven...@codeaurora.org <mailto:vven...@codeaurora.org> wrote: And on the other hand, If I go to the below link it is showing empty, How can I get the result of each Yardstick result performnace numbers . Please help http://testresults.opnfv.org/reporting/yardstick/release/danube/index- status-fuel.html _ Ce message et ses pieces jointes peuvent contenir des informations confidenti
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
Thanks Morgan . I’m clear about that now. Regards, Kubi 发件人: morgan.richo...@orange.com [mailto:morgan.richo...@orange.com] 发送时间: 2017年8月28日 15:47 收件人: Gaoliang (kubi) <jean.gaoli...@huawei.com> 抄送: vven...@codeaurora.org; Lvjing (Jing Lu) <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? the trend line can cover a long period, it is based on the local file storing all the results but a trend line is associated with a scenario and the list of scenarios is built based on the results over the last 10 days that is why if there is no run since 10 days, we have an empty page In deed we have fortunately results for all the installers [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep compass |wc -L 57 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep fuel |wc -L 63 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep apex |wc -L 53 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep joid |wc -L 54 but last run on - compass: 28/8 - fuel: 11/8 - apex: 20/5 - joid: 3/8 The reporting page really reflects the CI activity, we could amend the reporting to consider all the scenarios stored in the local file rather than considering the scneario over the last 10 days...but empty pages mean something (no CI activity) In Euphrates we introduced the scenario in the test API. It is not used yet but it should replace the local file /Morgan On 28/08/2017 09:33, Gaoliang (kubi) wrote: "In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo" That's a best practice for reporting. We should followed that at E release :) By the way, Is it possible to show the Trend picture even if there is no data in last 10 days. we may don't need to see the score and status which are calculated by last 10 day's result but a trend from one or two month result for each scenario. Such as compass page, we can see the trend from April to August http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html Regards, Kubi -邮件原件- 发件人: opnfv-tech-discuss-boun...@lists.opnfv.org<mailto:opnfv-tech-discuss-boun...@lists.opnfv.org> [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] 代表 morgan.richo...@orange.com<mailto:morgan.richo...@orange.com> 发送时间: 2017年8月28日 14:47 收件人: vven...@codeaurora.org<mailto:vven...@codeaurora.org>; Lvjing (Jing Lu) <lvji...@huawei.com><mailto:lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>; opnfv-us...@lists.opnfv.org<mailto:opnfv-us...@lists.opnfv.org> 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? regarding the reporting link, it always deals with a sliding windows processing the results from the last 10 days if no results since 10 days for the given version => no results so currently no Danube results, some runs on master => http://testresults.opnfv.org/reporting/yardstick/release/master/index-status-fuel.html In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo it is possible to rebuild the status assuming that we save the scores in a local files but it will be just a "release status" and it will not be as detailed as the first link you mentioned. /Morgan On 26/08/2017 09:46, vven...@codeaurora.org<mailto:vven...@codeaurora.org> wrote: And on the other hand, If I go to the below link it is showing empty, How can I get the result of each Yardstick result performnace numbers . Please help http://testresults.opnfv.org/reporting/yardstick/release/danube/index- status-fuel.html _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. ___ opnfv-tech-discuss mailing list
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
the trend line can cover a long period, it is based on the local file storing all the results but a trend line is associated with a scenario and the list of scenarios is built based on the results over the last 10 days that is why if there is no run since 10 days, we have an empty page In deed we have fortunately results for all the installers [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep compass |wc -L 57 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep fuel |wc -L 63 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep apex |wc -L 53 [morgan@gce-opnfv-sandbox-fbrockners danube]$ cat scenario_history.txt |grep joid |wc -L 54 but last run on - compass: 28/8 - fuel: 11/8 - apex: 20/5 - joid: 3/8 The reporting page really reflects the CI activity, we could amend the reporting to consider all the scenarios stored in the local file rather than considering the scneario over the last 10 days...but empty pages mean something (no CI activity) In Euphrates we introduced the scenario in the test API. It is not used yet but it should replace the local file /Morgan On 28/08/2017 09:33, Gaoliang (kubi) wrote: "In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo" That's a best practice for reporting. We should followed that at E release :) By the way, Is it possible to show the Trend picture even if there is no data in last 10 days. we may don't need to see the score and status which are calculated by last 10 day's result but a trend from one or two month result for each scenario. Such as compass page, we can see the trend from April to August http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html Regards, Kubi -邮件原件- 发件人: opnfv-tech-discuss-boun...@lists.opnfv.org [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] 代表 morgan.richo...@orange.com 发送时间: 2017年8月28日 14:47 收件人: vven...@codeaurora.org; Lvjing (Jing Lu) <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? regarding the reporting link, it always deals with a sliding windows processing the results from the last 10 days if no results since 10 days for the given version => no results so currently no Danube results, some runs on master => http://testresults.opnfv.org/reporting/yardstick/release/master/index-status-fuel.html In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo it is possible to rebuild the status assuming that we save the scores in a local files but it will be just a "release status" and it will not be as detailed as the first link you mentioned. /Morgan On 26/08/2017 09:46, vven...@codeaurora.org wrote: And on the other hand, If I go to the below link it is showing empty, How can I get the result of each Yardstick result performnace numbers . Please help http://testresults.opnfv.org/reporting/yardstick/release/danube/index- status-fuel.html _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss -- Morgan Richomme Orange/ IMT/ OLN/ CNC/ NCA/ SINA Network architect for innovative services Future of the Network community member Open source Orange community manager tel. +33 (0) 296 072 106 mob. +33 (0) 637 753 326 morgan.richo...@orange.com _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
"In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo" That's a best practice for reporting. We should followed that at E release :) By the way, Is it possible to show the Trend picture even if there is no data in last 10 days. we may don't need to see the score and status which are calculated by last 10 day's result but a trend from one or two month result for each scenario. Such as compass page, we can see the trend from April to August http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-compass.html Regards, Kubi -邮件原件- 发件人: opnfv-tech-discuss-boun...@lists.opnfv.org [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] 代表 morgan.richo...@orange.com 发送时间: 2017年8月28日 14:47 收件人: vven...@codeaurora.org; Lvjing (Jing Lu) <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? regarding the reporting link, it always deals with a sliding windows processing the results from the last 10 days if no results since 10 days for the given version => no results so currently no Danube results, some runs on master => http://testresults.opnfv.org/reporting/yardstick/release/master/index-status-fuel.html In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo it is possible to rebuild the status assuming that we save the scores in a local files but it will be just a "release status" and it will not be as detailed as the first link you mentioned. /Morgan On 26/08/2017 09:46, vven...@codeaurora.org wrote: > And on the other hand, If I go to the below link it is showing empty, > How can I get the result of each Yardstick result performnace numbers > . Please help > http://testresults.opnfv.org/reporting/yardstick/release/danube/index- > status-fuel.html _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
regarding the reporting link, it always deals with a sliding windows processing the results from the last 10 days if no results since 10 days for the given version => no results so currently no Danube results, some runs on master => http://testresults.opnfv.org/reporting/yardstick/release/master/index-status-fuel.html In functest we save the status after each release (Danube 1.0, Danube2.0, Danube 3.0) in our repo it is possible to rebuild the status assuming that we save the scores in a local files but it will be just a "release status" and it will not be as detailed as the first link you mentioned. /Morgan On 26/08/2017 09:46, vven...@codeaurora.org wrote: And on the other hand, If I go to the below link it is showing empty, How can I get the result of each Yardstick result performnace numbers . Please help http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-fuel.html _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
Hi Venkat, The result of each Yardstick result performnace numbers are located at InfluxDB of community, You can view the data with the Grafana page. https://testresults.opnfv.org/grafana/dashboard/db/yardstick-tc005 (user/password: opnfv/opnfv) Tips: You can select the time range with the grafana page, June 18th to July 18th would be a good choice for Danube 3.0 [cid:image001.png@01D31FF5.03725730] [cid:image002.png@01D31FF5.72153F40] Meanwhile, you can select each test case with the grafana. [cid:image003.png@01D31FF6.3208CDD0] Regards, Kubi 发件人: opnfv-tech-discuss-boun...@lists.opnfv.org [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] 代表 vven...@codeaurora.org 发送时间: 2017年8月26日 15:47 收件人: Lvjing (Jing Lu) <lvji...@huawei.com>; opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Hi Jing Lu, Thanks for the reply. I was specifically looking for the detailed analysis of the test result done and the summary written like this. http://artifacts.opnfv.org/yardstick/colorado/docs/results/index.html#test-results-for-os-nosdn-nofeature-ha And on the other hand, If I go to the below link it is showing empty, How can I get the result of each Yardstick result performnace numbers . Please help http://testresults.opnfv.org/reporting/yardstick/release/danube/index-status-fuel.html Venkat From: Lvjing (Jing Lu) [mailto:lvji...@huawei.com] Sent: Saturday, August 26, 2017 12:57 PM To: vven...@codeaurora.org<mailto:vven...@codeaurora.org>; opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>; opnfv-us...@lists.opnfv.org<mailto:opnfv-us...@lists.opnfv.org> Subject: RE: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Hi, You can find it at: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/release/release-notes/release-notes.html#scenario-matrix regards, Jing Lu From: opnfv-tech-discuss-boun...@lists.opnfv.org<mailto:opnfv-tech-discuss-boun...@lists.opnfv.org> [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] On Behalf Of vven...@codeaurora.org<mailto:vven...@codeaurora.org> Sent: Saturday, August 26, 2017 3:05 PM To: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>; opnfv-us...@lists.opnfv.org<mailto:opnfv-us...@lists.opnfv.org> Subject: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Request you to please let me know. From: vven...@codeaurora.org<mailto:vven...@codeaurora.org> [mailto:vven...@codeaurora.org] Sent: Thursday, August 24, 2017 11:52 AM To: 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Hi, Request you to please point me to the report similar to below for Danube 3.0 on both x86 and arm pods? http://artifacts.opnfv.org/yardstick/colorado/docs/results/index.html Thanks -Venkat ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
Hi, You can find it at: http://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/release/release-notes/release-notes.html#scenario-matrix regards, Jing Lu From: opnfv-tech-discuss-boun...@lists.opnfv.org [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] On Behalf Of vven...@codeaurora.org Sent: Saturday, August 26, 2017 3:05 PM To: opnfv-tech-discuss@lists.opnfv.org; opnfv-us...@lists.opnfv.org Subject: Re: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Request you to please let me know. From: vven...@codeaurora.org<mailto:vven...@codeaurora.org> [mailto:vven...@codeaurora.org] Sent: Thursday, August 24, 2017 11:52 AM To: 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: [opnfv-tech-discuss] [yardstick] Yardstick Testresult Report??? Hi, Request you to please point me to the report similar to below for Danube 3.0 on both x86 and arm pods? http://artifacts.opnfv.org/yardstick/colorado/docs/results/index.html Thanks -Venkat ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
[opnfv-tech-discuss] [yardstick] Yardstick Testresult Report???
Hi, Request you to please point me to the report similar to below for Danube 3.0 on both x86 and arm pods? http://artifacts.opnfv.org/yardstick/colorado/docs/results/index.html Thanks -Venkat ___ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
