Re: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution

[Panagiotis Karalis]

Hello community,



In continuation of my previous email, I'd like to state that the first phase of 
the integration of dovetail tool with XCI installer is completed.

The dovetail tool is working properly on environment prepared by XCI installer.

The specific instructions for the proper installation of the dovetail tool with 
XCI installer have been pushed through new patch [1]

[the impact is on the documentation part of dovetail project].



Trying to execute the entire set of dovetail test cases, I have noticed that 
there are a lot of PASS and FAIL (almost 50% PASS-50% FAIL).

Hence, the next phase is to solve the issue(s) of the dovetail test scenarios 
which have been executed but not successfully.

Firstly, I have tried to collect those test cases along with a short 
description of the Error message(s).

Secondly, I'm trying to investigate further the aforementioned failures and 
find the proper solution for each of them.

Currently, I'm working on this task and on this jira ticket [2].



Of course, any support and help on that is more than welcome!



[1] https://gerrit.opnfv.org/gerrit/#/c/68088/

[2] https://jira.opnfv.org/browse/DOVETAIL-778



Have a nice day,

BR

Panos





From: opnfv-tech-discuss@lists.opnfv.org 
[mailto:opnfv-tech-discuss@lists.opnfv.org] On Behalf Of Panagiotis Karalis
Sent: Friday, June 21, 2019 6:07 PM
To: opnfv-tech-discuss@lists.opnfv.org
Cc: dmcbr...@linuxfoundation.org; fatih.degirme...@est.tech
Subject: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution



Hi all,



After my first attempt, which was not so succeed [1], I tried something 
different and using a proper approach.

I've deployed from scratch the XCI installer, having as XCI scenario 
os-nosdn-nofeature-noha.



The results of those tests were much better:



1-  The test scenarios which are related to the healthcheck suite, are run 
properly using the opnfv/functest-healthcheck image (attached logs).

2-  Whatever I have tried from custom tempest test scenarios which are 
related to the opnfv/functest-smoke image, are run properly (attached logs).



The investigation for the rest categories of test scenarios is in progress.

I have uploaded a patch with the impact on dovetail.

The patch is in progress, nothing stable yet.



[1] XCI scenario = os-odl-sfc-noha and executing the SFC test cases (attached 
email)



Have a nice weekend!

BR

Panos





Panagiotis Karalis
Software Engineer

SDN/NFV Team
__
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t:   +30 2106671499
 <mailto:pkara...@intracom-telecom.com> pkara...@intracom-telecom.com
 <http://www.intracom-telecom.com/> www.intracom-telecom.com



















JOIN US

MWC Shanghai

26-28 June
Shanghai, China



GITEX Technology Week

6-10 October

Dubai, UAE



MWC Los Angeles

22-24 October

Los Angeles, USA



Futurecom

28-31 October
Sao Paulo, Brazil



AfricaCom

12-14 November
Cape Town, South Africa



MWC Barcelona

24-27 February 2020

Barcelona, Spain



The information in this e-mail message and any attachments are intended only 
for the individual or entity to whom it is addressed and may be confidential. 
If you have received this transmission in error, and you are not an intended 
recipient, be aware that any copying, disclosure, distribution or use of this 
transmission or its contents is prohibited. Intracom Telecom and the sender 
accept no liability for any loss, disruption or damage to your data or computer 
system that may occur while using data contained in, or transmitted with, this 
email. Views or opinions expressed in this message may be those of the author 
and may not necessarily represent those of Intracom Telecom.





-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#23321): 
https://lists.opnfv.org/g/opnfv-tech-discuss/message/23321
Mute This Topic: https://lists.opnfv.org/mt/32159327/21656
Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org
Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution

[Panagiotis Karalis]

Hi Georg,



To be frank, I have not checked this yet. I have focused to integration of 
Dovetail with XCI.

Analyzing further the results of those tests, I'd like to mention that those 
results are the same even if those tests are run through dovetail tool on XCI 
or those tests are run through directly on XCI.



The overall result is FAIL due to those skipped test cases.

This is matter of dovetail tool and this is a normal behavior of dovetail tool 
(only if every sub-testcase is pass, the overall verdict is pass).



I'll let you know for any new finding.

BR

Panos





From: opnfv-tech-discuss@lists.opnfv.org 
[mailto:opnfv-tech-discuss@lists.opnfv.org] On Behalf Of Georg Kunz
Sent: Saturday, June 22, 2019 10:53 PM
To: Panagiotis Karalis ; 
opnfv-tech-discuss@lists.opnfv.org
Subject: Re: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution



Hi Panos,



Thanks for sharing your results and pushing a corresponding patch for Dovetail.



One question: in the tempest compute run, two test cases were skipped. Both are 
related to boot-from-volume operations. Any idea why they were skipped? Is 
Cinder available?



Best regards

Georg



From: opnfv-tech-discuss@lists.opnfv.org 
<mailto:opnfv-tech-discuss@lists.opnfv.org>  
mailto:opnfv-tech-discuss@lists.opnfv.org> 
> On Behalf Of Panagiotis Karalis via Lists.Opnfv.Org
Sent: Friday, June 21, 2019 5:07 PM
To: opnfv-tech-discuss@lists.opnfv.org 
<mailto:opnfv-tech-discuss@lists.opnfv.org>
Cc: opnfv-tech-discuss@lists.opnfv.org 
<mailto:opnfv-tech-discuss@lists.opnfv.org>
Subject: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution



Hi all,



After my first attempt, which was not so succeed [1], I tried something 
different and using a proper approach.

I've deployed from scratch the XCI installer, having as XCI scenario 
os-nosdn-nofeature-noha.



The results of those tests were much better:



1-  The test scenarios which are related to the healthcheck suite, are run 
properly using the opnfv/functest-healthcheck image (attached logs).

2-  Whatever I have tried from custom tempest test scenarios which are 
related to the opnfv/functest-smoke image, are run properly (attached logs).



The investigation for the rest categories of test scenarios is in progress.

I have uploaded a patch with the impact on dovetail.

The patch is in progress, nothing stable yet.



[1] XCI scenario = os-odl-sfc-noha and executing the SFC test cases (attached 
email)



Have a nice weekend!

BR

Panos





Panagiotis Karalis
Software Engineer

SDN/NFV Team
__
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t:   +30 2106671499
 <mailto:pkara...@intracom-telecom.com> pkara...@intracom-telecom.com
 <http://www.intracom-telecom.com/> www.intracom-telecom.com



















JOIN US

MWC Shanghai

26-28 June
Shanghai, China



GITEX Technology Week

6-10 October

Dubai, UAE



MWC Los Angeles

22-24 October

Los Angeles, USA



Futurecom

28-31 October
Sao Paulo, Brazil



AfricaCom

12-14 November
Cape Town, South Africa



MWC Barcelona

24-27 February 2020

Barcelona, Spain



The information in this e-mail message and any attachments are intended only 
for the individual or entity to whom it is addressed and may be confidential. 
If you have received this transmission in error, and you are not an intended 
recipient, be aware that any copying, disclosure, distribution or use of this 
transmission or its contents is prohibited. Intracom Telecom and the sender 
accept no liability for any loss, disruption or damage to your data or computer 
system that may occur while using data contained in, or transmitted with, this 
email. Views or opinions expressed in this message may be those of the author 
and may not necessarily represent those of Intracom Telecom.





-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#23273): 
https://lists.opnfv.org/g/opnfv-tech-discuss/message/23273
Mute This Topic: https://lists.opnfv.org/mt/32159327/21656
Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org
Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution

[Georg Kunz]

Hi Panos,

Thanks for sharing your results and pushing a corresponding patch for Dovetail.

One question: in the tempest compute run, two test cases were skipped. Both are 
related to boot-from-volume operations. Any idea why they were skipped? Is 
Cinder available?

Best regards
Georg

From: opnfv-tech-discuss@lists.opnfv.org  
On Behalf Of Panagiotis Karalis via Lists.Opnfv.Org
Sent: Friday, June 21, 2019 5:07 PM
To: opnfv-tech-discuss@lists.opnfv.org
Cc: opnfv-tech-discuss@lists.opnfv.org
Subject: [opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution

Hi all,

After my first attempt, which was not so succeed [1], I tried something 
different and using a proper approach.
I've deployed from scratch the XCI installer, having as XCI scenario 
os-nosdn-nofeature-noha.

The results of those tests were much better:


  1.  The test scenarios which are related to the healthcheck suite, are run 
properly using the opnfv/functest-healthcheck image (attached logs).
  2.  Whatever I have tried from custom tempest test scenarios which are 
related to the opnfv/functest-smoke image, are run properly (attached logs).

The investigation for the rest categories of test scenarios is in progress.
I have uploaded a patch with the impact on dovetail.
The patch is in progress, nothing stable yet.

[1] XCI scenario = os-odl-sfc-noha and executing the SFC test cases (attached 
email)

Have a nice weekend!
BR
Panos


Panagiotis Karalis
Software Engineer
SDN/NFV Team
__
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t:   +30 2106671499
pkara...@intracom-telecom.com<mailto:pkara...@intracom-telecom.com>
www.intracom-telecom.com<http://www.intracom-telecom.com/>








JOIN US
MWC Shanghai
26-28 June
Shanghai, China

GITEX Technology Week
6-10 October
Dubai, UAE

MWC Los Angeles
22-24 October
Los Angeles, USA

Futurecom
28-31 October
Sao Paulo, Brazil

AfricaCom
12-14 November
Cape Town, South Africa

MWC Barcelona
24-27 February 2020
Barcelona, Spain

The information in this e-mail message and any attachments are intended only 
for the individual or entity to whom it is addressed and may be confidential. 
If you have received this transmission in error, and you are not an intended 
recipient, be aware that any copying, disclosure, distribution or use of this 
transmission or its contents is prohibited. Intracom Telecom and the sender 
accept no liability for any loss, disruption or damage to your data or computer 
system that may occur while using data contained in, or transmitted with, this 
email. Views or opinions expressed in this message may be those of the author 
and may not necessarily represent those of Intracom Telecom.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#23272): 
https://lists.opnfv.org/g/opnfv-tech-discuss/message/23272
Mute This Topic: https://lists.opnfv.org/mt/32159327/21656
Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org
Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[opnfv-tech-discuss] DOVETAIL + XCI , Successful Execution

[Panagiotis Karalis]

Hi all,



After my first attempt, which was not so succeed [1], I tried something 
different and using a proper approach.

I've deployed from scratch the XCI installer, having as XCI scenario 
os-nosdn-nofeature-noha.



The results of those tests were much better:



1-  The test scenarios which are related to the healthcheck suite, are run 
properly using the opnfv/functest-healthcheck image (attached logs).

2-  Whatever I have tried from custom tempest test scenarios which are 
related to the opnfv/functest-smoke image, are run properly (attached logs).



The investigation for the rest categories of test scenarios is in progress.

I have uploaded a patch with the impact on dovetail.

The patch is in progress, nothing stable yet.



[1] XCI scenario = os-odl-sfc-noha and executing the SFC test cases (attached 
email)



Have a nice weekend!

BR

Panos





Panagiotis Karalis
Software Engineer

SDN/NFV Team
__
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t:   +30 2106671499
  pkara...@intracom-telecom.com
  www.intracom-telecom.com



















JOIN US

MWC Shanghai

26-28 June
Shanghai, China



GITEX Technology Week

6-10 October

Dubai, UAE



MWC Los Angeles

22-24 October

Los Angeles, USA



Futurecom

28-31 October
Sao Paulo, Brazil



AfricaCom

12-14 November
Cape Town, South Africa



MWC Barcelona

24-27 February 2020

Barcelona, Spain



The information in this e-mail message and any attachments are intended only 
for the individual or entity to whom it is addressed and may be confidential. 
If you have received this transmission in error, and you are not an intended 
recipient, be aware that any copying, disclosure, distribution or use of this 
transmission or its contents is prohibited. Intracom Telecom and the sender 
accept no liability for any loss, disruption or damage to your data or computer 
system that may occur while using data contained in, or transmitted with, this 
email. Views or opinions expressed in this message may be those of the author 
and may not necessarily represent those of Intracom Telecom.





--- Begin Message ---
Hi all,



After an initiative, I've started with a first attempt to introduce the XCI in 
the dovetail and as I promised to David,

I' m sending you this email with my progress so far.

Specifically, I tried to deployed the dovetail on XCI installer and run TCs 
through dovetail tool.



XCI details:

-  OS: Ubuntu (check the rest requirements [1])

-  Flavor: mini (for more details [1])

-  Deploy Scenario: os-odl-sfc-noha and follow the rest instructions 
for SFC deployment with XCI [2]

Waiting until  the XCI deployment is completed.



After that, the dovetail tool installation takes place following  the relevant 
instructions from UG [3] in OPNFV VM of XCI (ssh root@192.168.122.2 
 ).



My first action was to verify that the containers which have been downloaded 
via dovetail project were run properly.

So, using the functest-features:gambia container , I was trying to run 
different test scenarios.

At this point, I noticed that the only scenario that was running properly (for 
my configuration setup and environment) was the SFC test cases.



After that I tried to run the same scenario through dovetail:

-  I prepared a patch in order to trigger this scenario [4].

-  I prepared the env_config.sh and pod.yaml files according to the XCI 
topology and configuration

-  I added in the 'env_config.sh' of dovetail the following parameters

o   DEPLOY_SCENARIO=os-odl-sfc-noha

o   INSTALLER_TYPE=osa

o   INSTALLER_IP=192.168.122.2

o   EXTERNAL_NETWORK=ext-net



The result was partially successfully.

The test scenario has been started and the OS components are created 
successfully (like routes, networks  etc).

At the end, I got an error which seems more or less related to my environment.

As far as I remember, I got the same error when I tried to run the SFC test 
case directly through functest-features:gambia



Another alternative that I tried after the aforementioned results



I used the patch [5] changing the relationship between the SFC test cases and 
the XCI installer.

[This patch makes the SFC TCs independently from each installer, so the 
information like the server's IP is fetched directly from a yaml file that 
prepared by user or by dovetail (the pod.yaml in our case)]  and not by 
installer.



Using this patch, I have skipped the step to add the above parameters in the 
environment file (env_config.sh), since this information is retrieved directly 
from pod.yaml which is copied in the container from dovetail.



BUT the important thing is that the results are much better.



The investigation is in progress! :)



Let me know if there are questions / comments about the above steps or results.

Moreover, If someone have