Re: [onap-discuss] Robot ./demo-k8s.sh issue

[Morgan Richomme]

Hi

I got the same issue
values.yaml is correct
robot is a priori well configured as I can run ./e2e-k8s.sh onap health without 
problems.

I wonder if the trace would not be misleading and if there is no call to 
Keystone v2 API to create resources on the OpenStack.
As my OpenStack is based on Queens,Keystone v2 is no more supported.
We put in place a wrapper for the SO but not for Robot.

[cid:9e57d42f670040f2356603c3379b5707b71f6a9c.camel@orange.com]
/Morgan


Le mardi 04 décembre 2018 à 09:42 +, Sangeeth G a écrit :
Hi David,

I did modified the values.yaml to point to correct keystone url and network and 
tenant id etc., in the /oom/kubernetes/robot and still I get the same error.

Best Regards,
Sangeeth G

From: Pérez Caparrós David, INI-EAI-INO-COW 
Sent: Tuesday, December 4, 2018 2:52 PM
To: Sangeeth G 
Cc: onap-discuss@lists.onap.org
Subject: Re: [onap-discuss] Robot ./demo-k8s.sh issue

Hi,

it seems that there is a problem with your robot config, e.g. 
openStackKeyStoneUrl. Check values.yaml under oom/kubernetes/robot

David

--
David Pérez Caparrós
Senior Innovation Engineer
Swisscom (Switzerland)
david.perezcapar...@swisscom.com


On 4 Dec 2018, at 10:14, Sangeeth G 
mailto:sg00542...@techmahindra.com>> wrote:

Hi Team,

When I run ./demo-k8s.sh onap init, I get the below error on OOM Beijing . Can 
you please suggest on the same to overcome this issue.

Executing robot tests at log level TRACE
==
OpenECOMP ETE
==
OpenECOMP ETE.Robot
==
OpenECOMP ETE.Robot.Testsuites
==
OpenECOMP ETE.Robot.Testsuites.Demo :: Executes the VNF Orchestration Test ...
==
Initialize Customer And Models| FAIL |
ConnectionError: HTTPConnectionPool(host='1.2.3.4', port=5000): Max retries 
exceeded with url: /v2.0/tokens (Caused by 
NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection 
timed out',))
--
OpenECOMP ETE.Robot.Testsuites.Demo :: Executes the VNF Orchestrat... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==
OpenECOMP ETE.Robot.Testsuites| FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed

Best Regards,
Sangeeth G

Disclaimer:  This message and the information contained herein is proprietary 
and confidential and subject to the Tech Mahindra policy statement, you may 
review the policy at http://www.techmahindra.com/Disclaimer.html externally 
http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra.




_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14242): https://lists.onap.org/g/onap-discuss/message/14242
Mute This Topic: https://lists.onap.org/mt/28580947/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [LFN][Certification] LFN certification, Dovetail & ONAP VVP portal integration

[Morgan Richomme]

Hi Dovetail team,

the ONAP VVP team 
(https://wiki.onap.org/display/DW/VNF+Validation+Program+Proposals) initiated 
some Epics for the next ONAP release Dublin (Code freeze end of March 2019).
One of them deals with a VVP-Portal: https://wiki.onap.org/display/DW/VVP-Web
VVP consists in a suite of rules to validate the VNF heat templates for ONAP, 
VVP-Portal offers a web interface to self test the heat templates.

There were some discussions on the integration of VNF packaging checks for next 
Dovetail release initiated by Chris Donley before he left.
I imagine that it could be possible to include an instance of VVP-WEB portal in 
OVP portal https://verified.opnfv.org/
There is already a rich up prototype developed by Vincent.

The goal would be similar than for the infrastructure verification:
- allow VNF providers/Service Providers to upload their VNF heat templates
- provide feedback from VVP (Ice validator scripts maintained by VVP team)
- If VNF provider agree => add the VNF on a public page to reference the VNF 
that passed successfully VVP.

Reusing the existing web site will allo to leverage LF authentication, artifact 
management & integrity that you already put in place for the infrastructure 
tests.

Could it be possible that some people from Dovetail join the next VVP meeting 
(Tuesday 4th of December 4PM UTC - details below) to see the right way to 
integrate VVP portal behind verified.opnfv.org (that could be renamed 
verified.lfnetworking.org)
I do not know if some of you planned to participate to the Plugfest beginning 
of January, it could be a good occasion to work concretely on this integration.

Thanks & Regards

Morgan

-
ONAP4 https://zoom.us/j/646674417
iPhone one-tap : US: +16699006833,,646674417# or +16465588656,,646674417# Or 
Telephone: US: +1 669 900 6833 or +1 646 558 8656 or +1 877 369 0926 (Toll 
Free) or +1 855 880 1246 (Toll Free)   *  Meeting ID: 646 674 417* 
International numbers available: 
https://zoom.us/zoomconference?m=IFAJmsDj4DoepDnWL5SqnDJSSz5Wzav_ ( 
https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fzoomconference%3Fm%3DIFAJmsDj4DoepDnWL5SqnDJSSz5Wzav_=D=1541515409058000=AFQjCNEHrYQSaJh9L50nPSJfeCC6bpMxkw
 )
5:00 PM - 6:00 PM

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14102): https://lists.onap.org/g/onap-discuss/message/14102
Mute This Topic: https://lists.onap.org/mt/28373067/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [Openlab] [VID] [Beijing] how to restart the VID

[Morgan Richomme]

Hi

on the Orange Openlab, we are facing some issue with the VID (beijing version 
installed with OOM)

users reported that there was an error when trying to instantiate from the 
models (Browse SDC Service Models menu), an errors was displayed
"Status: Error: Failed to get service models from SDC"

We checked that the SDC and the A were still responding when calling the 
APIs.

On the system, we were able to see
debian@control01-openlab:~$ kubectl get po -n 
onap |grep vid
onap-vid-54fc55cb99-hdgw62/2   Running0 
 5d
onap-vid-mariadb-galera-01/1   Running0 
 5d

when connecting on the vid docker in /var/log/onap/vid, we were able to see 
some java exceptions in error.log

com.fasterxml.jackson.databind.JsonMappingException: No content to map due to 
end-of-input
 at [Source: ; line: 1, column: 0]
at 
com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
at 
com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:3781)
at 
com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3721)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2745)
at 
org.onap.portalsdk.core.restful.client.SharedContextRestClient.getUserContext(SharedContextRestClient.java:141)
at 
org.onap.portalapp.controller.core.MenuListController.getUserInfo(MenuListController.java:202)
at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
...
rg.onap.portalsdk.core.exception.SessionExpiredException: Your session has 
expired. Please login again.
at org.onap.portalsdk.core.web.support.AppUtils.getSession(AppUtils.java:80)
at 
org.onap.portalsdk.core.web.support.UserUtils.getUserSession(UserUtils.java:176)
at 
org.onap.portalsdk.core.logging.logic.EELFLoggerDelegate.setRequestBasedDefaultsIntoGlobalLoggingContext(EELFLoggerDelegate.java:491)
at 
org.onap.portalsdk.core.controller.FusionBaseController.getMenu(FusionBaseController.java:91)
at sun.reflect.GeneratedMethodAccessor118.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
...

so I decided to delete the pod
the pod was deleted but ... not recreated
we now have only the galera part
kubectl get po -n onap |grep vid
onap-vid-mariadb-galera-01/1   Running0 
 6d

the deployment is still there
kubectl describe deployment onap-vid -n onap
Name:   onap-vid
Namespace:  onap
CreationTimestamp:  Thu, 15 Nov 2018 08:08:16 +
Labels: app=vid
chart=vid-2.0.0
heritage=Tiller
release=onap
Annotations:deployment.kubernetes.io/revision=1
Selector:   app=vid,release=onap
Replicas:   1 desired | 1 updated | 1 total | 1 available | 0 
unavailable
StrategyType:   RollingUpdate
MinReadySeconds:0
RollingUpdateStrategy:  1 max unavailable, 1 max surge
Pod Template:
  Labels:  app=vid
   release=onap
  Init Containers:kubectl get rs -n onap |grep vid
onap-vid-54fc55cb990 1 1 6d
  vid-readiness:
Image:  oomk8s/readiness-check:1.0.0
Port:   
Command:
  python
Args:
  /tmp/vid-check-job-completion/vid_check_job_completion.py
  --job-name
  vid-config-galera
Environment:
  NAMESPACE:   (v1:metadata.namespace)
Mounts:
  /tmp/vid-check-job-completion from vid-check-job-completion (rw)
  Containers:
   vid:
Image:  nexus.openlab.onap.eu/onap/vid:2.0.0
Port:   8080/TCP
Liveness:   tcp-socket :8080 delay=10s timeout=1s period=10s #success=1 
#failure=3
Readiness:  tcp-socket :8080 delay=10s timeout=1s period=10s #success=1 
#failure=3
Environment:
  ASDC_CLIENT_REST_HOST:  sdc-be.onap
  ASDC_CLIENT_REST_AUTH:  Basic 
dmlkOktwOGJKNFNYc3pNMFdYbGhhazNlSGxjc2UyZ0F3ODR2YW9HR21KdlV5MlU=
  ASDC_CLIENT_REST_PORT:  8080
  VID_AAI_HOST:   aai.onap
  VID_AAI_PORT:   8443
  VID_ECOMP_SHARED_CONTEXT_REST_URL:  
http://portal-app.onap:8989/ONAPPORTAL/context
  VID_MSO_SERVER_URL: http://so.onap:8080
  VID_MSO_PASS:   
OBF:1ih71i271vny1yf41ymf1ylz1yf21vn41hzj1icz
  MSO_DME2_SERVER_URL:http://localhost:8081
  MSO_DME2_ENABLED:
  VID_ECOMP_REDIRECT_URL: 
http://portal-app.onap:8989/ONAPPORTAL/login.htm
  VID_ECOMP_REST_URL: 
http://portal-app.onap:8989/ONAPPORTAL/auxapi
  VID_CONTACT_US_LINK:https://todo_contact_us_link.com
  

Re: [onap-discuss] Orange ONAP openlab no more responding

[Morgan Richomme]

Hi,

the Orange ONAP Openlab reinstallation is completed.
We reinstalled it in Beijing version and will upgrade in Casablanca in December.

I re-initially pushed all the SSH keys on Tuesday (our automation procedures 
are now quiete efficient) but if all the healthcheck tests were OK, it was not 
possible to deploy a VNFs..
This problem was detected using our xtesting-onap-vnf use cases.
The cause was identified: the behavior of our keystone wrapper (as our 
OpenStack is based on Queens, keystone v2 is no more supported) changed. It was 
still trying to deal with Keystone v2.
This was fixed, then the SDNC listener had to be restarted before running 
successfully the tests.
To be sure we reinstalled the ONAP beijing last night with the fix and re-tried 
the healthcheck then the xtesting onap tests with success this morning (CET).

You should now be able to connect to the jumphost.

Lessons learned:
- the platform (ONAP Beijing installed with OOM) has been relatively stable 
since September (some module restarts needed time to time but no deadlock)
- we moved from 2.0.0 to Beijing tag and got the GUI for the AA (always got a 
503 so far)
- the critical power outage (long duration time outage with finally power 
interuption during a week where most of our small team were in PTO) triggered 
severe damages on our discs ... and by consequence on our Ceph cluster.
We cumulated different problems when re-powering up the system (Cassandra and 
Ceph are not the best friends...) but were able after several operations on 
discs to recover the cluster.
However most of the ONAP DB were corrupted. That is why it was decided to 
redeploy ONAP (we did not reinstall the whole infrastructure, only rancher + 
ONAP).
Enjoy testing

Regards

Morgan

NB:
traces
healthcheck
2018-11-15 09:42:59,470 - xtesting.ci.run_tests - INFO - Xtesting report:

+---+--+--+--++
| TEST CASE | PROJECT  | TIER | DURATION
 | RESULT |
+---+--+--+--++
| robot_healthcheck | functest | onap |  00:04  
 |  PASS  |
| robot_api | functest | onap |  00:04  
 |  PASS  |
| robot_dcae| functest | onap |  00:00  
 |  PASS  |
|  robot_multicloud | functest | onap |  00:00  
 |  PASS  |
|   robot_3rdparty  | functest | onap |  00:01  
 |  PASS  |
+---+--+--+--++

automation basic vm (onboarding + instantiation)
2018-11-15 09:59:43,826 - onap_tests.scenario.e2e - INFO - VNF ubuntu16: test 
initialized
>>> test.execute()
2018-11-15 09:59:51,898 - onap_tests.scenario.e2e - INFO - Start onboarding
2018-11-15 09:59:52,978 - onap_tests.scenario.onboard - INFO - Create vendor
2018-11-15 09:59:54,074 - onap_tests.scenario.onboard - INFO - Check and update 
vendor
2018-11-15 09:59:54,304 - onap_tests.scenario.onboard - INFO - vendor submit
2018-11-15 09:59:54,633 - onap_tests.scenario.onboard - INFO - Check and update 
vendor
2018-11-15 09:59:54,855 - onap_tests.scenario.onboard - INFO - Debut creation 
VSP ubuntu16_VSP
2018-11-15 09:59:55,216 - onap_tests.scenario.onboard - INFO - Check and update 
vendor info
2018-11-15 09:59:55,216 - onap_tests.scenario.onboard - INFO - Create VSP 
ubuntu16_VSP
2018-11-15 09:59:56,446 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 09:59:56,663 - onap_tests.scenario.onboard - INFO - upload Heat 
files to VSP ubuntu16_VSP
2018-11-15 09:59:56,965 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 09:59:57,177 - onap_tests.scenario.onboard - INFO - validate Heat 
files
2018-11-15 09:59:59,917 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 10:00:00,131 - onap_tests.scenario.onboard - INFO - vsp commit
2018-11-15 10:00:01,356 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 10:00:01,601 - onap_tests.scenario.onboard - INFO - vsp submit
2018-11-15 10:00:03,690 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 10:00:03,913 - onap_tests.scenario.onboard - INFO - Create CSAR 
package
2018-11-15 10:00:04,513 - onap_tests.scenario.onboard - INFO - Check and update 
VSP
2018-11-15 10:00:06,141 - onap_tests.scenario.onboard - INFO - Check and update 
VSP info
2018-11-15 10:00:06,141 - onap_tests.scenario.onboard - INFO - Create VF 
ubuntu16_VF
2018-11-15 10:00:06,141 - onap_tests.scenario.onboard - INFO - VF using VSP 
name ubuntu16_VSP
2018-11-15 10:00:06,141 - onap_tests.scenario.onboard - INFO - VF using VSP id 
b83764c5ac8b492cb40c954753f90d09
2018-11-15 10:00:06,141 - onap_tests.scenario.onboard - INFO - VF using VSP 

Re: [onap-discuss] [A] [Beijing] Custom query on A

[Morgan Richomme]

ot;,"text":"Error 
writing output performing %1 on %2 (msg=%3) 
(ec=%4)","variables":["GET","v13/query","Internal 
Error:com.google.gson.JsonSyntaxException: 
com.google.gson.stream.MalformedJsonException: Expected value at line 1 column 
13 path $.start[0]","ERR.5.4.4000"]}}

I am using the same headers than for the other requests
the url of the query is 
https://aai.api.sparky.simpledemo.onap.org:30233/aai/v13/query?format=simple
initially I set a payload to
data = {"start" : ["business/generic-vnfs?service-instance-id="+ instance_id"],
"query" : "query/vfModule-fromServiceInstance"}
to perform the PUT request

The query part is OK as vfModule-fromServiceInstance is well defined in the doc.
my understanding is that the start part is wrong, it does not correspond to 
something available in the graph

I tried to change the value of the payload but was not able to get something 
else than a 400 from the server.

curl -X PUT -i -k -H "accept:application/json" -H 
"content-type:application/json" -H "x-fromappid:AAI" -H 
"x-transactionid:0a3f6713-ba96-4971-a6f8-c2da85a3176e" -H "authorization:Basic 
QUFJOkFBSQ==" -H "cache-control:no-cache" -d @data.json 
https://aai.api.sparky.simpledemo.onap.org:30233/aai/v13/query?format=simple
HTTP/1.1 400 Bad Request
Date: Wed, 17 Oct 2018 15:10:08 GMT
Content-Type: application/json
X-AAI-TXID: 2-aai-traversal-181017-15:10:08:609-30401
Content-Length: 211
Strict-Transport-Security: max-age=1600; includeSubDomains; preload;

{"requestError":{"serviceException":{"messageId":"SVC3014","text":"Query 
payload is invalid %1 (msg=%2) 
(ec=%3)","variables":["query/vfModule-fromServiceInstance","Query payload is 
invalid %1","ERR.5.6.3014"]}}}

with data.json

{"start" : ["network/598c6345-c162-4330-97f3-017d65108883"],
 "query" : "query/vfModule-fromServiceInstance"}

Do you have an example of a curl custom query?

Morgan



Le lundi 15 octobre 2018 à 14:30 +, MONTELEONE, CHRISTINA a écrit :
Hi Morgan,
The documentation you are pointing to is actually from SDN-C, not A, and 
applies specifically to their A interface implementation (AAIService). Here 
is the A API documentation wiki page for Beijing: 
https://wiki.onap.org/display/DW/AAI+REST+API+Documentation+-+Beijing. There is 
a 
AAICustomQueries.pdf<https://wiki.onap.org/download/attachments/28378171/AAICustomQueries.pdf?version=1=1533310532000=v2>
 embedded there.

Your start parameter needs to result in a service-instance being retrieved from 
the graph. To do this you can either use the full service instance URI (with 
values filled in) 
/business/customers/customer/{global-customer-id}/service-subscriptions/service-subscription/{service-type}/service-instances/service-instance/{service-instance-id}
 OR you can use the simplified nodes endpoint 
/nodes/service-instances/service-instance/{service-instance-id}

However, I would have expected A to send you a 404 error for providing a bad 
start URI, not a 500. Can you send the full details of your request and 
response?


Thank you,
Christina Monteleone
Sr. Member of Technical Staff
ECOMP System Engineering | A
732.420.3639

From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On 
Behalf Of Morgan Richomme
Sent: Monday, October 15, 2018 8:22 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [A] [Beijing] Custom query on A

Hi

I am trying to perform a custom query (vfModule-fromServiceInstance) on A on 
the Orange Openlab (Beijing 2.0.0-ONAP).
The questy seems available since Beijing.
I had a look at 
https://wiki.onap.org/display/DW/AAIService+Custom+Query<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_AAIService-2BCustom-2BQuery=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=t8s2YNlnG2yo7J9I1GiEXSPq9sOqHXMlvH5Fj_icwHY=hebNYiJpmWl0-K-N8dn7EDvOhSJRaEkhLtVOjYzDsKw=6YAwd1DHpPDaxXEQwtL9ymHhZs1NQHmlGo-AvKjgk-4=>
 (Please note that the 2 links in the page are internal ATT links)

I have a doubt on the request format and especially on the start parameter.
I did not find example in the documentation.

url = AAI_URL + "/aai/v11/query?format=simple"
start = "business/generic-vnfs?service-instance-id="+ instance_id
data = {"start" : start,
"query" : "query/vfModule-fromServiceInstance"}
response = requests.put(url,
headers=AAI_HEADERS,
proxies=PROXY,
verify=False,
data=data)

I got a 500 from the A without details.

Where can we fin logs to troubleshoot?

Regards

Morgan

_



Ce message et ses pieces jointes peuvent contenir des informations 
confiden

[onap-discuss] [A] [Beijing] Custom query on A

[Morgan Richomme]

Hi

I am trying to perform a custom query (vfModule-fromServiceInstance) on A on 
the Orange Openlab (Beijing 2.0.0-ONAP).
The questy seems available since Beijing.
I had a look at https://wiki.onap.org/display/DW/AAIService+Custom+Query 
(Please note that the 2 links in the page are internal ATT links)

I have a doubt on the request format and especially on the start parameter.
I did not find example in the documentation.

url = AAI_URL + "/aai/v11/query?format=simple"
start = "business/generic-vnfs?service-instance-id="+ instance_id
data = {"start" : start,
"query" : "query/vfModule-fromServiceInstance"}
response = requests.put(url,
headers=AAI_HEADERS,
proxies=PROXY,
verify=False,
data=data)

I got a 500 from the A without details.

Where can we fin logs to troubleshoot?

Regards

Morgan

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#13008): https://lists.onap.org/g/onap-discuss/message/13008
Mute This Topic: https://lists.onap.org/mt/27328605/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [openlab][orange] use of community mailing list

[Morgan Richomme]

Hi,

as the Orange Openlab is becoming a little be more mature, now, most of the 
discussions on our internal mailing list would be valuable for the community, 
especially the different reported issues.
The different problems detected & reported by Köksal for instance would be 
helpful to improve the usability and the troubleshooting.
Then I would like to invite you, as Orange openlab user, to use the community 
mailing list: onap-discuss AT list.onap.org.
You can add [openlab][orange] in the title, so it would be easier for the 
filtering.

Thanks & regards

Morgan

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12910): https://lists.onap.org/g/onap-discuss/message/12910
Mute This Topic: https://lists.onap.org/mt/27155567/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [ONAP] E2E VNF functional testing

[Morgan Richomme]

aging
- onboard the model
- instantiate the VNF
- check that resources are propely created on the target infrastructure
- perform functional tests (e.g. SIP tests on a vIMS VNF)
- clean the resources
- report the results

Automation shall be replicable on any ONAP platform without big effort except 
configuration file changes
It means decoupling use cases/ONAP installation (no hardcoded values in ONAP 
installation, no lab manual specific configuration)

Proprietary VNFs due to licensing models are very hard to integrate in CI/CD 
chains (which shall not prevent ambitious use cases to integrate such VNFs)

It is clearly challenging

As far as I know there are currently several initiatives aiming to provide ONAP 
VNF E2E automatic testing
1) integration project with the different cases including vCPE (integration 
team)
https://git.onap.org/testsuite/tree/robot
https://git.onap.org/demo/tree/
https://git.onap.org/integration/tree/test

Using Robot you can already onboard and instantiate several VNFs (vLB, vFW, 
vVG, vCPE): 
https://git.onap.org/testsuite/tree/robot/testsuites/model-distribution.robot
Some tests were integrated in CI and even use for some robustnes tests (I did 
not find the jenkins url corresponding to daily runs of there testcases)

2) VNFSDK/VPP as part of VNF certification program (contact C.Donley)
information shared during LFN C meeting - the idea is to work on a 
verification program for VNF as the one initiated on the infrastructure by OPNFV
VNFs have been announced for September
only packaging check are planned for Casablanca as a first step but 
onboarding/lifecycle tests/functional tests are mentioned in the roadmap
dovetail framework is mentioned as the tooling to launch the tests

3) Amdocs demo shared during last ONS summit (contact: Moshe Hoadley)
It is also linked to 2) as a poc of ONAP Life cycle testing through dovetail
https://wiki.onap.org/display/DW/VNFTEST+integration+with+DOVETAIL?preview=/28377754/28377756/onap-opnfv-collaboration-demo-21_march_2018.mp4
I did not find de code associated to the demo

4) OTF - Open Test Framework (contact: Kevin Wan)
https://wiki.onap.org/display/DW/OTF+-+Open+Test+Framework
project in progress / still no official repo

5) Light python framework shared during last ONS (contact: Morgan Richomme)
This is a python framework allowing to onboard and instantiate VNFs.
It can be used with Clearwater vIMS, vMRF (proprietary), vAAA (freeradius), 
ONAP vFW
The code is available here: https://gitlab.com/Orange-OpenSource/onap-tests

The plan is to integrate it in xtesting project (as robot healthcheck tests 
have been integrated)
xtesting (https://xtesting.readthedocs.io/en/latest/) is a light framework to 
harmonize the way of launching the tests (launch, get results, report results), 
supporting Robot, python, bash, junit based tests.
it is used in OPNFV and easy to integrate in CI chains (we use it internally 
from our gitlab pipelines).

6) Postman collection
can be used for automation

7) ...

As we can see there are several solutions adressing the same goals
It probably would make sense to see if possible synergies are possible
Would it make sense to plan a f2f meeting during next ONS summit?

/Morgan

_


Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.


This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have

Re: [onap-discuss] [ONAP] E2E VNF functional testing

[Morgan Richomme]

Hi Brian

thanks for the quick answer
some answers & ... questions in the mail ..

/Morgan

Le jeudi 23 août 2018 à 12:56 +, FREEMAN, BRIAN D a écrit :
Morgan,

Jenkins jobs for daily installation and regression tests are off the 
jenkins/grafana site that Gary runs.

http://onapci.org/jenkins/
http://onapci.org/grafana/
http://onapci.org/grafana/d/8cGRqBOmz/daily-summary?orgId=1

That is what I had in mind but I did not find the link from the wiki.
is there any reason it is not referenced? if no objection , I could add it to 
the wiki integration page

My first reflex was to go to https://jenkins.onap.org/view/integration/
but onapci.org is much clearer from an integration perspective
I am not sure to fully understand why there are 2 jenkins dealing with 
integration.
More generally I also remember that there is a dedicate CI chains for OOM. The 
CI/CD governance is not fully clear.

On onapci jenkins, does the daily jobs deal with the Master branch (Casablanca 
candidate)?
is there any jobs using Beijing (to check the stability)

I can see that healthcheck tests are performed at the end of the installation 
(with heat & oom installer).
For the moment, none of the healthcheck test reached 100% (which is logic for a 
master branch at M3 milestone), is it why the VNF tests are not triggered?
As far as I remember vFW was integrated in CI chains for Beijing
It would make sense to keep all the supported & automated VNF E2E tests in the 
CI chains.


We could start the discussion even before ONS.
sure..

I would encourage us to look at incorporating testing into the testsuite 
project rather than a new project but I may be mis-understanding what you mean 
by xtesting.
I agree
it is always challenging, as creation - at least in first step - looks quicker 
(you are master on board) than joining existing projects due to the learning 
curve and the technical debt.
but one the most important community added value deals with the capability to 
avoid that.
regarding Orange contribution in this area, the problem is more with onap-tests 
than xtesting.
xtesting does not create any use case, it is a docker launcher tool consuming 
existing testsuites from upstream test projects using different 
languages/technologies(Robot, bash, python, junit,..).

the python onap-tests framework do things similar to what Robot does 
(onboarding, instantiation, openstack resource creation check).
we initiated it mainly to learn (creation of class per ONAP module a little bit 
like the openstack python clients per Openstack module - but not so well 
written...)
we were not so familiar with robot and, as, when it becomes complex, robot 
(which is written in python) calls python classes, we did it this way.
But we could probably reuse all the robot capabilities to run the vIMS or vAAA
We can see that some of the python classes called from robot scripts (hosted in 
python-testing-utils) are not very different (and probably better) to what we 
did.

regarding xtesting, we are using it to unify the way we launch tests from 
different projects (infra/kubernetes, infra/openstack, onap/healthcheck, 
onap/vvp, ..) in different CI/CD chains (jenkins, gitlab).

We use it for our infra and for ONAP.
for the infra, you can see some exemples from OPNFV CI/CD chains
- kubernetes infra check (test suite from kubernetes community): 
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/249/console
- openstack infra check (testsuites from different sources:upstream openstack 
(rally, tempest, shaker, vmtp, ...), OPNFV feature project or test project own 
dev including VNF lifecycle tests on vIMS, vCPE): 
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/225/console

on ONAP we use xtesting to
- run the existing Robotframework => docker pull morganrol/xtesting-onap-robot
- run ice validator towards referenced heat templates from official ONAP repo 
=> docker pull morganrol/xtesting-onap-vnfpkgcheck

[cid:b3ca07c0596c201ff83a052309c83f1fb9a37372.camel@orange.com]

One more time it does not create new testcase, it just "dockerizes" the launch 
and the way to declare the cases, get and export the results.
the test execution is independent from the SUT and cleaned once tests are 
executed
the docker creation shall be triggered each time one of the heat template 
and/or the code of the ice_validator is modified

Installation of ONAP is generally in the demo or integration repos (demo is 
more for the test vnfs going forward) .
OK

it is sometimes not fully crystal clear but I do not have all the history
in integration/test I can find a directory vcpe 
https://git.onap.org/integration/tree/test/vcpe
there is also several vCPE directories under demo
https://git.onap.org/demo/tree/vnfs/vCPE
https://git.onap.org/demo/tree/heat/vCPE

in integration, there are stuff related to the tests, the labs, the CI, lots of 
tools. it is not always to see the link between the different folders.

would it make 

[onap-discuss] [ONAP] E2E VNF functional testing

[Morgan Richomme]

Hi,

a topic was dedicated to vCPE automation during Integration meeting today.

I think that E2E VNF testing automation is key to stabilize ONAP

For me automation means the ability to
- check packaging
- onboard the model
- instantiate the VNF
- check that resources are propely created on the target infrastructure
- perform functional tests (e.g. SIP tests on a vIMS VNF)
- clean the resources
- report the results

Automation shall be replicable on any ONAP platform without big effort except 
configuration file changes
It means decoupling use cases/ONAP installation (no hardcoded values in ONAP 
installation, no lab manual specific configuration)

Proprietary VNFs due to licensing models are very hard to integrate in CI/CD 
chains (which shall not prevent ambitious use cases to integrate such VNFs)

It is clearly challenging

As far as I know there are currently several initiatives aiming to provide ONAP 
VNF E2E automatic testing
1) integration project with the different cases including vCPE (integration 
team)
https://git.onap.org/testsuite/tree/robot
https://git.onap.org/demo/tree/
https://git.onap.org/integration/tree/test

Using Robot you can already onboard and instantiate several VNFs (vLB, vFW, 
vVG, vCPE): 
https://git.onap.org/testsuite/tree/robot/testsuites/model-distribution.robot
Some tests were integrated in CI and even use for some robustnes tests (I did 
not find the jenkins url corresponding to daily runs of there testcases)

2) VNFSDK/VPP as part of VNF certification program (contact C.Donley)
information shared during LFN C meeting - the idea is to work on a 
verification program for VNF as the one initiated on the infrastructure by OPNFV
VNFs have been announced for September
only packaging check are planned for Casablanca as a first step but 
onboarding/lifecycle tests/functional tests are mentioned in the roadmap
dovetail framework is mentioned as the tooling to launch the tests

3) Amdocs demo shared during last ONS summit (contact: Moshe Hoadley)
It is also linked to 2) as a poc of ONAP Life cycle testing through dovetail
https://wiki.onap.org/display/DW/VNFTEST+integration+with+DOVETAIL?preview=/28377754/28377756/onap-opnfv-collaboration-demo-21_march_2018.mp4
I did not find de code associated to the demo

4) OTF - Open Test Framework (contact: Kevin Wan)
https://wiki.onap.org/display/DW/OTF+-+Open+Test+Framework
project in progress / still no official repo

5) Light python framework shared during last ONS (contact: Morgan Richomme)
This is a python framework allowing to onboard and instantiate VNFs.
It can be used with Clearwater vIMS, vMRF (proprietary), vAAA (freeradius), 
ONAP vFW
The code is available here: https://gitlab.com/Orange-OpenSource/onap-tests

The plan is to integrate it in xtesting project (as robot healthcheck tests 
have been integrated)
xtesting (https://xtesting.readthedocs.io/en/latest/) is a light framework to 
harmonize the way of launching the tests (launch, get results, report results), 
supporting Robot, python, bash, junit based tests.
it is used in OPNFV and easy to integrate in CI chains (we use it internally 
from our gitlab pipelines).

6) Postman collection
can be used for automation

7) ...

As we can see there are several solutions adressing the same goals
It probably would make sense to see if possible synergies are possible
Would it make sense to plan a f2f meeting during next ONS summit?

/Morgan

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12035): https://lists.onap.org/g/onap-discuss/message/12035
Mute This Topic: https://lists.onap.org/mt/24929469/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-