Thanks Adrian and Sylvian for your inputs. OOM-1227 is very good persistence solution for ONAP.
From: [email protected] <[email protected]> Sent: Thursday, September 5, 2019 7:05 PM To: Adrian OSullivan <[email protected]>; Patel, Divyang <[email protected]>; GEEREBAERT Matthieu TGI/OLS <[email protected]> Cc: Husain, Atif <[email protected]>; [email protected]; [email protected] Subject: Re: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question [External Email] This email was sent from outside the organisation – be cautious, particularly with links and attachments. Hi, I’ve had issue with NFS when I was using UDP and not TCP. Here’s my /etc/exports: /dockerdata-nfs *(rw,async,no_root_squash,no_subtree_check) And here’s how I mount it (in /etc/fstab): 10.253.0.10:/dockerdata-nfs /dockerdata-nfs nfs4 nfsvers=4.1,rsize=131072,wsize=131072 0 2 I’m using an SSD backend on top of CEPH but HDD (w/o CEPH) should be sufficient. We’re working on the OOM project to use storage classes for all components (see https://jira.onap.org/browse/OOM-1227, we’re half way…) Regards, --- Sylvain Desbureaux De : Adrian OSullivan <[email protected]<mailto:[email protected]>> Date : jeudi 5 septembre 2019 à 10:59 À : "Patel, Divyang" <[email protected]<mailto:[email protected]>>, GEEREBAERT Matthieu TGI/OLS <[email protected]<mailto:[email protected]>>, DESBUREAUX Sylvain TGI/OLN <[email protected]<mailto:[email protected]>> Cc : "Husain, Atif" <[email protected]<mailto:[email protected]>> Objet : RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hi Divyang, I feel your pain. I’m afraid I am not a docker NFS expert, so I am not in a position to offer advice on what maybe causing the issues in your lab. In the Frankfurt release NBI will be moving to using the common mariadb galera cluster, Sylvain is currently preparing this migration. However on a quick scan, I think the common mariadb galera cluster uses the same persistence dockerdata-nfs. As for developer access to labs, I have the same issue. I can access Orange Openlabs but this is only to use UIs/API healthchecks, not for developer access to the docker containers/ logs etc. In Dublin I used the Swisscom BBS Lab for development with full access to dockers, however this is not an open lab and that project has now finished. Sorry for not being able to help more on this, Adrian From: Patel, Divyang [mailto:[email protected]] Sent: Thursday 5 September 2019 06:52 To: [email protected]<mailto:[email protected]>; DESBUREAUX Sylvain TGI/OLN <[email protected]<mailto:[email protected]>> Cc: Husain, Atif <[email protected]<mailto:[email protected]>>; Adrian OSullivan <[email protected]<mailto:[email protected]>> Subject: RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hi Adrian/Matthieu, Here’s an update to NBI-Mariadb issue. The one thing is sure that, NFS share is causing issue on my setup. I’ve tried numerous times with varying methods to figure out what’s going wrong, but for life of me I couldn’t. For now I’ve applied a stop-gap solution to not use `/dockerdata-nfs` mount to store mariadb data. Instead I’ve used a `Cinder` volume which is working fine. Technically it’s a good strategy but to keep up with upstream, I’ll have to find a solution to my NFS nightmares. I’ll try on public clouds. But if there’s an environment where you guys work and available to other devs like me, I would appreciate if I can get access to it. Thanks for all your help. Divyang Patel Senior Specialist - Programmable Infrastructure Product Strategy & Innovation – Telstra Labs | Telstra Corporation M +61 431 954 551 | E [email protected]<mailto:[email protected]> From: Patel, Divyang Sent: Monday, September 2, 2019 10:42 AM To: [email protected]<mailto:[email protected]>; DESBUREAUX Sylvain TGI/OLN <[email protected]<mailto:[email protected]>> Cc: Husain, Atif <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Subject: RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hi Adrian & Matthieu, Thanks for your quick reply and inputs. We’re using Kubernetes cluster (managed by Rancher) on top of Openstack on-prem cloud Here’re few things I tried over the weekend. 1) Remove NBI completely and deploy it again. – Didn’t work 2) Try older versions of mariadb image i.e. 10.2.25 – Didn’t work 3) Changed PVC access from ReadWriteMany to ReadWriteOnce – Didn’t work 4) Ran the container in my local Ubuntu machine – Worked It looks like the issue is with Volume permission or NFS related. Will try this on Azure/AWS cloud today and see if it works. Will let you know. Divyang Patel Senior Specialist - Programmable Infrastructure Product Strategy & Innovation – Telstra Labs | Telstra Corporation M +61 431 954 551 | E [email protected]<mailto:[email protected]> From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> Sent: Saturday, August 31, 2019 1:15 AM To: DESBUREAUX Sylvain TGI/OLN <[email protected]<mailto:[email protected]>> Cc: Patel, Divyang <[email protected]<mailto:[email protected]>>; Husain, Atif <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Subject: Re: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question [External Email] This email was sent from outside the organisation – be cautious, particularly with links and attachments. Hi Sylvain, Do you think that this mysql file access problem would be relative to the one you fixed yesterday in oom project ? https://jira.onap.org/browse/EXTAPI-305 https://gerrit.onap.org/r/c/oom/+/94589 The crash: 2019-08-30 7:56:17 140366837704448 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 30/08/2019 17:56:17 2019-08-30 7:56:17 140366837704448 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Plugin 'FEEDBACK' is disabled. 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [ERROR] Could not open mysql.plugin table. Some plugins may be not loaded 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Recovering after a crash using tc.log 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Starting crash recovery... On Fri, 2019-08-30 at 09:38 +0000, Adrian OSullivan wrote: Hi Divyang, I have tried both the oom installed nbi-mariadb and also I did a local docker-compose up –d mariadb on my macOs 10.14.4 , using the Dublin release. I was not able to reproduce the issue you are seeing, see my local logs below. It looks like you are having an issue accessing the volumes , are you launching the container locally on a windows machine? docker-compose up –d mariadb?, similar to thread: https://github.com/docker-library/mariadb/issues/95 Including Matthieu in case he has seen this issue with mariadb on a different environment. Thanks Adrian MySQL init process done. Ready for start up. 2019-08-30 9:21:12 0 [Note] mysqld (mysqld 10.3.14-MariaDB-1:10.3.14+maria~bionic) starting as process 1 ... 2019-08-30 9:21:12 0 [Note] InnoDB: Using Linux native AIO 2019-08-30 9:21:12 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-08-30 9:21:12 0 [Note] InnoDB: Uses event mutexes 2019-08-30 9:21:12 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2019-08-30 9:21:12 0 [Note] InnoDB: Number of pools: 1 2019-08-30 9:21:12 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-08-30 9:21:12 0 [Note] InnoDB: Initializing buffer pool, total size = 256M, instances = 1, chunk size = 128M 2019-08-30 9:21:12 0 [Note] InnoDB: Completed initialization of buffer pool 2019-08-30 9:21:12 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-08-30 9:21:12 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-08-30 9:21:12 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-08-30 9:21:12 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-08-30 9:21:12 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-08-30 9:21:12 0 [Note] InnoDB: Waiting for purge to start 2019-08-30 9:21:12 0 [Note] InnoDB: 10.3.14 started; log sequence number 1630824; transaction id 21 2019-08-30 9:21:12 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2019-08-30 9:21:12 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-08-30 9:21:12 0 [Note] Server socket created on IP: '::'. 2019-08-30 9:21:12 0 [Warning] 'proxies_priv' entry '@% root@edbe70d9d34d' ignored in --skip-name-resolve mode. 2019-08-30 9:21:12 0 [Note] InnoDB: Buffer pool(s) load completed at 190830 9:21:12 2019-08-30 9:21:12 0 [Note] Reading of all Master_info entries succeded 2019-08-30 9:21:12 0 [Note] Added new Master_info '' to hash table 2019-08-30 9:21:12 0 [Note] mysqld: ready for connections. Version: '10.3.14-MariaDB-1:10.3.14+maria~bionic' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org<http://mariadb.org> binary distribution From: Patel, Divyang [mailto:[email protected]] Sent: Friday 30 August 2019 08:59 To: Adrian OSullivan <[email protected]<mailto:[email protected]>> Cc: Husain, Atif <[email protected]<mailto:[email protected]>> Subject: RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hi Adrian, A side question about nbi-mariadb in Dublin release. Nbi-mariadb is not starting. See the error log below. If you know something about it, could you please guide me! 2019-08-30 7:56:17 140366837704448 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 30/08/2019 17:56:17 2019-08-30 7:56:17 140366837704448 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Plugin 'FEEDBACK' is disabled. 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [ERROR] Could not open mysql.plugin table. Some plugins may be not loaded 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Recovering after a crash using tc.log 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Starting crash recovery... 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Crash recovery finished. 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [Note] Server socket created on IP: '::'. 30/08/2019 17:56:17 2019-08-30 7:56:17 140367922398976 [Note] mysqld (initiated by: unknown): Normal shutdown 30/08/2019 17:56:17 2019-08-30 7:56:17 140368059086144 [ERROR] Fatal error: Can't open and lock privilege tables: Table 'mysql.user' doesn't exist Divyang Patel Senior Specialist - Programmable Infrastructure Product Strategy & Innovation – Telstra Labs | Telstra Corporation M +61 431 954 551 | E [email protected]<mailto:[email protected]> From: Adrian OSullivan <[email protected]<mailto:[email protected]>> Sent: Thursday, August 29, 2019 6:36 PM To: Husain, Atif <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Cc: [email protected]<mailto:[email protected]>; Patel, Divyang <[email protected]<mailto:[email protected]>> Subject: RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question [External Email] This email was sent from outside the organisation – be cautious, particularly with links and attachments. Thank you Atif, I really appreciate you spending time with us on the External API call yesterday, it being so late in Melbourne. It was good to flesh out the requirements for External API. For the API community team it was a great help to understand the ODM requirements. Hopefully it will help in getting more people to help out in the implementation in Frankfurt. Best Regards, Adrian From: Husain, Atif [mailto:[email protected]] Sent: Thursday 29 August 2019 04:55 To: Adrian OSullivan <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Cc: [email protected]<mailto:[email protected]>; Patel, Divyang <[email protected]<mailto:[email protected]>> Subject: Re: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hi Adrian, Thanks for the good discussion last night. Yes, we plan to leverage the CCVPN approach to add the 3rd Party details into SDC as part of the service specification. They will be part of the RFS specification (if I may call it RFS) that the 3rd Party will send to ONAP. As discussed, I have added the requirement on Ext API Frankfurt page, also added the sample CSAR on the meeting notes<https://wiki.onap.org/display/DW/2019-08-28+%5BExtAPI%5D+Meeting+notes> page. We can discuss about details of ServiceProxy with Ofir once he is available. I am based in Melbourne Australia, so if we can have the discussion during early first half of your day it will be great. Regards, Atif ________________________________ From: Adrian OSullivan <[email protected]<mailto:[email protected]>> Sent: Wednesday, August 28, 2019 7:38 PM To: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>>; Husain, Atif <[email protected]<mailto:[email protected]>> Cc: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> Subject: RE: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question [External Email] This email was sent from outside the organisation – be cautious, particularly with links and attachments. These are great points Rene, For CCVPN we used the SpPartner resource to store the source ( SDC A UUIDs, plus we also needed the url of the Partner External API so we can communicate with it ) SpPartner had properties including properties: ….. partnerServiceUuid: type: string description: template uuid of peer SP Partner url: type: string description: url of External API of peer SP Partner I guess when the Partner Service is Onboarded as a 3rd Party Service via ExtAPI to SDC, these properties along with the local ( SDC B generated Service UUID ) need to be stored in SDC B catalog. We could then use ServiceProxy resource to consume Service A on SDC B in Service B. So ONAP SDC B Runtime can look up the partnerServiceUuid: i.e. the UUID of ServiceSpec A in SDC A. It is also equally important to store the external url of External API of ONAP A so as to allow ONAP B to communicate with it via open apis. Hope this make sense, lots of A’s and B’s ☺ Perhaps it's a discussion item for todays NBI call? Adrian From: [email protected]<mailto:[email protected]> [mailto:[email protected]] Sent: Wednesday 28 August 2019 10:19 To: Husain, Atif <[email protected]<mailto:[email protected]>> Cc: Adrian OSullivan <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]> Subject: ONAP SDC : modeling a "CFS" composed of a third-party "RFS" : third-party service model UUID question Hello Atif, Scenario : - service model “A” is defined in ONAP SDC “A” : service model “A” has its service UUID “A” in ONAP SDC “A” - service model “B” is defined in ONAP SDC “B” and we want to compose Service model “B” with service model “A” - we import/create service model “A” in ONAP SDC “B”: ONAP SDC “B” is going to generate a UUID “A-bis” for that copy of service model “A” - when we want to instantiate service model “B”, at one point it will be necessary to use the UUID “A” in the request to ONAP “A” Question: How do you imagine to handle that situation about “UUIDs” ? Do we need an evolution in SDC to be able to store that “third-party service model UUID” ? René _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#18836): https://lists.onap.org/g/onap-discuss/message/18836 Mute This Topic: https://lists.onap.org/mt/33151467/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
