[onap-discuss] Component-specific properties in build environment for passwords?

2017-08-02 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
How do you all handle passwords when building your component dockers?

To build our apps and create our docker containers we have to specify 
passwords, for example to our database.  Today we put the passwords in our 
build scripts, which are committed in git and exposed to the world.  Our 
database docker is running in rackspace and also open to the wild internets, so 
I think this situation does not pass the red-face test.  

I noticed that in initializing our virtual machine the LF environment scripts 
use data stored in "/opt/config/*" files for nexus username and nexus password. 
 That seems like a step in the right direction.

Is something similar possible for components?  If this is a solved problem 
please point me to the issue, email archive, etc. and I'll read up.  

Possibly also relevant - I hear installations will soon be done by ONAP 
Operation Manager (?).

Thanks in advance.

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] [integration] Update POM to inherit from oparent

2017-08-01 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
Gary and community, please advise how best to integrate the new OParent POM.  
On my first attempt Maven showed this error:

  Could not find artifact org.onap.oparent:checkstyle:jar:1.0.0-SNAPSHOT in 
apache.snapshots (http://repository.apache.org/snapshots)

I posted complete details about what I tried on the ONAP-Parent wiki page:

  https://wiki.onap.org/pages/viewpage.action?pageId=10783020

Thanks in advance.

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] Request Jenkins configuration extension for LF Portal

2017-06-12 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
Andrew and community:

Thanks for the details.  I think I should start by adding add a local parameter 
to this job defined in global-templates-java.yaml:
  
   name: '{project-name}-{stream}-release-version-java-daily'

This job has 2 maven-target entries, here is the second:

  - maven-target:
  maven-version: '{maven-version}'
  goals: 'clean deploy -B

-Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn'
  properties:
- '{maven-deploy-properties}'
  settings: '{mvn-settings}'
  settings-type: cfp
  global-settings: 'global-settings'
  global-settings-type: cfp


I think I need to modify the portal.yaml file to set a value for the property 
"maven-deploy-properties" above with my new bit of text 
"-Dbuild.number=${BUILD_NUMBER}"

So here is that portal.yaml file again:

---
- project:
name: portal
project-name: 'portal'
jobs:
  - '{project-name}-{stream}-release-version-java-daily'
  - '{project-name}-{stream}-stage-site-java':
  site-pom: 'pom.xml'
  trigger-job: '{project-name}-{stream}-release-version-java-daily'

project: 'portal'
stream:
  - 'master':
  branch: 'master'
  - 'release-1.0.0':
  branch: 'release-1.0.0'
mvn-settings: 'portal-settings'
files: '**'
archive-artifacts: ''
build-node: ubuntu1604-basebuild-4c-4g

In the template (above) the hooks available to me seem to be anything in curly 
braces; e.g., {maven-deploy-properties} and {mvn-settings}.  So I added this 
line at the end of the portal.yaml file:

maven-deploy-properties: -Dbuild.number=${BUILD_NUMBER}

Does that look right?  I will submit this change to gerrit soon for review.

Finally, do you want a Jira ticket number here?

Please guide me. 


> On Jun 12, 2017, at 2:02 PM, Andrew Grimberg <agrimb...@linuxfoundation.org> 
> wrote:
> 
> +onap-discuss
> 
> These sorts of discussions should be held in the public where everyone
> can benefit.
> 
> On 06/12/2017 10:41 AM, LOTT, CHRISTOPHER M (CHRISTOPHER) wrote:
>> Thanks Andrew. I cloned that project and am trying to figure it out.  Looks 
>> like I could modify global-defaults.yaml (probably the wrong thing to do); 
>> modify global-templates-java.yaml (in many many places); or limit the scope 
>> to just the portal project (seems the best option).  So I found this file - 
>> it seems to reference a variable 'portal-settings' but I cannot find where 
>> that is defined, what it contains, etc.  Please advise.
>> 
>> 
>> bd-228-251:~/git/ci-management/jjb/portal$ cat portal.yaml 
>> 
>> ---
>> - project:
>>name: portal
>>project-name: 'portal'
>>jobs:
>>  - '{project-name}-{stream}-release-version-java-daily'
>>  - '{project-name}-{stream}-stage-site-java':
>>  site-pom: 'pom.xml'
>>  trigger-job: '{project-name}-{stream}-release-version-java-daily'
>> 
>>project: 'portal'
>>stream:
>>  - 'master':
>>  branch: 'master'
>>  - 'release-1.0.0':
>>  branch: 'release-1.0.0'
>>mvn-settings: 'portal-settings'   <-- is this my hook 
>> to make a change??
> 
> That file is non-settable by any of the projects. It's the credentials
> settings file that LF provides to each project in our systems. It is
> required to be "${projectrepo}-settings".
> 
> The correct thing to do is the following:
> 
> 1) Determine what job(s) it is you're trying to modify
> 2) Determine if there are variables already being passed in that you can
> modify to do what you want, if there are, then modify them in your
> project definition
> 3) If there are not, then updating the job template to take a new
> variable is something that can be done, but then all projects that are
> using the template must be updated to pass a proper default so as to not
> break the jobs.
> 
> -Andy-
> 
>>files: '**'
>>archive-artifacts: ''
>>build-node: ubuntu1604-basebuild-4c-4g
>> 
>> 
>> 
>> 
>>> On Jun 12, 2017, at 12:53 PM, Andrew Grimberg 
>>> <agrimb...@linuxfoundation.org> wrote:
>>> 
>>> On 06/12/2017 09:34 AM, LOTT, CHRISTOPHER M (CHRISTOPHER) wrote:
>>>> I would like to suggest a extension to the Jenkins job that builds the 
>>>> ONAP Portal back-end (compiles java, yields war file).  The job is 
>>>> probably "portal-master-release-version-java-daily".  I propose to add 
>>>> this argument to mvn: "-Dbuild.number=${BUILD_NUMBER}".  This passes thru 
>>>> the build number cho

Re: [onap-discuss] [ONAP Helpdesk #45358] RE: [integration][confluence] Developer Wiki > O-Parent (oparent)

2017-09-07 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
Please advise how best to incorporate the oparent POM prepared by Gary Wu given 
these differences among repositories. Currently that POM uses the ecomp- prefix 
for server IDs in its distribution management block, but as you wrote, that 
doesn't work for portal project. 

> On Sep 7, 2017, at 17:39, Jessica Wagantall via RT 
>  wrote:
> 
> You are correct. 
> 
> Portal-sdk is one of those repos which has transitioned to use the generic 
> serverIDs. Soon all of them are going to be using these generic serverIDs 
> too. 
> 
> Sorry for the confusion
> Thanks!
> Jess
___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

[onap-discuss] Jenkins build times cut in half, thank you LF!

2017-10-12 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
Just want to mention that for our project (portal) the build time in the LF 
Jenkins has dropped from 30 to 15 minutes, thank you LF for the recent 
action(s) that resulted in this big speedup.  

p.s. Can you find another 50%?  :)
___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] ONAP installation on vanilla openstack

2017-11-22 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
Good day, definitely missing the Portal-apps VM!  Please choose a Heat template 
that deploys the just-released Amsterdam release of Portal, which is version 
1.3.0, instead of the (much older) 1.1.0.  Hope this helps.

> On Nov 22, 2017, at 8:52 AM, Muhammad Ali  wrote:
> 
> Hi,
>  
> I’ve started deploying ONAP using the following Heat template.
>  
> https://nexus.onap.org/content/sites/raw/org.openecomp.demo/heat/OpenECOMP/1.1.0-SNAPSHOT/onap_openstack.yaml
>  
> Stack creation was successful in Openstack. VMs and networks are up running.
>  
> However, Portal VM was not configured correctly, below is the output of 
> “docker ps -a” from portal VM.
>  
> root@vm1-portal:/opt# docker ps -a
> CONTAINER IDIMAGE   COMMAND  CREATED  
>STATUS  PORTS   NAMES
> a07f1099790dmariadb "docker-entrypoint..."   2 hours ago  
>Created data_vol_portal
>  
> Is this the correct output? I’m wondering if there should be more active 
> containers of ecomp portal and its components.
>  
> Below are my findings, when manually executed the portal_install.sh file.
>  
> <…>
> docker stop/waiting
> docker start/running, process 20839
> Cloning into 'portal'...
> remote: Finding sources: 100% (6754/6754)
> remote: Total 6754 (delta 2747), reused 6754 (delta 2747)
> Receiving objects: 100% (6754/6754), 16.28 MiB | 3.46 MiB/s, done.
> Resolving deltas: 100% (2747/2747), done.
> Checking connectivity... done.
> Already up-to-date.
> chmod: cannot access ‘portal/deliveries/new_start.sh’: No such file or 
> directory
> chmod: cannot access ‘portal/deliveries/new_stop.sh’: No such file or 
> directory
> chmod: cannot access ‘portal/deliveries/dbstart.sh’: No such file or directory
> unzip:  cannot find or open portal/deliveries/etc.zip, 
> portal/deliveries/etc.zip.
> Login Succeeded
> 1.1-STAGING-latest: Pulling from openecomp/portaldb
> 4a441ce0e165: Pull complete
> a1ddcbe73394: Pull complete
> <…snipped…>
> Status: Downloaded newer image for mariadb:latest
> a07f1099790d8b19db7906b7bd337459d4b0676c08b9515fe6d0d3ba7872ff19
> Error response from daemon: No such container: ecompdb_portal
> Error response from daemon: No such container: 1610-1
> Error response from daemon: No such container: widget-ms:latest
> ./portal_vm_init.sh: line 35: ./dbstart.sh: No such file or directory
> ./portal_vm_init.sh: line 36: ./new_start.sh: No such file or directory
> ./portal_vm_init.sh: line 37: ./widget_ms_start.sh: No such file or directory
>  
> And script hangs there.
>  
> Below is my heat env file.
>  
>  nexus_repo: https://nexus.onap.org/content/sites/raw
>   nexus_docker_repo: nexus3.onap.org:10001
>   nexus_username: docker
>   nexus_password: docker
>   dmaap_topic: AUTO
>  artifacts_version: 1.1.0-SNAPSHOT
>   docker_version: 1.1-STAGING-latest
>   gerrit_branch: master
>   openstack_tenant_id: admin
>   openstack_username: admin
>   cloud_env: openstack
>  
> Seems like, it is missing some *start.sh scripts from the repo.
>  
> Can you please point me to the correct upstream repo? Also, kindly review the 
> my env config, if there is something that I need to modify/update.
>  
> Any help will be appreciated in this regard.
>  
> Thanks
> Muhammad Ali
> ___
> onap-discuss mailing list
> onap-discuss@lists.onap.org
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.onap.org_mailman_listinfo_onap-2Ddiscuss=DwICAg=LFYZ-o9_HUMeMTSQicvjIg=IZdJcfOS7YWo6UY200A3VVFzja_rCk3u0gLN62mqPOk=sacvlwYW47YjlXiDSJKZwC2JE28RYdBYgpQMwGXFjmQ=Qf6h0Fsjsf2VseXfAJ28K64pYlu6m3WATmhKeZcPOgU=

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] OOM Gerrit repository page not found

2017-11-22 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
This works for me (please note "https"):

   git clone https://gerrit.onap.org/r/oom


> On Nov 22, 2017, at 5:32 AM, Kiruthiga R  wrote:
> 
> Hi All,
>  
> As part of ONAP on Kubernetes installation, while trying to clone the oom 
> repo using anonymous http method (git clone http://gerrit.onap.org/r/oom) we 
> get page not found error.
>  
> Before Amsterdam release, git clone to oom repo was happening fine without 
> any issues. Please help.
>  
> Thanks & Regards,
> Kiruthiga
>  
> ___
> onap-discuss mailing list
> onap-discuss@lists.onap.org
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.onap.org_mailman_listinfo_onap-2Ddiscuss=DwICAg=LFYZ-o9_HUMeMTSQicvjIg=IZdJcfOS7YWo6UY200A3VVFzja_rCk3u0gLN62mqPOk=4PZe-DacC_uJShSWH6iDiXHaefzlX6LqwAtWZU4k-co=vfWiHOVGA3B7RKusNt3qstSvfkDkB_paChi4m0uxJdU=

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] build docker:portal

2017-11-17 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
The build process for Portal and Portal/SDK is done together, and automated in 
the LF Jenkins system.  The two parts must be obtained from two different Git 
repositories ("portal" and "portal/sdk"). My best guess is that this build was 
attempted with only the first repo checked out, and without having the second 
one also checked out.  You may wish to consult exactly how the Jenkins job is 
configured if you would like to reproduce that build process.  HTH

> On Nov 17, 2017, at 4:42 AM, aijianwen  wrote:
> 
> Hi, team
> Buid the docker of portal:
> CURRENTDIR="$(pwd)"
> echo $CURRENTDIR
> ls -ltr
> cd deliveries
> ls -ltr
> chmod 755 *.sh
> ./os_docker_push.sh
> Errors:
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-common/EcompPortalDMLMySql_1707_Common.sql
>  
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-common/EcompPortalDMLMySql_1710_Common.sql
>  build/scripts/ecomp-portal-DB-os
> + cp 
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-os/EcompPortalDDLMySql_1707_OS.sql
>  
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-os/EcompPortalDDLMySql_1710_OS.sql
>  
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-os/EcompPortalDMLMySql_1707_OS.sql
>  
> /directory/var/jenkins/workspace/portal-docker-1.1.0/ecomp-portal-DB-os/EcompPortalDMLMySql_1710_OS.sql
>  build/scripts/ecomp-portal-DB-os
> + cp 
> '/directory/var/jenkins/workspace/portal-docker-1.1.0/sdk/ecomp-sdk/epsdk-app-common/db-scripts/*.sql'
>  build/scripts/epsdk-app-os
> cp: cannot stat 
> '/directory/var/jenkins/workspace/portal-docker-1.1.0/sdk/ecomp-sdk/epsdk-app-common/db-scripts/*.sql':
>  No such file or directory
> Build step 'Execute shell' marked build as failure
>  
> How to solve it?
> ___
> onap-discuss mailing list
> onap-discuss@lists.onap.org
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.onap.org_mailman_listinfo_onap-2Ddiscuss=DwICAg=LFYZ-o9_HUMeMTSQicvjIg=IZdJcfOS7YWo6UY200A3VVFzja_rCk3u0gLN62mqPOk=h65r1Px9rEYj9fVRlNyDa_RZVD2iHoV1AzzII4vNTu8=S7FZU44UrNaKiH2KWXnUa75sL9yPJ1KLBtxvrri2q2U=

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] [integration] Integration-SB-00

2017-10-30 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) 
This is (or should be) already done, Marco merged the required change this 
morning:

  https://gerrit.onap.org/r/#/c/21299/


> On Oct 30, 2017, at 1:51 PM, Gary Wu  wrote:
> 
> Please see update from Chris Lott in https://jira.onap.org/browse/PORTAL-138: 
> It seems that we can no longer use portal master branch in Amsterdam 
> deployment scripts.
>  
> Chris, can you please help make the necessary changes in the demo repo to 
> make sure that the Heat deployment scripts are pulling the right branch for 
> Amsterdam?
>  
> Thanks,
> Gary
>  
> From: onap-discuss-boun...@lists.onap.org 
> [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Yunxia Chen
> Sent: Monday, October 30, 2017 10:43 AM
> To: FREEMAN, BRIAN D ; Kang Xi ; 
> onap-discuss 
> Subject: Re: [onap-discuss] [integration] Integration-SB-00
>  
> With the latest install, about 90 minutes ago, Portal didn’t pass the sanity 
> testing at Integration-SB-04.
>  
> Basic Portal Health Check [ WARN 
> ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, 
> status=None)) after connection broken by 
> 'NewConnectionError(' 0x7f620baa1090>: Failed to establish a new connection: [Errno 111] Connection 
> refused',)': /ONAPPORTAL/portalApi/healthCheck
> [ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, 
> status=None)) after connection broken by 
> 'NewConnectionError(' 0x7f620baa1dd0>: Failed to establish a new connection: [Errno 111] Connection 
> refused',)': /ONAPPORTAL/portalApi/healthCheck
> [ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, 
> status=None)) after connection broken by 
> 'NewConnectionError(' 0x7f620b6fb990>: Failed to establish a new connection: [Errno 111] Connection 
> refused',)': /ONAPPORTAL/portalApi/healthCheck
> | FAIL |
> ConnectionError: HTTPConnectionPool(host='10.0.9.1', port=8989): Max retries 
> exceeded with url: /ONAPPORTAL/portalApi/healthCheck (Caused by 
> NewConnectionError(' 0x7f620baa1910>: Failed to establish a new connection: [Errno 111] Connection 
> refused',))
>  
>  
> Regards,
>  
> Helen Chen
>  
> From: "FREEMAN, BRIAN D" 
> Date: Monday, October 30, 2017 at 9:02 AM
> To: Kang Xi , Helen Chen 00725961 
> , onap-discuss 
> Subject: RE: [integration] Integration-SB-00
>  
> Kang,
>  
> Can you retry this morning. In Integration a fresh portal seems to be working 
> ?
>  
> Brian
>  
>  
> From: onap-discuss-boun...@lists.onap.org 
> [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Kang Xi
> Sent: Monday, October 30, 2017 11:58 AM
> To: Yunxia Chen ; onap-discuss 
> 
> Subject: Re: [onap-discuss] [integration] Integration-SB-00
>  
> Hi Helen,
>  
> Portal is not working in my weekend install: 
> https://jira.onap.org/browse/INT-313
>  
> Regards,
> Kang
>  
> From: onap-discuss-boun...@lists.onap.org 
> [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Yunxia Chen
> Sent: Monday, October 30, 2017 11:47
> To: onap-discuss 
> Subject: [onap-discuss] [integration] Integration-SB-00
>  
> Hi,
> Anyone is using Integration-SB-00 for any integration testing at this moment? 
> I will re-create the vms if no one is using it.
>  
> Anyone uses Integration space, please log here and put the owner name, by 
> default, it is Helen Chen. Once, you finish your testing, please release it 
> back to the pool: we are currently used 90% of the memory.
>  
> https://wiki.onap.org/display/DW/Integration+Test+Labs
>  
> Regards,
> Helen Chen
>  

___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss

Re: [onap-discuss] [ONAP Helpdesk #45358] [integration][confluence] Developer Wiki > O-Parent (oparent)

2017-09-05 Thread LOTT, CHRISTOPHER M (CHRISTOPHER) via RT 
All I can offer is my experience, namely that the deploy step failed when my 
POM used "ecomp-snapshots":

   
https://logs.onap.org/production/vex-yul-ecomp-jenkins-1/portal-sdk-master-ecomp-sdk-merge-java/12/console.log.gz

And succeeded when my POM used "snapshots":

  
https://logs.onap.org/production/vex-yul-ecomp-jenkins-1/portal-sdk-master-ecomp-sdk-merge-java/13/console.log.gz

The error log shows "ecomp-snapshots" but the success log shows no server IDs 
at all.  Could it have been something transient?  Sure, but that seems like a 
bit of stretch.


> On Sep 5, 2017, at 3:07 PM, Jessica Wagantall via RT 
>  wrote:
> 
> Dear Gary, 
> 
> Just to confirm, we are still using ecomp-staging, ecomp-snapshots and (if 
> your project needs it) ecomp-site. Those are the servers that we have defined 
> in the Jenkins config files. The pom files can still have the ecomp-releases 
> block but this ServerID will no longer be accessible from the Jenkins 
> configuration files due to all the previous accidental pushes into the 
> release repo.
> 
> I have discussed with Andy the future change to remove the "ecomp-" prefix 
> from the ServerIds in order to make them more generic. This is a big change 
> and surely will take a lot of effort. For now, if we see teams using the 
> generic names, I make sure the config files matches those generic names too. 
> 
> The unauthorized errors are tricky becuase it can be problems with the parent 
> pom.xml, the privileges, the user/pass combo, the group-id... 
> 
> Thanks!
> Jess


___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss