Change in osmo-ci[master]: gerrit, master builds: build almost all in docker

2019-10-18 Thread osmith
osmith has submitted this change. ( 
https://gerrit.osmocom.org/c/osmo-ci/+/15584 )

Change subject: gerrit, master builds: build almost all in docker
..

gerrit, master builds: build almost all in docker

Instead of building some projects in docker, and some directly on the
build slave, build almost all of them in docker with few exceptions, and
make building in docker the default.

This has several advantages:
* build environment of master builds and gerrit verifications is the
  same, therefore the same build won't pass in gerrit and then fail in
  master
* all build environments are volatile
* no more conflicts while running VTY/CTRL tests
* fix osmo-python-tests gerrit review versions being installed to
  /usr/local of build slave (see previous commit message)

Projects that still do not get built in docker:
* openggsn: depends on libgtpnl, but does not build it in jenkins.sh
* osmo-bts: l1headers, various SDKs not installed in the docker image
* osmo-trx: LimeSuite is not in the docker image (and just installing the
debian package does not work)
* osmo-ttcn3-hacks: TTCN-3 not installed in docker image
* pysim: needs to access real sim cards attached to the host
* sysmo-usim-tool: needs to access real sim cards attached to the host

Related: OS#3726, OS#3598
Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
---
M jobs/gerrit-verifications.yml
M jobs/master-builds.yml
2 files changed, 34 insertions(+), 42 deletions(-)

Approvals:
  laforge: Looks good to me, approved
  pespin: Looks good to me, but someone else must approve
  osmith: Verified



diff --git a/jobs/gerrit-verifications.yml b/jobs/gerrit-verifications.yml
index 693d3c3..83c7169 100644
--- a/jobs/gerrit-verifications.yml
+++ b/jobs/gerrit-verifications.yml
@@ -39,7 +39,7 @@
   -v "$PWD:/build" -v "$HOME/bin:/build_bin" \
   -v "$ARTIFACT_STORE:/artifact_store" \
 docker_img: 'osmocom:deb9_amd64'
-cmd: ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
+cmd: '{docker_run} {docker_img} /build/contrib/jenkins.sh'
 repos_url: 'ssh://jenk...@gerrit.osmocom.org:29418/{repos}'
 gerrit_project: '{repos}'

@@ -49,20 +49,18 @@

   - cellmgr-ng:
   concurrent: true
-  cmd: '{docker_run} {docker_img} /build/contrib/jenkins.sh'

   - libasn1c
   - libgtpnl
   - libosmo-abis
   - libosmo-netif
-  - libosmo-sccp:
-  cmd: WITH_MANUALS=1 ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
+  - libosmo-sccp

   - libosmocore:
   a1_name: arch
   a1: !!python/tuple [arm-none-eabi, amd64]
   combination_filter: '!(arch=="arm-none-eabi" && 
label=="FreeBSD_amd64")'
-  cmd: './contrib/jenkins_arch.sh "$arch"'
+  cmd: '{docker_run} {docker_img} /build/contrib/jenkins_arch.sh 
"$arch"'

   - libsmpp34
   - libtelnet
@@ -90,7 +88,6 @@

   - osmo-bsc:
   concurrent: true
-  cmd: '{docker_run} {docker_img} /build/contrib/jenkins.sh'

   - osmo-bts:
   a1_name: FIRMWARE_VERSION
@@ -120,19 +117,18 @@
   combination_filter: >
 (GTP == "--enable-gtp-linux" && WITH_MANUALS == "0") ||
 (GTP == "--disable-gtp-linux" && WITH_MANUALS == "1")
-  cmd: ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
+  cmd: |
+{docker_run} \
+  -e GTP="$GTP" \
+  -e WITH_MANUALS="$WITH_MANUALS" \
+  {docker_img} /build/contrib/jenkins.sh

   - osmo-gsm-manuals
-
-  - osmo-hlr:
-  cmd: WITH_MANUALS=1 ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
-
-  - osmo-iuh:
-  cmd: WITH_MANUALS=1 ./contrib/jenkins.sh
+  - osmo-hlr
+  - osmo-iuh

   - osmo-mgw:
   concurrent: true
-  cmd: '{docker_run} {docker_img} /build/contrib/jenkins.sh'

   - osmo-msc:
   a1_name: IU
@@ -195,8 +191,7 @@
   -e WITH_MANUALS="$WITH_MANUALS" \
   {docker_img} /build/contrib/jenkins.sh

-  - osmo-sip-connector:
-  cmd: WITH_MANUALS=1 ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
+  - osmo-sip-connector

   - osmo-trx:
   a1_name: INSTR
@@ -208,9 +203,9 @@
   concurrent: true
   combination_filter: >
 (INSTR == "--with-sse" && WITH_MANUALS == "1")
+  cmd: 'ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh'

-  - osmocom-bb:
-  cmd: WITH_MANUALS=1 ASCIIDOC_WARNINGS_CHECK=1 ./contrib/jenkins.sh
+  - osmocom-bb
   - osmo-tetra
   - osmo-sysmon
   - osmo-remsim
@@ -222,6 +217,7 @@

   - pysim:
   slave_axis: !!python/tuple [simtester]
+  cmd: './contrib/jenkins.sh'

   - osmo-ttcn3-hacks:
   repos_url: 'https://gerrit.osmocom.org/{repos}'
diff --git a/jobs/master-builds.yml b/jobs/master-builds.yml
index 854b991..138807e 100644
--- a/jobs/master-builds.yml
+++ b/jobs/master-bu

Change in osmo-ci[master]: gerrit, master builds: build almost all in docker

2019-10-11 Thread laforge
laforge has posted comments on this change. ( 
https://gerrit.osmocom.org/c/osmo-ci/+/15584 )

Change subject: gerrit, master builds: build almost all in docker
..


Patch Set 7: Code-Review+2


--
To view, visit https://gerrit.osmocom.org/c/osmo-ci/+/15584
To unsubscribe, or for help writing mail filters, visit 
https://gerrit.osmocom.org/settings

Gerrit-Project: osmo-ci
Gerrit-Branch: master
Gerrit-Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
Gerrit-Change-Number: 15584
Gerrit-PatchSet: 7
Gerrit-Owner: osmith 
Gerrit-Reviewer: laforge 
Gerrit-Reviewer: osmith 
Gerrit-Reviewer: pespin 
Gerrit-Comment-Date: Fri, 11 Oct 2019 10:48:50 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in osmo-ci[master]: gerrit, master builds: build almost all in docker

2019-10-11 Thread pespin
pespin has posted comments on this change. ( 
https://gerrit.osmocom.org/c/osmo-ci/+/15584 )

Change subject: gerrit, master builds: build almost all in docker
..


Patch Set 7: Code-Review+1


--
To view, visit https://gerrit.osmocom.org/c/osmo-ci/+/15584
To unsubscribe, or for help writing mail filters, visit 
https://gerrit.osmocom.org/settings

Gerrit-Project: osmo-ci
Gerrit-Branch: master
Gerrit-Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
Gerrit-Change-Number: 15584
Gerrit-PatchSet: 7
Gerrit-Owner: osmith 
Gerrit-Reviewer: laforge 
Gerrit-Reviewer: osmith 
Gerrit-Reviewer: pespin 
Gerrit-Comment-Date: Fri, 11 Oct 2019 10:47:37 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in ...osmo-ci[master]: gerrit, master builds: build almost all in docker

2019-10-11 Thread osmith
osmith has posted comments on this change. ( 
https://gerrit.osmocom.org/c/osmo-ci/+/15584 )

Change subject: gerrit, master builds: build almost all in docker
..


Patch Set 7: Verified+1


--
To view, visit https://gerrit.osmocom.org/c/osmo-ci/+/15584
To unsubscribe, or for help writing mail filters, visit 
https://gerrit.osmocom.org/settings

Gerrit-Project: osmo-ci
Gerrit-Branch: master
Gerrit-Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
Gerrit-Change-Number: 15584
Gerrit-PatchSet: 7
Gerrit-Owner: osmith 
Gerrit-Reviewer: laforge 
Gerrit-Reviewer: osmith 
Gerrit-Reviewer: pespin 
Gerrit-Comment-Date: Fri, 11 Oct 2019 08:25:03 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in ...osmo-ci[master]: gerrit, master builds: build almost all in docker

2019-10-11 Thread osmith
osmith has posted comments on this change. ( 
https://gerrit.osmocom.org/c/osmo-ci/+/15584 )

Change subject: gerrit, master builds: build almost all in docker
..


Patch Set 6: Verified+1

Tested with all projects.


--
To view, visit https://gerrit.osmocom.org/c/osmo-ci/+/15584
To unsubscribe, or for help writing mail filters, visit 
https://gerrit.osmocom.org/settings

Gerrit-Project: osmo-ci
Gerrit-Branch: master
Gerrit-Change-Id: If4b7d2f9ffbc7e92699732d97a8f5829a88c5b35
Gerrit-Change-Number: 15584
Gerrit-PatchSet: 6
Gerrit-Owner: osmith 
Gerrit-Reviewer: laforge 
Gerrit-Reviewer: osmith 
Gerrit-Reviewer: pespin 
Gerrit-Comment-Date: Fri, 11 Oct 2019 08:02:12 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment