JIRA: API Tech Debt

[Greg Mann]

Hi all,
As discussed during the last API working group meeting, I've created an
epic in JIRA to collect API-related tech debt which we would like to
address before/during the development of the v2 API: MESOS-8700
.

AFAIK there's no projected timeline yet for v2 API development, but this
epic can provide us with a place to track issues we want to make sure are
addressed in the new API, whenever we begin the design in earnest. If you
know of any existing tickets which fit this description, please add them to
the epic.

Thanks!
Greg

API Working Group Meeting Today

[Greg Mann]

Hey folks,
Sorry for the late reminder - the API working group will meet this morning
at 11am PST. Zhitao will be presenting the new volume resizing feature he's
designing, and we'll have a discussion on the current state and future
directions of the Mesos CLI. If you have any other items for discussion,
feel free to add them to the agenda document here

!

Cheers,
Greg

Re: Introducing `support/mesos-build.sh`

[Tomek Janiszewski]

Other jobs finish in 50 min but they do clang/gcc and cmake/auttools checks
so total build time takes 2h.
I hope we can make next release with ARM binaries. Tere was some proposal
of making official Mesos binaries (debs, rpms etc) so we can plug in this
process.

wt., 20 mar 2018 o 15:35 użytkownik Ed Vielmetti  napisał:

> Congratulations Tomek and good job.
>
> How does build time on this system compare to other systems?
>
> When you have something packaged for release I'd love to give it a try.
>
> On Tue, Mar 20, 2018 at 8:54 AM, Tomek Janiszewski 
> wrote:
>
>> Thank you!
>>
>> ARM builds are passing right now [0]. We are using ubuntu-16.04-arm image
>> [1]. I think from next release we can consider ARM as a supported platform!
>>
>> 0:
>> https://builds.apache.org/job/Mesos-Buildbot-ARM/BUILDTOOL=autotools,COMPILER=gcc,CONFIGURATION=--verbose%20--disable-libtool-wrappers%20--disable-java%20--disable-python,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1%20%20MESOS_TEST_AWAIT_TIMEOUT=60secs%20JOBS=16,label_exp=arm/453/
>> 1: https://hub.docker.com/r/mesos/mesos-build/tags/
>>
>> wt., 20 mar 2018 o 13:30 użytkownik Benjamin Bannier <
>> benjamin.bann...@mesosphere.io> napisał:
>>
>>> Done.
>>>
>>> > On Mar 20, 2018, at 10:46 AM, Tomek Janiszewski 
>>> wrote:
>>> >
>>> > Thanks for merging. Can we push this image to dockerhub tagged as
>>> > ubuntu-16.04-arm? Then we will need to update CI configuration to:
>>> > JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=cmake COMPILER=gcc
>>> > CONFIGURATION='--disable-java --disable-python
>>> --disable-libtool-wrappers'
>>> > ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ../mesos-build.sh
>>> > or
>>> > JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=autotools COMPILER=gcc
>>> > CONFIGURATION='--disable-java --disable-python
>>> --disable-libtool-wrappers'
>>> > ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ./support/mesos-build.sh
>>> >
>>> >
>>> > pon., 19 mar 2018 o 16:24 użytkownik Tomek Janiszewski <
>>> jani...@gmail.com>
>>> > napisał:
>>> >
>>> >> Dockerfile for ARM with CMake support
>>> https://reviews.apache.org/r/66138/
>>> >>
>>> >> pon., 12 lut 2018 o 15:41 użytkownik Tomek Janiszewski <
>>> jani...@gmail.com>
>>> >> napisał:
>>> >>
>>> >>> How can I use it for our ARM CI?
>>> >>>
>>> >>> JOBS=16 OS=arm64v8/ubuntu:16.04  ./support/mesos-build.sh
>>> >>> + set -e
>>> >>> + set -o pipefail
>>> >>> + : arm64v8/ubuntu:16.04
>>> >>> + : autotools
>>> >>> + : gcc
>>> >>> + : '--verbose --disable-libtool-wrappers'
>>> >>> + : 'GLOG_v=1 MESOS_VERBOSE=1'
>>> >>> + : 16
>>> >>> ++ git rev-parse --show-toplevel
>>> >>> + MESOS_DIR=/home/janisz/mesos
>>> >>> ++ git diff-index --quiet HEAD --
>>> >>> + docker run --rm -v /home/janisz/mesos:/SRC:Z -e
>>> BUILDTOOL=autotools -e
>>> >>> COMPILER=gcc -e 'CONFIGURATION=--verbose --disable-libtool-wrappers'
>>> -e
>>> >>> 'ENVIRONMENT=GLOG_v=1 MESOS_VERBOSE=1' -e JOBS=16
>>> >>> mesos/mesos-build:arm64v8/ubuntu-16.04
>>> >>> docker: invalid reference format.
>>> >>> See 'docker run --help'.
>>> >>>
>>> >>>
>>> >>> czw., 8 lut 2018 o 07:38 użytkownik Michael Park 
>>> >>> napisał:
>>> >>>
>>>  The first run looks good!
>>>  https://builds.apache.org/job/Mesos-Buildbot/4890/
>>> 
>>>  [image: Screen Shot 2018-02-07 at 10.30.51 PM.png]
>>>  On Wed, Feb 7, 2018 at 8:39 PM Michael Park 
>>> wrote:
>>> 
>>> > Yep, Just landed! Waiting for
>>>  https://builds.apache.org/job/Mesos-Buildbot to
>>> > pick it up.
>>> >
>>> > On Wed, Feb 7, 2018 at 8:27 PM Vinod Kone 
>>>  wrote:
>>> >
>>> >> Yay, thanks MPark! Has the change landed already?
>>> >>
>>> >> On Wed, Feb 7, 2018 at 8:23 PM, Michael Park 
>>>  wrote:
>>> >>
>>> >>> Many of you probably know that we currently have
>>> >> `support/docker-build.sh`
>>> >>> to power our CI for our various configurations. One of the
>>> problems
>>>  for
>>> >> us
>>> >>> has been that we create a `Dockerfile` ad-hoc and invoke `docker
>>>  build`
>>> >>> with it. This is very inefficient and also leads to flaky issues
>>>  around
>>> >>> `apt-get install`.
>>> >>>
>>> >>> I've introduced `support/mesos-build.sh` which operates off of
>>>  docker
>>> >>> images hosted on Dockerhub instead, and should aid in bringing us
>>>  faster
>>> >>> and more stable CI results!
>>> >>>
>>> >>> As a bonus, we now also test Clang on the CentOS 7!
>>> >>>
>>> >>> Thanks,
>>> >>>
>>> >>> MPark
>>> >>>
>>> >>
>>> >
>>> 
>>> >>>
>>>
>>>
>
>
> --
> Edward Vielmetti
> +1 734 330 2465 <(734)%20330-2465>
> e...@packet.net
> http://worksonarm.com
>

Re: Introducing `support/mesos-build.sh`

[Tomek Janiszewski]

Thank you!

ARM builds are passing right now [0]. We are using ubuntu-16.04-arm image
[1]. I think from next release we can consider ARM as a supported platform!

0:
https://builds.apache.org/job/Mesos-Buildbot-ARM/BUILDTOOL=autotools,COMPILER=gcc,CONFIGURATION=--verbose%20--disable-libtool-wrappers%20--disable-java%20--disable-python,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1%20%20MESOS_TEST_AWAIT_TIMEOUT=60secs%20JOBS=16,label_exp=arm/453/
1: https://hub.docker.com/r/mesos/mesos-build/tags/

wt., 20 mar 2018 o 13:30 użytkownik Benjamin Bannier <
benjamin.bann...@mesosphere.io> napisał:

> Done.
>
> > On Mar 20, 2018, at 10:46 AM, Tomek Janiszewski 
> wrote:
> >
> > Thanks for merging. Can we push this image to dockerhub tagged as
> > ubuntu-16.04-arm? Then we will need to update CI configuration to:
> > JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=cmake COMPILER=gcc
> > CONFIGURATION='--disable-java --disable-python
> --disable-libtool-wrappers'
> > ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ../mesos-build.sh
> > or
> > JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=autotools COMPILER=gcc
> > CONFIGURATION='--disable-java --disable-python
> --disable-libtool-wrappers'
> > ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ./support/mesos-build.sh
> >
> >
> > pon., 19 mar 2018 o 16:24 użytkownik Tomek Janiszewski <
> jani...@gmail.com>
> > napisał:
> >
> >> Dockerfile for ARM with CMake support
> https://reviews.apache.org/r/66138/
> >>
> >> pon., 12 lut 2018 o 15:41 użytkownik Tomek Janiszewski <
> jani...@gmail.com>
> >> napisał:
> >>
> >>> How can I use it for our ARM CI?
> >>>
> >>> JOBS=16 OS=arm64v8/ubuntu:16.04  ./support/mesos-build.sh
> >>> + set -e
> >>> + set -o pipefail
> >>> + : arm64v8/ubuntu:16.04
> >>> + : autotools
> >>> + : gcc
> >>> + : '--verbose --disable-libtool-wrappers'
> >>> + : 'GLOG_v=1 MESOS_VERBOSE=1'
> >>> + : 16
> >>> ++ git rev-parse --show-toplevel
> >>> + MESOS_DIR=/home/janisz/mesos
> >>> ++ git diff-index --quiet HEAD --
> >>> + docker run --rm -v /home/janisz/mesos:/SRC:Z -e BUILDTOOL=autotools
> -e
> >>> COMPILER=gcc -e 'CONFIGURATION=--verbose --disable-libtool-wrappers' -e
> >>> 'ENVIRONMENT=GLOG_v=1 MESOS_VERBOSE=1' -e JOBS=16
> >>> mesos/mesos-build:arm64v8/ubuntu-16.04
> >>> docker: invalid reference format.
> >>> See 'docker run --help'.
> >>>
> >>>
> >>> czw., 8 lut 2018 o 07:38 użytkownik Michael Park 
> >>> napisał:
> >>>
>  The first run looks good!
>  https://builds.apache.org/job/Mesos-Buildbot/4890/
> 
>  [image: Screen Shot 2018-02-07 at 10.30.51 PM.png]
>  On Wed, Feb 7, 2018 at 8:39 PM Michael Park  wrote:
> 
> > Yep, Just landed! Waiting for
>  https://builds.apache.org/job/Mesos-Buildbot to
> > pick it up.
> >
> > On Wed, Feb 7, 2018 at 8:27 PM Vinod Kone 
>  wrote:
> >
> >> Yay, thanks MPark! Has the change landed already?
> >>
> >> On Wed, Feb 7, 2018 at 8:23 PM, Michael Park 
>  wrote:
> >>
> >>> Many of you probably know that we currently have
> >> `support/docker-build.sh`
> >>> to power our CI for our various configurations. One of the problems
>  for
> >> us
> >>> has been that we create a `Dockerfile` ad-hoc and invoke `docker
>  build`
> >>> with it. This is very inefficient and also leads to flaky issues
>  around
> >>> `apt-get install`.
> >>>
> >>> I've introduced `support/mesos-build.sh` which operates off of
>  docker
> >>> images hosted on Dockerhub instead, and should aid in bringing us
>  faster
> >>> and more stable CI results!
> >>>
> >>> As a bonus, we now also test Clang on the CentOS 7!
> >>>
> >>> Thanks,
> >>>
> >>> MPark
> >>>
> >>
> >
> 
> >>>
>
>

Re: Introducing `support/mesos-build.sh`

[Benjamin Bannier]

Done.

> On Mar 20, 2018, at 10:46 AM, Tomek Janiszewski  wrote:
> 
> Thanks for merging. Can we push this image to dockerhub tagged as
> ubuntu-16.04-arm? Then we will need to update CI configuration to:
> JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=cmake COMPILER=gcc
> CONFIGURATION='--disable-java --disable-python --disable-libtool-wrappers'
> ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ../mesos-build.sh
> or
> JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=autotools COMPILER=gcc
> CONFIGURATION='--disable-java --disable-python --disable-libtool-wrappers'
> ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ./support/mesos-build.sh
> 
> 
> pon., 19 mar 2018 o 16:24 użytkownik Tomek Janiszewski 
> napisał:
> 
>> Dockerfile for ARM with CMake support https://reviews.apache.org/r/66138/
>> 
>> pon., 12 lut 2018 o 15:41 użytkownik Tomek Janiszewski 
>> napisał:
>> 
>>> How can I use it for our ARM CI?
>>> 
>>> JOBS=16 OS=arm64v8/ubuntu:16.04  ./support/mesos-build.sh
>>> + set -e
>>> + set -o pipefail
>>> + : arm64v8/ubuntu:16.04
>>> + : autotools
>>> + : gcc
>>> + : '--verbose --disable-libtool-wrappers'
>>> + : 'GLOG_v=1 MESOS_VERBOSE=1'
>>> + : 16
>>> ++ git rev-parse --show-toplevel
>>> + MESOS_DIR=/home/janisz/mesos
>>> ++ git diff-index --quiet HEAD --
>>> + docker run --rm -v /home/janisz/mesos:/SRC:Z -e BUILDTOOL=autotools -e
>>> COMPILER=gcc -e 'CONFIGURATION=--verbose --disable-libtool-wrappers' -e
>>> 'ENVIRONMENT=GLOG_v=1 MESOS_VERBOSE=1' -e JOBS=16
>>> mesos/mesos-build:arm64v8/ubuntu-16.04
>>> docker: invalid reference format.
>>> See 'docker run --help'.
>>> 
>>> 
>>> czw., 8 lut 2018 o 07:38 użytkownik Michael Park 
>>> napisał:
>>> 
 The first run looks good!
 https://builds.apache.org/job/Mesos-Buildbot/4890/
 
 [image: Screen Shot 2018-02-07 at 10.30.51 PM.png]
 On Wed, Feb 7, 2018 at 8:39 PM Michael Park  wrote:
 
> Yep, Just landed! Waiting for
 https://builds.apache.org/job/Mesos-Buildbot to
> pick it up.
> 
> On Wed, Feb 7, 2018 at 8:27 PM Vinod Kone 
 wrote:
> 
>> Yay, thanks MPark! Has the change landed already?
>> 
>> On Wed, Feb 7, 2018 at 8:23 PM, Michael Park 
 wrote:
>> 
>>> Many of you probably know that we currently have
>> `support/docker-build.sh`
>>> to power our CI for our various configurations. One of the problems
 for
>> us
>>> has been that we create a `Dockerfile` ad-hoc and invoke `docker
 build`
>>> with it. This is very inefficient and also leads to flaky issues
 around
>>> `apt-get install`.
>>> 
>>> I've introduced `support/mesos-build.sh` which operates off of
 docker
>>> images hosted on Dockerhub instead, and should aid in bringing us
 faster
>>> and more stable CI results!
>>> 
>>> As a bonus, we now also test Clang on the CentOS 7!
>>> 
>>> Thanks,
>>> 
>>> MPark
>>> 
>> 
> 
 
>>> 

Re: Introducing `support/mesos-build.sh`

[Tomek Janiszewski]

Thanks for merging. Can we push this image to dockerhub tagged as
ubuntu-16.04-arm? Then we will need to update CI configuration to:
JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=cmake COMPILER=gcc
CONFIGURATION='--disable-java --disable-python --disable-libtool-wrappers'
ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ../mesos-build.sh
or
JOBS=16 OS=ubuntu-16.04-arm BUILDTOOL=autotools COMPILER=gcc
CONFIGURATION='--disable-java --disable-python --disable-libtool-wrappers'
ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1' ./support/mesos-build.sh


pon., 19 mar 2018 o 16:24 użytkownik Tomek Janiszewski 
napisał:

> Dockerfile for ARM with CMake support https://reviews.apache.org/r/66138/
>
> pon., 12 lut 2018 o 15:41 użytkownik Tomek Janiszewski 
> napisał:
>
>> How can I use it for our ARM CI?
>>
>> JOBS=16 OS=arm64v8/ubuntu:16.04  ./support/mesos-build.sh
>> + set -e
>> + set -o pipefail
>> + : arm64v8/ubuntu:16.04
>> + : autotools
>> + : gcc
>> + : '--verbose --disable-libtool-wrappers'
>> + : 'GLOG_v=1 MESOS_VERBOSE=1'
>> + : 16
>> ++ git rev-parse --show-toplevel
>> + MESOS_DIR=/home/janisz/mesos
>> ++ git diff-index --quiet HEAD --
>> + docker run --rm -v /home/janisz/mesos:/SRC:Z -e BUILDTOOL=autotools -e
>> COMPILER=gcc -e 'CONFIGURATION=--verbose --disable-libtool-wrappers' -e
>> 'ENVIRONMENT=GLOG_v=1 MESOS_VERBOSE=1' -e JOBS=16
>> mesos/mesos-build:arm64v8/ubuntu-16.04
>> docker: invalid reference format.
>> See 'docker run --help'.
>>
>>
>> czw., 8 lut 2018 o 07:38 użytkownik Michael Park 
>> napisał:
>>
>>> The first run looks good!
>>> https://builds.apache.org/job/Mesos-Buildbot/4890/
>>>
>>> [image: Screen Shot 2018-02-07 at 10.30.51 PM.png]
>>> On Wed, Feb 7, 2018 at 8:39 PM Michael Park  wrote:
>>>
>>> > Yep, Just landed! Waiting for
>>> https://builds.apache.org/job/Mesos-Buildbot to
>>> > pick it up.
>>> >
>>> > On Wed, Feb 7, 2018 at 8:27 PM Vinod Kone 
>>> wrote:
>>> >
>>> >> Yay, thanks MPark! Has the change landed already?
>>> >>
>>> >> On Wed, Feb 7, 2018 at 8:23 PM, Michael Park 
>>> wrote:
>>> >>
>>> >> > Many of you probably know that we currently have
>>> >> `support/docker-build.sh`
>>> >> > to power our CI for our various configurations. One of the problems
>>> for
>>> >> us
>>> >> > has been that we create a `Dockerfile` ad-hoc and invoke `docker
>>> build`
>>> >> > with it. This is very inefficient and also leads to flaky issues
>>> around
>>> >> > `apt-get install`.
>>> >> >
>>> >> > I've introduced `support/mesos-build.sh` which operates off of
>>> docker
>>> >> > images hosted on Dockerhub instead, and should aid in bringing us
>>> faster
>>> >> > and more stable CI results!
>>> >> >
>>> >> > As a bonus, we now also test Clang on the CentOS 7!
>>> >> >
>>> >> > Thanks,
>>> >> >
>>> >> > MPark
>>> >> >
>>> >>
>>> >
>>>
>>