Re: Mesos LXC container Support

[Tom Barber]

Yay! Go Antonis! ;)

On 30/11/17 18:27, Jie Yu wrote:

Antonis,

Please follow
http://mesos.apache.org/documentation/latest/advanced-contribution/#before-coding-starts
for this non-trivial feature.

I feel that for this work, adding a new Containerizer

might be the route to pursue.

- Jie

On Thu, Nov 30, 2017 at 10:16 AM, ??t ?a? 
wrote:


Hello,

I’ve been working implementing support for lxc containers in mesos, as my
thesis (I’m, a undergraduate student at the university of Athens), and
would be interested in contributing to the mesos project itself. I noticed
that currently there is no one that is working on this feature.

I read the contribution guidelines and also hopped over to the slack
server to ask for advice (that's how I was directed here).

Thank you,

Antonis Danezis






--


Spicule Limited is registered in England & Wales. Company Number: 09954122. 
Registered office: First Floor, Telecom House, 125-135 Preston Road, 
Brighton, England, BN1 6AF. VAT No. 251478891.



All engagements are subject to Spicule Terms and Conditions of Business. 
This email and its contents are intended solely for the individual to whom 
it is addressed and may contain information that is confidential, 
privileged or otherwise protected from disclosure, distributing or copying. 
Any views or opinions presented in this email are solely those of the 
author and do not necessarily represent those of Spicule Limited. The 
company accepts no liability for any damage caused by any virus transmitted 
by this email. If you have received this message in error, please notify us 
immediately by reply email before deleting it from your system. Service of 
legal notice cannot be effected on Spicule Limited by email.

Re: LXC Container Support

[Tom Barber]

Everyone appears asleep on IRC so for a non real time response:

If I were looking to replicate the docker calls but for LXC, I'd be
updating stuff in the containerizer package right? Not the top level appc
and docker packages.
https://github.com/apache/mesos/blob/master/src/slave/containerizer/

Thanks

Tom

On Thu, Oct 6, 2016 at 10:59 PM, Tom Barber <tom.bar...@meteorite.bi> wrote:

> Also just as an aside, being able to run system containers and not
> precanned Docker applications would seem to certainly be a missing feature
> that Mesos could benefit from, as it would allow sysadmins to spin up
> vanilla Ubuntu, Centos, Debian etc images without doing something funky
> like using the Docker image and tailing /dev/null. :)
>
> On Thu, Oct 6, 2016 at 2:11 AM, Tom Barber <t...@analytical-labs.com>
> wrote:
>
>> Thanks guys.  I do a lot of work with the juju ecosystem and lxc
>> containers
>> to deploy workloads with that, for example multi node big top clusters
>> etc.
>> It's far more flexible using LXC system containers than pre configured app
>> containers. This works on cloud and bare metal but I'd also like to be
>> able
>> to deploy containers to Mesos using the same technology stack.
>>
>> Cheers
>> Tom
>>
>> On 6 Oct 2016 00:51, "Jie Yu" <yujie@gmail.com> wrote:
>>
>> > Tom,
>> >
>> > I'm looking to add LXC/LXD support, POC initially then hopefully bake it
>> > > into some Mesos libraries. From what I can tell Mesos doesn't have
>> hooks
>> > > for LXC in the new container setup and also the External Shim that was
>> > > underdevelopment is Deprecated. Sound roughly accurate so far?
>> >
>> >
>> > Yup. External containerizer has been deprecated and removed. The
>> direction
>> > is to maintain only one containerizer in the future, and make that
>> > containerizer better and supports various containerization requests.
>> >
>> > If so, would extending the Unified Containerizer be the correct way to
>> go
>> > > about adding LXC/LXD support?
>> >
>> >
>> > Yes, I would prefer exploring this direction. But even before that, it
>> > would be nice to understand the motivation for using lxd. I'd prefer we
>> > find out the feature gap and augment unified containerizer to fill the
>> gap.
>> >
>> > - Jie
>> >
>> > On Wed, Oct 5, 2016 at 3:10 PM, Tom Barber <tom.bar...@meteorite.bi>
>> > wrote:
>> >
>> > > Hello folks,
>> > >
>> > > I've been Googling Mesos container support a bit recently, I see
>> support
>> > > for Mesos(AppC) and Docker in the latest versions.
>> > >
>> > > I'm looking to add LXC/LXD support, POC initially then hopefully bake
>> it
>> > > into some Mesos libraries. From what I can tell Mesos doesn't have
>> hooks
>> > > for LXC in the new container setup and also the External Shim that was
>> > > underdevelopment is Deprecated. Sound roughly accurate so far?
>> > >
>> > > If so, would extending the Unified Containerizer be the correct way
>> to go
>> > > about adding LXC/LXD support? (
>> > > http://mesos.apache.org/documentation/latest/container-image/)
>> > >
>> > > Thanks
>> > >
>> > > Tom
>> > >
>> >
>>
>
>

Re: LXC Container Support

[Tom Barber]

Also just as an aside, being able to run system containers and not
precanned Docker applications would seem to certainly be a missing feature
that Mesos could benefit from, as it would allow sysadmins to spin up
vanilla Ubuntu, Centos, Debian etc images without doing something funky
like using the Docker image and tailing /dev/null. :)

On Thu, Oct 6, 2016 at 2:11 AM, Tom Barber <t...@analytical-labs.com> wrote:

> Thanks guys.  I do a lot of work with the juju ecosystem and lxc containers
> to deploy workloads with that, for example multi node big top clusters etc.
> It's far more flexible using LXC system containers than pre configured app
> containers. This works on cloud and bare metal but I'd also like to be able
> to deploy containers to Mesos using the same technology stack.
>
> Cheers
> Tom
>
> On 6 Oct 2016 00:51, "Jie Yu" <yujie@gmail.com> wrote:
>
> > Tom,
> >
> > I'm looking to add LXC/LXD support, POC initially then hopefully bake it
> > > into some Mesos libraries. From what I can tell Mesos doesn't have
> hooks
> > > for LXC in the new container setup and also the External Shim that was
> > > underdevelopment is Deprecated. Sound roughly accurate so far?
> >
> >
> > Yup. External containerizer has been deprecated and removed. The
> direction
> > is to maintain only one containerizer in the future, and make that
> > containerizer better and supports various containerization requests.
> >
> > If so, would extending the Unified Containerizer be the correct way to go
> > > about adding LXC/LXD support?
> >
> >
> > Yes, I would prefer exploring this direction. But even before that, it
> > would be nice to understand the motivation for using lxd. I'd prefer we
> > find out the feature gap and augment unified containerizer to fill the
> gap.
> >
> > - Jie
> >
> > On Wed, Oct 5, 2016 at 3:10 PM, Tom Barber <tom.bar...@meteorite.bi>
> > wrote:
> >
> > > Hello folks,
> > >
> > > I've been Googling Mesos container support a bit recently, I see
> support
> > > for Mesos(AppC) and Docker in the latest versions.
> > >
> > > I'm looking to add LXC/LXD support, POC initially then hopefully bake
> it
> > > into some Mesos libraries. From what I can tell Mesos doesn't have
> hooks
> > > for LXC in the new container setup and also the External Shim that was
> > > underdevelopment is Deprecated. Sound roughly accurate so far?
> > >
> > > If so, would extending the Unified Containerizer be the correct way to
> go
> > > about adding LXC/LXD support? (
> > > http://mesos.apache.org/documentation/latest/container-image/)
> > >
> > > Thanks
> > >
> > > Tom
> > >
> >
>

Re: LXC Container Support

[Tom Barber]

Thanks guys.  I do a lot of work with the juju ecosystem and lxc containers
to deploy workloads with that, for example multi node big top clusters etc.
It's far more flexible using LXC system containers than pre configured app
containers. This works on cloud and bare metal but I'd also like to be able
to deploy containers to Mesos using the same technology stack.

Cheers
Tom

On 6 Oct 2016 00:51, "Jie Yu" <yujie@gmail.com> wrote:

> Tom,
>
> I'm looking to add LXC/LXD support, POC initially then hopefully bake it
> > into some Mesos libraries. From what I can tell Mesos doesn't have hooks
> > for LXC in the new container setup and also the External Shim that was
> > underdevelopment is Deprecated. Sound roughly accurate so far?
>
>
> Yup. External containerizer has been deprecated and removed. The direction
> is to maintain only one containerizer in the future, and make that
> containerizer better and supports various containerization requests.
>
> If so, would extending the Unified Containerizer be the correct way to go
> > about adding LXC/LXD support?
>
>
> Yes, I would prefer exploring this direction. But even before that, it
> would be nice to understand the motivation for using lxd. I'd prefer we
> find out the feature gap and augment unified containerizer to fill the gap.
>
> - Jie
>
> On Wed, Oct 5, 2016 at 3:10 PM, Tom Barber <tom.bar...@meteorite.bi>
> wrote:
>
> > Hello folks,
> >
> > I've been Googling Mesos container support a bit recently, I see support
> > for Mesos(AppC) and Docker in the latest versions.
> >
> > I'm looking to add LXC/LXD support, POC initially then hopefully bake it
> > into some Mesos libraries. From what I can tell Mesos doesn't have hooks
> > for LXC in the new container setup and also the External Shim that was
> > underdevelopment is Deprecated. Sound roughly accurate so far?
> >
> > If so, would extending the Unified Containerizer be the correct way to go
> > about adding LXC/LXD support? (
> > http://mesos.apache.org/documentation/latest/container-image/)
> >
> > Thanks
> >
> > Tom
> >
>

LXC Container Support

[Tom Barber]

Hello folks,

I've been Googling Mesos container support a bit recently, I see support
for Mesos(AppC) and Docker in the latest versions.

I'm looking to add LXC/LXD support, POC initially then hopefully bake it
into some Mesos libraries. From what I can tell Mesos doesn't have hooks
for LXC in the new container setup and also the External Shim that was
underdevelopment is Deprecated. Sound roughly accurate so far?

If so, would extending the Unified Containerizer be the correct way to go
about adding LXC/LXD support? (
http://mesos.apache.org/documentation/latest/container-image/)

Thanks

Tom