otka)
From: Kevin Sweeney [mailto:kevi...@apache.org]
Sent: Wednesday, August 12, 2015 1:52 AM
To: user@mesos.apache.org
Subject: Re: Custom python executor with Docker
Apache Aurora [1] uses a custom Python executor and supports Docker via the
containerizer. There's just one problem - the con
: Custom python executor with Docker
We would also be interested in some sort of standardised DockerExecutor which
would allow us to add pre and post launch steps.
Also having the ability to run two containers together as one task would be
very useful (ie on the same host and linked together
Yeah.. it'd be nice to do it natively though :)
From: Plotka, Bartlomiej [bartlomiej.plo...@intel.com]
Sent: 10 November 2015 15:38
To: user@mesos.apache.org
Subject: RE: Custom python executor with Docker
This is somehow possible using Kubernetes over Mesos
: Tom Fordon [tom.for...@gmail.com]
Sent: 12 August 2015 00:28
To: user@mesos.apache.org
Subject: Re: Custom python executor with Docker
We ended up implementing a solution where we did the pre/post steps as separate
mesos tasks and adding logic to our scheduler to ensure they were run
m: Plotka, Bartlomiej [bartlomiej.plo...@intel.com]
> Sent: 10 November 2015 15:38
> To: user@mesos.apache.org
> Subject: RE: Custom python executor with Docker
>
> This is somehow possible using Kubernetes over Mesos:
> https://github.com/kubernetes/kubernetes/blob/master/docs/get
/ 8800836581
*From:* James DeFelice [mailto:james.defel...@gmail.com]
*Sent:* 09 April 2015 18:12
*To:* user@mesos.apache.org
*Subject:* Re: Custom python executor with Docker
If you can run the pre/post steps in a container then I'd recommend
building a Docker image that includes your pre/post
Apache Aurora [1] uses a custom Python executor and supports Docker via the
containerizer. There's just one problem - the container has to have a
Python2.7 runtime inside that can run the executor PEX file [2]. So if
you're okay with that restriction you're in business (and you can use the
Aurora
2015 18:12
To: user@mesos.apache.org
Subject: Re: Custom python executor with Docker
If you can run the pre/post steps in a container then I'd recommend building a
Docker image that includes your pre/post step scripting + your algorithm and
launching it using the built-in mesos Docker
If you can run the pre/post steps in a container then I'd recommend
building a Docker image that includes your pre/post step scripting + your
algorithm and launching it using the built-in mesos Docker containerizer.
It's much simpler than managing the lifetime of the Docker container
yourself.
On
Hi Tom,
Docker cgroup parenting recently landed, so recovering from such a tricky
situation may no longer be as difficult if docker containers are parented
to the executor's cgroup at run-time.
On Tue, Apr 7, 2015 at 7:15 PM, Tom Arnfeld t...@duedil.com wrote:
It's not possible to invoke the
Hi Tom(s),
Tom Arnfeld is right, if you want to launch your own docker container
in your custom executor you will have to handle all the issues
yourself and not able to use the Docker containerizer at all.
Alternatively, you can actually launch your custom executor in a
Docker container by
It's not possible to invoke the docker containerizer from outside of Mesos, as
far as I know.
If you persue this route, you can run into issues with orphaned containers as
your executor may die for some unknown reason, and the container is still
running. Recovering from this can be tricky
Hi. I'm trying to understand using docker within a custom executor. For
each of my tasks, I would like to perform some steps on the node before
launching a docker container. I was planning on writing a custom python
executor for this, but I wasn't sure how to launch docker from within this
13 matches
Mail list logo
