How to make use of a custom executor?

2016-07-16 Thread Mark Hammons
cutor with java -jar seems to work somewhat, but some of the tasks are reporting errors after I do that. Does anyone have some good examples of actually using a custom executor?-- Mark Hammons - +33 06 03 69 56 56 Research Engineer @ BioEmergences[1] Lab Phone: 01 69 82 34 19 [1] bioemerg

Re: How to make use of a custom executor?

2016-07-18 Thread Mark Hammons
om/mesosphere/RENDLER. > > Sent from my iPhone > > > On Jul 16, 2016, at 14:29, Mark Hammons > > wrote: > > > > Hi All, > > > > I'm trying to make a service in our labs into a custom framework that will > > launch tasks in our (prospective) mesos

Having slaves notify masters of other resources/properties of the slave?

2016-07-23 Thread Mark Hammons
Is there any way to have a slave specify that it is capable of running cuda apps, and make it to where tasks that request cuda resources are only executed on those slaves?-- Mark Hammons - +33 06 03 69 56 56 Research Engineer @ BioEmergences[1] Lab Phone: 01 69 82 34 19 [1

Re: Having slaves notify masters of other resources/properties of the slave?

2016-07-23 Thread Mark Hammons
s as cuda role or add attribute to run tasks > on this agent.-- Mark Hammons - +33 06 03 69 56 56 Research Engineer @ BioEmergences[1] Lab Phone: 01 69 82 34 19 [1] bioemergences.iscpif.fr signature.asc Description: This is a digitally signed message part.

Re: Having slaves notify masters of other resources/properties of the slave?

2016-07-23 Thread Mark Hammons
turday, July 23, 2016 06:10:14 PM Krish wrote: > Hi Mark, > Just add a --attributes=":,:" to the mesos > slave/agent; say, --attributes="capabilities:cuda". > > https://open.mesosphere.com/reference/mesos-slave/ > > > > -- > κρισhναν > > On Sa

Re: Having slaves notify masters of other resources/properties of the slave?

2016-07-23 Thread Mark Hammons
on then attributes will be easiest > option. After adding agent attributes, add constraints to you app > definition https://mesosphere.github.io/marathon/docs/constraints.html > > sob., 23.07.2016, 14:37 użytkownik Mark Hammons < > > mark.hamm...@inaf.cnrs-gif.fr> napisał: &g

Re: Having slaves notify masters of other resources/properties of the slave?

2016-07-23 Thread Mark Hammons
tation/latest/architecture/ You can write > one on your own or use some existing like Marathon depending on your > needs. > Both HTTP API and native API supports constraints but at offer accepting > level. > > sob., 23.07.2016, 15:04 użytkownik Mark Hammons < > > mark.

Running a mesos executor within a container....

2016-07-31 Thread Mark Hammons
there any way to do what I'm trying to do? Could someone give me an example project that works this way? Thanks, Mark-- Mark Hammons - +33 06 03 69 56 56 Research Engineer @ BioEmergences[1] Lab Phone: 01 69 82 34 19 [1] bioemergences.iscpif.fr signature.asc Description: This is a digitally signed message part.

Re: Running a mesos executor within a container....

2016-07-31 Thread Mark Hammons
ssing. Is there any way to do what I'm trying to do? > Could someone give me an example project that works this way? > > Thanks, > Mark-- > Mark Hammons - +33 06 03 69 56 56 > Research Engineer @ BioEmergences[1] > Lab Phone: 01 69 82 34 19 > > > [1] bioem

Re: Running a mesos executor within a container....

2016-08-01 Thread Mark Hammons
> Yes, you need package the native library(libmesos) which required by executor > into your jar or package it into your docker container. > Or you could consider implementing your executor base on the new HTTP API > (https://github.com/mesosphere/mesos-rxjava) > >> On

Re: Running a mesos executor within a container....

2016-08-02 Thread Mark Hammons
is > the mounted path of the sandbox in the docker container. > > On Mon, Aug 1, 2016 at 8:21 PM, Mark Hammons > wrote: > > I'll double check, but last time I du -sh the var folder in the container > > it was too small to contain the binaries I downloaded. > >

Using mesos' cfs limits on a docker container?

2016-08-13 Thread Mark Hammons
x27;d like my executor/algorithm to run inside a docker container, but have that container's memory and cpu usage controlled by systemd/mesos. Thanks, Mark-- Mark Hammons - +33 06 03 69 56 56 Research Engineer @ BioEmergences[1] Lab Phone: 01 69 82 34 19 [1] bioemergences

Re: Using mesos' cfs limits on a docker container?

2016-08-14 Thread Mark Hammons
, > try using the Unified containerizer. > See the latter half of this document: > http://mesos.apache.org/documentation/latest/mesos-containerizer/ > >> On Sat, Aug 13, 2016 at 7:02 PM, Mark Hammons >> wrote: >> Hi All, >> >> I was having a lot

Re: Using mesos' cfs limits on a docker container?

2016-08-14 Thread Mark Hammons
m and how did you overcome it? (i.e. This would be a sad > resolution to this thread for someone faced with this same problem in the > future.) > >> On Sunday, August 14, 2016, Mark Hammons >> wrote: >> I finally got this working after fiddling with it all night.

Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
Hi all, I've been working with the mesos containerizer to handle my docker containers recently. I created a docker container that requires libtiff.so.5, and the application within it runs well. But when I try to run it within the mesos containerizer I get an error saying libtiff.so.5 doesn't ex

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
ght need > to setup LD_LIBRARY_PATH in your env while launching the image so that the > container process knows where to look for the shared object. > > On Mon, Oct 17, 2016 at 5:21 AM, Mark Hammons > wrote: > > > > Hi all, > > > > I've been work

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
the container's file system or the host file system? > > On Mon, Oct 17, 2016 at 6:47 AM, Mark Hammons > wrote: > > > > Yes, it's installed under /usr/lib/x86_64 or whatever the multilib path is > > in > > debian. It seems files under this path are not

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
the container's file system or the host file system? > > On Mon, Oct 17, 2016 at 6:47 AM, Mark Hammons > wrote: > > > > Yes, it's installed under /usr/lib/x86_64 or whatever the multilib path is > > in > > debian. It seems files under this path are not

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
No, but even when I set LD_PRELOAD=/usr/lib/libtiff.so.5 for the process environment it says it can't load /usr/lib/libtiff.so.5. On Monday, October 17, 2016 7:52:16 AM CEST Avinash Sridharan wrote: > Are you setting the env in the dockerfile? > > On Mon, Oct 17, 2016 at 6:58 AM

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
; libraries so found a bit odd that you are using it here? > > On Mon, Oct 17, 2016 at 7:54 AM, Mark Hammons > wrote: > > > > No, but even when I set LD_PRELOAD=/usr/lib/libtiff.so.5 for the process > > environment it says it can't load /usr/lib/libtiff.so.5

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
Adding LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu doesn't fix the error. On Monday, October 17, 2016 5:06:34 PM CEST Mark Hammons wrote: > As I've shown in the original logs, the symbolic link libtiff.so.5 is in > /usr/ lib. I used LD_PRELOAD just to try to force /usr/lib/libt

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
No, it's a regular linux log. I've reattached it. On Monday, October 17, 2016 8:32:07 AM CEST Avinash Sridharan wrote: > can't seem to open the attached logs, is it gzip? > > On Mon, Oct 17, 2016 at 8:14 AM, Mark Hammons > wrote: > > > > Adding LD_LIBRARY

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
the exact version of Mesos and the Distro you are > trying to run this on. > > -Avinash > > On Mon, Oct 17, 2016 at 8:35 AM, Mark Hammons > wrote: > > > > No, it's a regular linux log. I've reattached it. > > > > On Monday, October 17, 2016 8

Re: Problems with shared libraries with mesos containerization....

2016-10-17 Thread Mark Hammons
t; > are > > trying to run this on. > > > > -Avinash > > > > On Mon, Oct 17, 2016 at 8:35 AM, Mark Hammons < > > > > mark.hamm...@inaf.cnrs-gif.fr> wrote: > >> No, it's a regular linux log. I've reattached it. > >> &g

Getting files from a container after a task?

2016-10-20 Thread Mark Hammons
Hi all, Mesos provides the functionality to send data at the end of a task, but is there any way to send large files? Something like downloading files with CommandInfo, but for the results of a task. I'm currently getting this behavior by having a custom executor that downloads and uploads the

Suspend a running task?

2017-03-16 Thread Mark Hammons
Can you suspend a running task with mesos? I see that it can be killed, but it would be nice to have the ability to suspend tasks for a preemptive scheduler.