Task properties/attributes?

2015-03-20 Thread James Vanns
Does a mesos task feature a URI attribute or list thereof? For downloading data automatically within the sandbox in which the command will execute? Eg. upon defining a task I wish to supply a list of sources from which to download various different types of data all destined for the container that

Re: Mesos Slave Attributes

2015-03-13 Thread James Vanns
/acaee563a66e5528ae5c5e417f2a811f8ee466b2/include/mesos/mesos.proto#L618 . If you want to check the slave attributes you can check the state.json on the slave by looking at this endpoint: http:// host:port/slave(1)/state.json On Thu, Mar 12, 2015 at 11:00 AM, James Vanns jvanns@gmail.com wrote: I think

Threading model of mesos API (C++)

2015-06-09 Thread James Vanns
Hi. I'm toying with the mesos scheduler (C++) API and running into unexpected race conditions. I have *not* synchronised access to attributes of my Scheduler-derived class. Is the mesos library code threaded and network communication asynchronous? What it *looks like* I'm seeing is my

Re: Threading model of mesos API (C++)

2015-06-09 Thread James Vanns
. Just so I know what I need to protect access to ;) Cheers, Jim On 9 June 2015 at 16:58, James Vanns jvanns@gmail.com wrote: Hi. I'm toying with the mesos scheduler (C++) API and running into unexpected race conditions. I have *not* synchronised access to attributes of my Scheduler-derived

Re: Threading model of mesos API (C++)

2015-06-10 Thread James Vanns
method must complete before the next is called. So, we recommend that you don't block inside the callbacks. Otherwise, you're blocking the driver as well and your own ability to continue processing callbacks. On Tue, Jun 9, 2015 at 8:58 AM, James Vanns jvanns@gmail.com wrote: Hi. I'm

Re: Debugging framework registration from inside docker

2015-06-11 Thread James Vanns
! Jim On 10 June 2015 at 18:16, Steven Schlansker sschlans...@opentable.com wrote: On Jun 10, 2015, at 10:10 AM, James Vanns jvanns@gmail.com wrote: Hi. When attempting to run my scheduler inside a docker container in --net=bridge mode it never receives acknowledgement or a reply

Re: Debugging framework registration from inside docker

2015-06-11 Thread James Vanns
Looks like I share the same symptoms as this 'marathon inside container' problem; https://groups.google.com/d/topic/marathon-framework/aFIlv-VnF58/discussion I guess that sheds some light on the subject ;) On 11 June 2015 at 09:43, James Vanns jvanns@gmail.com wrote: For what exactly? I

Re: Debugging framework registration from inside docker

2015-06-11 Thread James Vanns
someone will correct me where I'm wrong ;) Cheers, Jim On 11 June 2015 at 10:00, James Vanns jvanns@gmail.com wrote: Looks like I share the same symptoms as this 'marathon inside container' problem; https://groups.google.com/d/topic/marathon-framework/aFIlv-VnF58/discussion I guess

Re: Threading model of mesos API (C++)

2015-06-11 Thread James Vanns
Excellent. Thank you both for your time and efforts - and most importantly clarifying behavior :) Jim

Re: Threading model of mesos API (C++)

2015-06-10 Thread James Vanns
complex async code base I manage. I'll get back to you. - alex On Wed, Jun 10, 2015 at 6:15 AM, James Vanns jvanns@gmail.com wrote: Thanks for the responses, guys. That link of the 'detailed description' will be handy - I've not come across that before. I do now have another question

Debugging framework registration from inside docker

2015-06-10 Thread James Vanns
Hi. When attempting to run my scheduler inside a docker container in --net=bridge mode it never receives acknowledgement or a reply to that request. However, it works fine in --net=host mode. It does not listen on any port as a service so does not expose any. The scheduler receives the mesos

Re: Debugging framework registration from inside docker

2015-06-12 Thread James Vanns
Hi Vinod - this is good news! Just the fact that I'm not barking up the wrong tree and that indeed it is a known issue. Cheers Jim On 11 June 2015 at 18:16, Vinod Kone vinodk...@gmail.com wrote: On Thu, Jun 11, 2015 at 4:00 AM, James Vanns jvanns@gmail.com wrote: I think I can

Re: Tasks that run docker images consistently fail while downloading

2015-10-28 Thread James Vanns
s come to you in error you must take no action based on it, nor > must you copy or show it to anyone; please delete/destroy and inform the > sender immediately. > > On Wednesday, 28 October 2015 at 13:06, James Vanns wrote: > > I shall fix my own problem it's embarrassing.

Re: Tasks that run docker images consistently fail while downloading

2015-10-28 Thread James Vanns
I shall fix my own problem it's embarrassing. Top marks to those of you that notice I supplied 3000 instead of 3 (which I understand is actually the default anyway) to task_launch_timeout! Jim On 28 October 2015 at 10:21, James Vanns <jvanns@gmail.com> wrote: > Hi all.

Re: Tasks that run docker images consistently fail while downloading

2015-10-28 Thread James Vanns
radgruchalski/ > > > *Confidentiality:*This communication is intended for the above-named > person and may be confidential and/or legally privileged. > If it has come to you in error you must take no action based on it, nor > must you copy or show it to anyone; please delete/destroy and i

Mesos master metrics endpoint?

2015-09-23 Thread James Vanns
Hi all. It appears there is a glaring omission in the 'Tasks' section of the following doc; http://mesos.apache.org/documentation/latest/monitoring/ Shouldn't there be a 'Tasks waiting' metric!? We generally have tasks hanging around for a while because their resource requests can't (yet) be met

Re: Task still 'active' after TASK_FINISHED status

2015-11-25 Thread James Vanns
you don't actually > exit the executor process. Is this using CommandExecutor or a custom one? > > On Wed, Nov 25, 2015 at 5:01 AM James Vanns <jvanns@gmail.com> wrote: > >> Er, I could. At the moment it's pretty huge so maybe I'll just try and >> trim it down a bit.

Re: Task still 'active' after TASK_FINISHED status

2015-11-25 Thread James Vanns
to switch frameworks suddenly - this was simpler because it was one task instead of 100s. Jim On 24 November 2015 at 17:57, Vinod Kone <vinodk...@gmail.com> wrote: > Can you paste the logs? > > On Tue, Nov 24, 2015 at 2:16 AM, James Vanns <jvanns@gmail.com> wrote: > >&

statusUpdate() duplicate messages?

2015-11-18 Thread James Vanns
Hello list. We have an experimental framework (C++ API) based on Mesos 0.24 and we're seeing duplicate task status messages -- eg. 2 'FINISHED' messages for a single task. This may well be normal behaviour but I wasn't prepared for it. Could someone point me in the direction of a decent

Re: statusUpdate() duplicate messages?

2015-11-18 Thread James Vanns
I think that’s all correct! The docs will be able to > clarify better :-) > > On 18 Nov 2015, at 12:09, James Vanns <jvanns@gmail.com> wrote: > > Hello list. > > We have an experimental framework (C++ API) based on Mesos 0.24 and we're > seeing duplicate t

Task still 'active' after TASK_FINISHED status

2015-11-24 Thread James Vanns
Hi again list. Mesos 0.24 C++ Framework (still using the Protobufs based comms, not REST) My framework appears to be holding onto offers (somehow) from tasks that are finished!? I don't understand why. The task comprises of a shell command that executes within a docker container. The return code

Simple question about slave<->master latency?

2016-05-11 Thread James Vanns
Is the latency (perhaps the weighted rolling average) between master and a slave measured? If so, is it recorded as an attribute of a slave object in the scheduler API? Cheers, Jim -- Senior Production Engineer Industrial Light & Magic