Re: Set LIBPROCESS_IP for frameworks launched with marathon

>>> Maybe it would be a good idea if Mesos was setting env variables named >>> AGENT_IP_0, AGENT_IP_1 and so on for every IP interface on the agent, maybe >>> AGENT_BIND_IP if bind IP is different than 0.0.0.0 That said, it’d be tricky to always be sure that IP_0 was the one you wanted. If the

Re: Removing the External Containerizer

Hey, No objections from us here to remove it. As far as our usage goes, we updated mesos-hadoop and also our own frameworks a little while ago (so we can switch to the native docker implementation). I think it’s for the best to remove it! Tom. > On 20 Apr 2016, at 22:02, Kevin Klues

Re: Mesos sometimes not allocating the entire cluster

> 3) master http endpoint for state > > Thanks, > > Guangya > > On Mon, Feb 22, 2016 at 10:57 PM, Tom Arnfeld <t...@duedil.com > <mailto:t...@duedil.com>> wrote: > Ah yes sorry my mistake, there are a couple of agents with a dev role and > only one or two fr

Re: Mesos sometimes not allocating the entire cluster

heck the master and each slave start command to > see how does role configured. You can also check this via the command: < curl > "http://master-ip:5050/master/state.json > <http://master-ip:5050/master/state.json>" 2>/dev/null| jq . > (Note: There > is a d

Re: Mesos sometimes not allocating the entire cluster

may be tripping the following issue: > https://issues.apache.org/jira/browse/MESOS-4302 > > Please have a read through this and see if it applies here. You may also > be able to apply the fix to your cluster to see if that helps things. > > Ben > > On Wed, Jan 20, 2016 at 10:19

Re: Mesos sometimes not allocating the entire cluster

> Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer > Platform OpenSource Technology, STG, IBM GCG > +86-10-8245 4084 | klaus1982...@gmail.com <mailto:klaus1982...@gmail.com> | > http://k82.me <http://k82.me/> > On Thu, Jan 21, 2016 at 11:57 PM, Tom Arnfeld <

Re: Mesos sometimes not allocating the entire cluster

ory Software Engineer > Platform OpenSource Technology, STG, IBM GCG > +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me > > On Thu, Jan 21, 2016 at 2:19 AM, Tom Arnfeld <t...@duedil.com> wrote: > >> Hey, >> >> I've noticed some interesting behav

Re: Mesos sometimes not allocating the entire cluster

is helps fairness when running frameworks that hold on to offers, or > frameworks that accidentally drop offers. > > Thanks, > > Guangya > > On Thu, Jan 21, 2016 at 9:44 PM, Tom Arnfeld <t...@duedil.com> wrote: > >> Hi Klaus, >> >> Sorr

Mesos sometimes not allocating the entire cluster

Hey, I've noticed some interesting behaviour recently when we have lots of different frameworks connected to our Mesos cluster at once, all using a variety of different shares. Some of the frameworks don't get offered more resources (for long periods of time, hours even) leaving the cluster under

Re: Monitoring

We're using collectd (https://collectd.org/) to send system metrics to Graphite, and also using the https://github.com/rayrod2030/collectd-mesos collectd plugin to pull stats directly from the Apache Mesos stats endpoint. This works pretty well for us, and seems kind-of similar to the Diamond

Re: statusUpdate() duplicate messages?

When you construct the scheduler, are you disabling implicit acknowledgements? https://github.com/apache/mesos/blob/master/include/mesos/scheduler.hpp#L373 I’d suggest having a read over this document, it

Re: Spark on Mesos / Executor Memory

ache/spark/pull/4027>) > > It also might be interesting to include a cores to memory multiplier so that > with a larger amount of cores we try to scale the memory with some factor, > but I'm not entirely sure that's intuitive to use and what people know what > to set it to, as that

Re: MesosCon Seattle attendee introduction thread

Hey everyone! I'm Tom Arnfeld, a software engineer working at DueDil (in London). We've been running Mesos for almost 18 months now, for large scale batch and stream data processing applications. Give me a shout if you want to talk data stuff! We're also experimenting with Mesos to deploy long

Re: Cleaning out old mesos-slave sandbox directories

Ok, do you think that'd be a change that would be accepted into Mesos if I sent it in? Thanks Vinod, btw. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Wed, Jul 8, 2015 at 7:24 PM, Vinod Kone vinodk...@gmail.com wrote: On Wed

Re: Cleaning out old mesos-slave sandbox directories

at 11:09 AM, Tom Arnfeld t...@duedil.com wrote: In this instance there were three old slave directories, and there are three log lines in the mesos-slave.INFO file; I0708 11:24:52.023453  2425 slave.cpp:3499] Garbage collecting old slave 20150515-105200-84152492-5050-9915-S46 I0708 11:24

Cleaning out old mesos-slave sandbox directories

out the directories based on the timestamps in the directory names... Any input would be great! Tom. -- Tom Arnfeld Senior Developer // DueDil

Re: Cleaning out old mesos-slave sandbox directories

think I actually discussed this with BenH a while back, we're running 0.21.0 on this cluster. Anyone else seen this before? Using the standard `rm` unix tool clears out the directories fine currently, running as the same user as the slave (root). -- Tom Arnfeld Senior Developer

RE: mesos-execute + docker_image

through mesos-execute at the moment. Tom. -- Tom Arnfeld Senior Developer // DueDil On Tuesday, Jul 7, 2015 at 5:21 pm, Nikolaos Ballas neXus nikolaos.bal...@nexusgroup.com, wrote: Search for containerizers in the manual on apache or mesosphere sites  Sent from

Re: Hadoop on Mesos. HDFS question.

It might be worth taking a look at the install documentation on the Hadoop on Mesos product here; https://github.com/mesos/hadoop For our installations I don't think we really do much more than installing the apt packages you mentioned and then installing the hadoop-mesos jars.. plus adding

Re: RFC: Framework - Executor Message Passing Optimization Removal

. -- Tom Arnfeld Developer // DueDil On Mon, Jun 29, 2015 at 10:48 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: FYI Some folks reached out off thread that they are using this optimization for distributed health checking of tasks. This is on the order of O(10,000) framework messages

Re: Debugging framework registration from inside docker

I believe you're correct Jim, if you set LIBPROCESS_IP=$HOST_IP libprocess will try to bind to that address as well as announce it, which won't work inside a bridged container. We've been having a similar discussion on https://github.com/wickman/pesos/issues/25. -- Tom Arnfeld

Re: Design doc for Mesos HTTP API

if you could help me understand. -- Tom Arnfeld Developer // DueDil On Thursday, Apr 30, 2015 at 10:26 pm, Vinod Kone vinodk...@gmail.com, wrote: Welcome to the Greater Anglia Wi-Fi Service

Re: MRv2 jobs on mesos

is that MRv2 is better described as the MapReduce application for YARN which means you can't run it without a YARN cluster, because it's intrinsically designed around it. Cheers, -- Tom Arnfeld Developer // DueDil On Tuesday, Apr 28, 2015 at 9:24 am, Bharath Ravi Kumar reachb...@gmail.com

Re: Current State of Service Discovery

Hi Yaron, (Also apologies for the long reply) First, I think that we need to clearly distinguish that service discovery, and request routing / load balancing are related but separate concerns. In my mind, at least, discovery is about finding a way to communicate with a service (much like a DNS

Re: Spark on Mesos / Executor Memory

, 2015 at 9:51 AM, Tom Arnfeld t...@duedil.com mailto:t...@duedil.com wrote: We're running Spark 1.3.0 (with a couple of patches over the top for docker related bits). I don't think SPARK-4158 is related to what we're seeing, things do run fine on the cluster, given

Re: Spark on Mesos / Executor Memory

/pull/3024 Do these look relevant? What version of Spark are you running? On Sat, Apr 11, 2015 at 9:33 AM, Tom Arnfeld t...@duedil.com wrote: Hey, Not sure whether it's best to ask this on the spark mailing list or the mesos one, so I'll try here first :-) I'm having a bit of trouble

Spark on Mesos / Executor Memory

Hey, Not sure whether it's best to ask this on the spark mailing list or the mesos one, so I'll try here first :-) I'm having a bit of trouble with out of memory errors in my spark jobs... it seems fairly odd to me that memory resources can only be set at the executor level, and not also at the

Re: Fwd: Questions about Mesos

Hi Robin, It might be a little late to reply but I thought it would be worth weighing in. Given the Mesos master and slave are primarily configured using command line parameters, the main issue is getting a working install as configuration is fairly simple. It can be quite easy to compile

Re: Custom python executor with Docker

business, so it's better if you can adapt your framework design to fit within the Mesos Task/Executor pattern. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Mon, Apr 6, 2015 at 7:00 PM, Vinod Kone vinodk...@apache.org wrote: Tim, do you

Re: Using mesos-dns in an enterprise

We're using a BGP based solution currently to solve the problem of highly available DNS resolvers. That might be a route worth taking, and one that could still work via marathon on top of Mesos. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London

Re: Mesos Hadoop Framework 0.1.0

trying to pack a multi-tenant cluster to the max. -- Tom Arnfeld Developer // DueDil On Saturday, Mar 28, 2015 at 2:40 pm, Jeff Schroeder jeffschroe...@computer.org, wrote: Does this have any pros / cons over Myriad, which runs Yarn on Mesos? Other than not requiring Yarn

Re: Mesos Hadoop Framework 0.1.0

To follow up, this is also a decent solution to a nasty problem in the current framework detailed here, https://github.com/mesos/hadoop/issues/32. -- Tom Arnfeld Developer // DueDil On Sat, Mar 28, 2015 at 2:40 PM, Jeff Schroeder jeffschroe...@computer.org wrote: Does this have any pros

Re: hadoop on mesos odd issues with heartbeat and ghost task trackers.

Hi John, Not sure if you ended up getting to the bottom of the issue, but often when the scheduler gives up and his this time out it's because something funky happened in mesos and the scheduler wasn't updated correctly. Could you describe the state (with some logs too if possible) of mesos while

Re: Does MesosScheduler.resourceOffers need to be reentrant?

As far as I know the entire scheduler (the API at least) is single threaded so only one callback will fire at a given time. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Thu, Feb 26, 2015 at 9:45 AM, Dario Rexin da...@mesosphere.io

Re: Hadoop on Mesos

with the right version in it, and they will all happily share the Mesos cluster. I hope this makes sense! Ping me on irc (tarnfeld) if you run into anything funky on that branch for flexi trackers. Tom. -- Tom Arnfeld Developer // DueDil On Thu, Jan 29, 2015 at 4:09 PM, Alex alex.m.lis

Re: mesos and coreos?

The way I see it, Mesos is an API and framework for building and running distributed systems. CoreOS is an API and framework for running them. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Sun, Jan 18, 2015 at 3:01 PM, Jason Giedymin

Re: hadoop job stuck.

Hi Dan, Can you look at the stdout/stderr logs in the task sandbox for me and share any errors here? Also – What version of Hadoop are you using, and what version of the Hadoop on Mesos framework? Thanks. -- Tom Arnfeld Developer // DueDil On Wednesday, Jan 14, 2015 at 8

Re: Running services on all slaves

how you end up doing it! -- Tom Arnfeld Developer // DueDil On Thursday, Jan 8, 2015 at 7:32 am, Itamar Ostricher ita...@yowza3d.com, wrote: Thanks everybody for all your insights! I totally agree with the last response from Tom. The per-node services definitely belong

Re: Running services on all slaves

why would log aggregation by any different? -- Tom Arnfeld Developer // DueDil On Tue, Jan 6, 2015 at 11:57 PM, Charles Baker cnob...@gmail.com wrote: It seems like an 'anti-pattern' (for lack of a better term) to attempt to force locality on a bunch of dependency services launched

Re: Mesos Community Meetings

+1 also! Very interesting to hear what’s being discussed. +1 on the google hangouts if these meetings are happening in person so we can listen along. -- Tom Arnfeld Developer // DueDil On Monday, Dec 29, 2014 at 4:12 pm, Chris Aniszczyk caniszc...@gmail.com, wrote: +1 to opening up

Re: [VOTE] Release Apache Mesos 0.21.1 (rc2)

+1 -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Wed, Dec 31, 2014 at 12:16 AM, Ankur Chauhan an...@malloc64.com wrote: +1 Sent from my iPhone On Dec 30, 2014, at 16:01, Tim Chen t...@mesosphere.io wrote: Hi all, Just a reminder

Re: Question about External Containerizer

for the container and updates the resources in a very similar way to the mesos-slave. I believe this is also what the built in Docker containerizer will do. https://github.com/duedil-ltd/mesos-docker-containerizer/blob/master/containerizer/commands/update.py#L35 Tom. -- Tom Arnfeld Developer

Re: Question about External Containerizer

that makes some sense! -- Tom Arnfeld Developer // DueDil On Wed, Dec 3, 2014 at 10:54 AM, Diptanu Choudhury dipta...@gmail.com wrote: Thanks for the explanation Tom, yeah I just figured that out by reading your code! You're touching the memory.soft_limit_in_bytes and memory.limit_in_bytes

Re: Timeline for 0.22.0?

I don't mind helping out shepherding a release through for 0.21.1 though I don't have committer rights. -- Tom Arnfeld Developer // DueDil On Tue, Dec 2, 2014 at 10:44 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: If anyone is interested in driving a 0.21.1 bug fix release, we

Re: Rocket

+1 Sounds exciting! -- Tom Arnfeld Developer // DueDil On Mon, Dec 1, 2014 at 8:03 PM, Jie Yu yujie@gmail.com wrote: Sounds great Tim! Do you know if they have published an API for the rocket toolset? Are we gonna rely on the command line interface? - Jie On Mon, Dec 1, 2014 at 11

Re: Master memory usage

I have and it doesn't seem to add up. That being said, the growth of the memory and number of tasks does seem to make sense give the issue you linked to. I'll upgrade and see where that leaves the issue. Thanks for your help! -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25

Re: Master memory usage

That's what I thought. There around 2500 tasks launched with this master, most of which will be by our Hadoop JT. The Hadoop framework ships the configuration for the TT using the TaskInfo.data property, and that looks to be about 80K per task. Any debugging suggestions? -- Tom Arnfeld

Re: Implementing an Executor

as the mesos slave is going to kill the container ASAP after the executor disconnects. Sending task status updates should do the trick for you here. Tom. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Wed, Nov 19, 2014 at 10:16 PM, Janet

Re: Implementing an Executor

to be queried by your containers on the slave, and switch to using the mesos docker containerizer. I hope that helps somewhat! Tom. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Wed, Nov 19, 2014 at 10:16 PM, Janet Borschowa

Master memory usage

/mem_total_bytes:12631490560,total_schedulers:1,uptime:1411611.27369318,valid_status_updates:5371} -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS

Re: hadoop-mesos error

Hi John, Could you paste your JT configuration and the configuration that gets printed out by the executor? Also, what version of Hadoop are you running, and what revision of the framework? Cheers, Tom. -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher

Re: [VOTE] Release Apache Mesos 0.21.0 (rc1)

+1 `make check` passed on Ubuntu 12.04 LTS (kernel 3.2.0-67) -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Thu, Nov 6, 2014 at 8:43 PM, Ian Downes idow...@twitter.com.invalid wrote: Apologies: I used support/tag.sh but had a local

Re: CDH5.2.3 on mesos

the process as ubuntu i kept getting Does not contain a valid host:port authority: local -- Ankur On 28 Oct 2014, at 01:57, Tom Arnfeld t...@duedil.com wrote: Hi Ankur, There aren't any getting started resources other than the documention there as far as I know. Could you share your

Re: CDH5.2.3 on mesos

Hi Ankur, There aren't any getting started resources other than the documention there as far as I know. Could you share your hadoop configuration and perhaps a description of the problems you're having? Tom. On Tue, Oct 28, 2014 at 8:53 AM, Ankur Chauhan an...@malloc64.com wrote: H, I

Re: Problems with OOM

I'm not sure if this at all related to the issue you're seeing, but we ran into this fun issue (or at least this seems to be the cause) helpfully documented on this blog article: http://blog.nitrous.io/2014/03/10/stability-and-a-linux-oom-killer-bug.html. TLDR: OOM killer getting into an infinite

Re: [VOTE] Release Apache Mesos 0.20.1 (rc3)

+1 (non-binding) Make check on Ubuntu 12.04 with gcc 4.6.3 On 19 September 2014 17:37, Tim Chen t...@mesosphere.io wrote: +1 (non-binding) Make check on Centos 5.5, docker tests all passed too. Tim On Fri, Sep 19, 2014 at 9:17 AM, Jie Yu yujie@gmail.com wrote: +1 (binding) Make

Re: Mesos task ordering guarantees

filing a ticket? On Wed, Sep 17, 2014 at 6:22 PM, Tom Arnfeld t...@duedil.com wrote: Hey Vinod, On the most part I have indeed observed this to be the case. However every now and then the tasks are being launched out of order. Here's a slave log https://gist.github.com/tarnfeld

Mesos task ordering guarantees

Hey, I couldn't seem to find any documentation on this.. If a framework responds to an offer with two tasks and they share the same executor (therefore leading to two invocations of *launchTasks()* on the executor), does Mesos provide any guarantees around the order of those tasks being handed

Re: Sandbox GC fails

That's useful to know, thanks Vinod. I'll try and dig deeper. On Mon, Sep 8, 2014 at 5:33 AM, Vinod Kone vinodk...@gmail.com wrote: On Sat, Sep 6, 2014 at 8:23 AM, Tom Arnfeld t...@duedil.com wrote: If I try and manually remove the directory mentioned, it works fine. Is this a known issue

Sandbox GC fails

I've noticed the disk on my mesos slaves filling up when running tasks that generate large amounts of data in their sandbox directories (~2-5GB). The tasks don't last very long, and I can see that the mesos GC process is trying to delete them, but failing. Here are some logs;

Re: Mesos 0.20.0 with Docker registry availability

You can tag each image with your commit hash that way Mesos will always have to do a docker pull and you don't lose the fast iteration cycle in development. I mentioned this on one of the review requests the other day. The problem here is that, say I want to iterate quickly on installing things

Re: Introducing Portainer

/documentation/latest/mesos-frameworks/). Please send a PR or RB request. On Wed, Sep 3, 2014 at 3:50 PM, Tom Arnfeld t...@duedil.com wrote: @Ankur Wups! That's silly of me... http://github.com/duedil-ltd/portainer On 3 September 2014 23:45, Ankur Chauhan an...@malloc64.com wrote

Re: Introducing Portainer

feedback and see contributions from those using it! Thanks, Tom. On 4 September 2014 11:30, Tom Arnfeld t...@duedil.com wrote: That's a great question James. So for the past ~8 months we've been using a jenkins master + (n) slaves setup to build images. We currently build around ~20 different

Introducing Portainer

Hey everyone, Thought it would be worth sharing this on the mailing list. We've recently open sourced a Mesos framework called Portainer, which is for *building* docker containers on top of your cluster. It is in working order, though very early stage... It supports all *Dockerfile* instructions

Re: Introducing Portainer

@Ankur Wups! That's silly of me... http://github.com/duedil-ltd/portainer On 3 September 2014 23:45, Ankur Chauhan an...@malloc64.com wrote: Could you share a link to the repo? On Wed, Sep 3, 2014 at 3:20 PM, Tom Arnfeld t...@duedil.com wrote: Hey everyone, Thought it would be worth

Re: Mesos slaves across network zones

Hey, We've been running mesos slaves across sites, most in a private cloud off site and using AWS EC2 for extra burst capacity when required, across a Direct Connect link. We've found this model to work well on the mesos side, though it's key to understand the interaction between tasks running

Re: MesosCon attendee introduction thread

​Depending on the specific needs, different models are possible. Would be great to chat. I'd love to join in this conversation, in our recent deployment we've been bridging Amazon EC2 with our private cloud to make use of the elasticity AWS provides, and have been thinking of ways to better

Re: MesosCon attendee introduction thread

Awesome! Hey everyone, I'm Tom Arnfeld, and I work as a data / infrastructure engineer at a financial startup called DueDil, based in London. We're a data aggregator, and are in the process of migrating to a new production deployment of Mesos, upon which we're running Hadoop, Docker

Re: Force a slave to garbage collect framework/executors

for garbage collection during (1) and/or (2). On Thu, Jul 31, 2014 at 3:40 PM, Tom Arnfeld t...@duedil.com wrote: I don't have them to hand now, but I recall it saying something in the high 90's and 0ns for the max allowed age. I actually found the root cause of the probably, docker related

Re: Python bindings are changing!

Woah, this is really awesome Thomas! Especially the pip install ;-) Looking forward to bringing pesos up to speed with this. On 1 August 2014 21:30, Jie Yu yujie@gmail.com wrote: Thomas, Thank you for the heads-up. One question: what if mesos and python binding have different versions?

Re: Force a slave to garbage collect framework/executors

to be well documented anywhere. Tom. On 31 July 2014 23:33, Benjamin Mahler benjamin.mah...@gmail.com wrote: What do the slave logs say? E.g. I0731 22:22:17.851347 23525 slave.cpp:2879] Current usage 7.84%. Max allowed age: 5.751197441470081days On Wed, Jul 30, 2014 at 8:55 AM, Tom

Force a slave to garbage collect framework/executors

I'm not sure if this is something already supported by mesos, and if so it'd be great if someone could point me in the right direction. Is there a way of asking a slave to garbage collect old executors manually? Maybe i'm misunderstanding things, but as each executor does (insert knowledge gap)

Re: Does Mesos support Hadoop MR V2

with MRv2 every map reduce job would be mapped as a new framework in Mesos. Not sure how many frameworks mesos can run and scale up to. Especially short lived frameworks. On Jul 25, 2014 8:54 PM, Tom Arnfeld t...@duedil.com wrote: Hey Luyi, That's correct, the Hadoop framework currently

Re: Does Mesos support Hadoop MR V2

Hey Luyi, That's correct, the Hadoop framework currently only supports Hadoop 2 MRv1. It also doesn't have great support for the HA jobtracker available in newer versions of Hadoop, but I've been working on that the past few weeks. I'm not sure how Hadoop 2 would play with Mesos, but very

Re: Does Mesos support Hadoop MR V2

PM, Tom Arnfeld t...@duedil.com javascript:_e(%7B%7D,'cvml','t...@duedil.com'); wrote: Hey Luyi, That's correct, the Hadoop framework currently only supports Hadoop 2 MRv1. It also doesn't have great support for the HA jobtracker available in newer versions of Hadoop, but I've been working

Re: Mesos language bindings in the wild

just work. -- Cheers, Tim -- *From: *Tom Arnfeld t...@duedil.com *To: *user@mesos.apache.org *Sent: *Tuesday, July 15, 2014 2:50:47 AM *Subject: *Re: Mesos language bindings in the wild Hey

Re: [VOTE] Release Apache Mesos 0.19.1 (rc1)

+1 (non binding) - Tested on Mac OSX mavericks - Tested on Ubuntu 12.04 LTS machines (spark and Hadoop run fine also) On 15 Jul 2014, at 19:48, Niklas Nielsen nik...@mesosphere.io wrote: +1 (binding) Tested on: - OSX Mavericks w/ clang-503.0.40 LLVM 3.4 - Ubuntu 13.10 w/ gcc-4.8.1

Re: Mesos language bindings in the wild

Very exciting. I'd vote +1 for splitting them out. Especially if you look at the common way of using Go imports, just stick the project on GitHub and import it directly using github.com/mesos/mesos-go or similar. I guess one argument is that you have more fragmentation of the code (e.g every

Python Celery on Mesos

? I'm not very familiar with the internals of Celery so it might be more complex to achieve than it looks from the surface, but something we'd be interested in working with. Tom. -- Tom Arnfeld Developer // DueDil t...@duedil.com (+44) 7525940046 25 Christopher Street, London, EC2A 2BS

Re: Deimos / Marathon task stuck in staging

Hey, This looked to me like a bug in the external containerizer code, I opened a JIRA issue about it a while back - https://issues.apache.org/jira/browse/MESOS-1462. I don't think anyone has started looking at fixing it yet. Tom. On 8 Jul 2014, at 15:29, Aurélien Dehay aurel...@dehay.info

Re: 0.19.1

this is a critical fix? We try to minimise what we include in bug fix releases to avoid feature creep. Thanks On Jul 4, 2014 12:31 PM, Tom Arnfeld t...@duedil.com wrote: Any chance we can get https://issues.apache.org/jira/browse/MESOS-1448 too? On 3 Jul 2014, at 21:40, Vinod Kone vinodk

Re: Docker support in Mesos core

Hey Everyone, Excited to see discussions of this. Something I started playing around with just as the external containerizer was coming to life! Diptanu – A few responses to your notes... a. Mesos understanding docker metrics which should be straightforward because docker writes all its

Re: Apache Mesos 0.19.0 Released

support for custom container technologies. Initial Docker support is now available through some community driven external containerizers: Docker Containerizer for Mesos by Tom Arnfeld and Deimos by Jason Dusek. Please reach out on the mailing lists with questions! Metrics Previously, Mesos

Mesos / Libprocess ENETUNREACH

Hey, I’ve been testing out mesos for production recently and i’m having trouble registering frameworks over our VPN connection. I expect it’s a firewall issue, but i’m unsure as to what connectivity mesos requires for its frameworks. When running the test java framework from one of the slaves

Re: Where did 0.18.1 go? Suggesting 0.18.2

Definitely +1. On 13 May 2014, at 18:54, Benjamin Hindman b...@eecs.berkeley.edu wrote: +1! On Tue, May 13, 2014 at 9:51 AM, Niklas Nielsen n...@qni.dk wrote: Hey everyone, First and foremost, I apologize for the radio silence on my part with regards to the 0.18.1 release. We didn't

Re: [DRAFT] Mesos community survey questions

I’d be quite interested in asking if people are running their own in-house built frameworks. I’m actually quite curious to know if people are just using Mesos mainly as a way of getting access to Hadoop+{insert data platform here} at the moment… On 1 May 2014, at 21:00, Dave Lester

System dependencies with Mesos

the wrong way to go. — Tom Arnfeld Developer // DueDil

Compiling Mesos on Mac OSX Mountain Lion 10.9

managed to successfully install thrift version 0.9.1using brew (though unrelated) which makes me think it might not be an issue with thrift, but with the mesos build process? I can attach my Makefile if that’s of any help, Thanks. — Tom Arnfeld Developer // DueDil

Re: Compiling Mesos on Mac OSX Mountain Lion 10.9

not found # include ext/slist ^ 2 warnings and 1 error generated. make[7]: *** [stl_logging_unittest-stl_logging_unittest.o] Error 1 # — Tom Arnfeld Developer // DueDil On 30 Jan 2014, at 19:46, Benjamin Mahler benjamin.mah

Re: Compiling Mesos on Mac OSX Mountain Lion 10.9

it seems homebrew/versions doesn’t have 4.2) brew tap homebrew/versions brew install homebrew/versions/gcc4.3 --enable-cxx ./bootstrap CC=“gcc-4.3” CXX=“g++-4.3” ./configure make Thanks for the pointers! :) — Tom Arnfeld Developer // DueDil On 30 Jan 2014, at 20:03, Benjamin Mahler benjamin.mah