Re: Current state of the oversubscription feature

Hi everyone, For now (and in the current Serenity[1]), we avoided oversubscription of non-compressible resources. If you look at a system like Heracles[2], the polling interval is in O(seconds) which may not be fast enough to react to OOM. But shouldn't be impossible, taken all the work VMWare

Re: Mesos metrics -> influxdb

Or take SNAP for a spin: https://github.com/intelsdi-x/snap/blob/master/docs/PLUGIN_CATALOG.md Can collect metrics from Mesos and output in several TSDBs and you can do transformations on the metrics in flight. Niklas On Fri, Feb 26, 2016 at 1:05 AM, Aaron Carey wrote: > Thanks

Re: [RESULT][VOTE] Release Apache Mesos 0.27.0 (rc2)

Awesome guys! Kapil, we usually linked to the user documentation in the blog to the new features. Do you have a link to the docs on multiple disk resources? On Wed, Feb 3, 2016 at 11:27 PM, Kapil Arya wrote: > And here is the blog post: >

Re: Poland, Warsaw User Group

You can see the removal here: http://svn.apache.org/viewvc/mesos/site/publish/community/user-groups/index.html?r1=1711312=1720526=1720526 On Mon, Jan 11, 2016 at 10:14 AM, Niklas Nielsen <n...@qni.dk> wrote: > Sorry about that, Piotr! I will have taken a stab at this by tomorrow. &

Re: Poland, Warsaw User Group

rsaw-Mesos-User-Group/ > > Thanks! > > -- > Piotr Szwed > > 2015-10-29 17:56 GMT+01:00 Niklas Nielsen <n...@qni.dk>: > >> Hi Tomek, >> >> Great to hear! I am adding your user group to the list. >> >> Thanks! >> Niklas >>

Re: Poland, Warsaw User Group

Hi Tomek, Great to hear! I am adding your user group to the list. Thanks! Niklas On Thu, Oct 29, 2015 at 2:34 AM, Tomek Janiszewski wrote: > Hi > > I'm organizing an Apache Mesos user group in the Warsaw. We have created > our Meetup group and scheduled our first meeting in

Notes from off-line sync on processes for Mesos road maps

Hi everyone, Yesterday, a few of us met up to discuss processes for Mesos road maps: how to capture core values of the project, how to prioritize features from users running different workloads and how to delegate specifics of road mapping to the working groups. The meeting notes are available

Re: upgrade from 0.24.1 to 0.25

Hi Craig, That should definitely not happen; did you try to upgrade to 0.25.0 already? If not, we can try to run an upgrade experiment with that marathon version. Niklas On 13 October 2015 at 02:39, craig w wrote: > When upgrading from 0.23.0 to 0.24.1, I installed the

[RESULT][VOTE] Release Apache Mesos 0.25.0 (rc3)

Hi all, The vote for Mesos 0.25.0 (rc3) has passed with the following votes. +1 (Binding) -- Joris Van Remoortere Michael Park Brenden Matthews +1 (Non-binding) -- Kapil Arya There were no 0 or -1 votes. Please find the

[VOTE] Release Apache Mesos 0.25.0 (rc3)

Hi all, Following up with an RC with the build fix suggested by Kapil: Please vote on releasing the following candidate as Apache Mesos 0.25.0. 0.25.0 includes the following: * [MESOS-1474] - Experimental

Re: [Breaking Change 0.26] Credential secret change

Hi Isabel, Would you mind adding a section to upgrades.md and the changelog where you capture the upgrade path? Also, will there be an intermediate phase where both formats work? Niklas On 7 October 2015 at 12:06, Isabel Jimenez wrote: > Hello, > > As JSON

Re: [VOTE] Release Apache Mesos 0.25.0 (rc2)

gt; [17:18:48][Step 4/6] if (expected == actual) { > >> > >> [17:18:48][Step 4/6] ^ > >> > >> > >> Cherry-picking one commit (bfeb070a2aef52f445e "Fixed compiler warning

[VOTE] Release Apache Mesos 0.25.0 (rc2)

Hi all, Please vote on releasing the following candidate as Apache Mesos 0.25.0. 0.25.0 includes the following: * [MESOS-1474] - Experimental support for maintenance primitives. * [MESOS-2600] - Added master

Re: [VOTE] Release Apache Mesos 0.23.1 (rc1)

+1 (binding) Tested on centos7 and ubuntu 14.04 On 24 September 2015 at 07:53, Alexander Rojas wrote: > +1 (non binding) > > Tested Ubuntu 14.04, OSX > > > On 22 Sep 2015, at 03:06, Adam Bordelon wrote: > > > > Hi friends, > > > > Please vote on

Re: [VOTE] Release Apache Mesos 0.24.1 (rc1)

+1 (binding) On 21 September 2015 at 11:46, Vinod Kone wrote: > +1 (binding) > > Tested on CI for CentOS5 and CentOS6. > > On Fri, Sep 18, 2015 at 6:21 PM, Adam Bordelon wrote: > >> Hi friends, >> >> Please vote on releasing the following candidate as

Re: mesos 0.24 released?

On 18 September 2015 at 11:19, Yan Xu wrote: > Hey Mesosphere peeps, on a related note, can > https://mesosphere.com/downloads/ be updated as well? :) > > Hey Yan, We are working on it :) Niklas > -- > Jiang Yan Xu @xujyan > > On Fri,

Re: [VOTE] Release Apache Mesos 0.24.0 (rc2)

+1 - tested on our CI On Tuesday, September 1, 2015, Vinod Kone wrote: > Hi all, > > > Please vote on releasing the following candidate as Apache Mesos 0.24.0. > > > 0.24.0 includes the following: > > >

Re: [VOTE] Release Apache Mesos 0.24.0 (rc1)

-1: sudo make check on centos 7 [--] Global test environment tear-down [==] 793 tests from 121 test cases ran. (606946 ms total) [ PASSED ] 786 tests. [ FAILED ] 7 tests, listed below: [ FAILED ] UserCgroupIsolatorTest/1.ROOT_CGROUPS_UserCgroup, where TypeParam =

Re: [VOTE] Release Apache Mesos 0.24.0 (rc1)

, and /lib64 when preparing test root filesystem. Review: https://reviews.apache.org/r/37684 On Thu, Aug 27, 2015 at 3:30 PM, Niklas Nielsen nik...@mesosphere.io wrote: -1: sudo make check on centos 7 [--] Global test environment tear-down [==] 793 tests from 121

Re: [Announce] Satellite: Two Sigma's Monitoring, Alerting, and Self-Healing Application for Apache Mesos

Amazing! Thanks for sharing Sunil! On 9 June 2015 at 11:22, Sunil Abraham sunil.abra...@twosigma.com wrote: We are pleased to announce that Two Sigma is open-sourcing Satellite, a Mesos monitoring and alerting application with self-healing capabilities. Satellite makes it easy to

Re: Introducing BDS: A datacenter scripting language

That's awesome Pablo! Will definitely take this for a spin. Thanks for sharing! Niklas On 14 May 2015 at 18:45, Pablo Cingolani pablo.e.cingol...@gmail.com wrote: Hi Everyone, I've been working on a simple programming language to create large data pipelines on Mesos. The language is

Oversubscription design doc

Hi everyone, In context of some of the recent discussions on 'Resource overcommittal', we are very interested and invested in enabling oversubscription in Mesos in a safe and efficient way. Some of the community members have been working on an architecture document and prototypes recently and

[RESULT][VOTE] Release Apache Mesos 0.22.0 (rc4)

Hi all, The vote for Mesos 0.22.0 (rc4) has passed with the following votes. +1 (Binding) -- Ben Mahler Tim St Clair Adam Bordelon Brenden Matthews +1 (Non-binding) -- Alex Rukletsov Craig W Ben Whitehead Elizabeth Lingg Dario Rexin Jeff

Re: [VOTE] Release Apache Mesos 0.22.0 (rc4)

I would like to steer this conversation/thread back to the release vote. Can you restart the distcc discussion in another thread? Cheers, Niklas On 23 March 2015 at 21:31, CCAAT cc...@tampabay.rr.com wrote: Excellent start! Nice links I was not aware of (thanks). Folks can use distcc now to

Re: Mesos 0.22.0

[2] refs/tags/0.22.0-rc2 [created] e51fb50e4 On 26 February 2015 at 14:44, Niklas Nielsen nik...@mesosphere.io wrote: Hi all, Per Dave and Chris suggestion, here is a stub document for tracking/planning future releases (assigning release managers etc): https://cwiki.apache.org/confluence

Re: Mesos 0.22.0

Hi all, Per Dave and Chris suggestion, here is a stub document for tracking/planning future releases (assigning release managers etc): https://cwiki.apache.org/confluence/display/MESOS/Mesos+Release+Planning Niklas On 22 January 2015 at 16:27, Niklas Nielsen nik...@mesosphere.io wrote: Hi all

Re: Total resources available versus actually available

The slave picks up total available resources (not free) on startup, but this can be overridden by the --resources= flag. That way, you can leave resources for your out of bound processes. If you want to compute the slack (difference between allocated and actually used), you can compute that from

Re: Accessing stdout/stderr of a task programmattically?

First off, you can only do this per executor - not per task. To my understanding, the webui just picks up the executor directory from the slave state.json, but the container id should also be available there. Here is a snippet from a run of a echo 'foobar' baz.txt job: The slave state endpoint:

Re: Mesos 0.22.0

, Niklas Nielsen nik...@mesosphere.io wrote: Hi all, We have been releasing major versions of Mesos roughly every second month (current average is ~66 days) and we are now 2 months after the 0.21.0 release, so I would like to propose that we start planning for 0.22.0 Not only

Re: Marathon stability and use-case

Looping in Connor and Dario. On 21 January 2015 at 17:21, Benjamin Mahler benjamin.mah...@gmail.com wrote: Hm.. I'm not sure if any of the Marathon developers are on this list. They have a mailing list here: https://groups.google.com/forum/?hl=en#!forum/marathon-framework On Mon, Jan 19,

Mesos 0.22.0

Hi all, We have been releasing major versions of Mesos roughly every second month (current average is ~66 days) and we are now 2 months after the 0.21.0 release, so I would like to propose that we start planning for 0.22.0 Not only in terms of timing, but also because we have some exciting

Re: [VOTE] Release Apache Mesos 0.21.1 (rc2)

+1, Compiled and tested on Ubuntu Trusty, CentOS Linux 7 and Mac OS X Thanks guys! Niklas On 19 December 2014 at 22:02, Tim Chen t...@mesosphere.io wrote: Hi Ankur, Since MESOS-1711 is just a minor improvement I'm inclined to include it for the next major release which shouldn't be too far

Re: Authorization via a Module

...@yahoo.com wrote: isnt authorization done in a separate module than authenticator? Sushant On Wednesday, December 17, 2014 12:58 PM, Niklas Nielsen nik...@mesosphere.io wrote: Pluggable authenticator modules should land in Mesos 0.22: https://issues.apache.org/jira/browse/MESOS-1966

Re: Rocket

Huge +1 On 1 December 2014 at 11:10, Tim Chen t...@mesosphere.io wrote: Hi all, Per the announcement from CoreOS about Rocket ( https://coreos.com/blog/rocket/) , it seems to be an exciting containerizer runtime that has composable isolation/components, better security and image

Re: Task Checkpointing with Mesos, Marathon and Docker containers

Have you tried a more recent version of Mesos/Marathon? Docker support has landed as a first class containerizer in the Mesos slave, so there is no need to use deimos. Niklas On 25 November 2014 at 07:43, Geoffroy Jabouley geoffroy.jabou...@gmail.com wrote: Hello i am currently trying to

Re: MPI on Mesos

Hi Stratos, Sorry for the tardy reply. We wrote mesos-hydra as new versions of mpich2 didn't provide mpdtrace (see https://github.com/apache/mesos/blob/master/mpi/README) and assuming not having a posix parallel file system available. mesos-hydra starts mpirun using the 'manual' launcher and the

Re: [VOTE] Release Apache Mesos 0.21.0 (rc1)

+1 for Ubuntu 14.04.1 LTS and Mac OS X 10.9.5. Niklas On 6 November 2014 13:00, Tom Arnfeld t...@duedil.com wrote: +1 `make check` passed on Ubuntu 12.04 LTS (kernel 3.2.0-67) -- Tom Arnfeld Developer // DueDil (+44) 7525940046 25 Christopher Street, London, EC2A 2BS On Thu, Nov

Re: Message retries for TASK_FINISHED

It could look like the scheduler is blocked somehow. The second TASK_FINISHED status update (@06:16:25.295990) is most likely resent by the status update manager because it never got an acknowledgement from the scheduler. You can run your scheduler with GLOG_v=2 to get more information about from

Re: kubernetes-mesos installation issues

We are working on it: https://github.com/mesosphere/kubernetes-mesos/issues/28 Sorry for the wait - the Kubernetes internal API's changes rapidly and we are doing our best to keep up. Niklas On 26 August 2014 13:35, Sidharta Seethana sidharta.apa...@gmail.com wrote: Hi Vladimir, Thank you

Re: Can not finish ./src/test-framework

. Can you please let me know how to resolve this issue? Thanks! Qian 2014-08-20 21:11 GMT+08:00 Niklas Nielsen nik...@mesosphere.io: Hi Qian, State 5 is TASK_LOST. Can you take a look at the executor logs? I have seen this before for the test frameworks when they can't locate libmesos.so

Re: [VOTE] Release Apache Mesos 0.20.0 (rc2)

+1 make check on Ubuntu 14.04 gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) and Mac OS X clang-503.0.40 Looking so much forward to this release! Niklas On 19 August 2014 11:28, Ian Downes idow...@twitter.com.invalid wrote: +1 make check passes on CentOS 5.5 with 3.4 kernel. Docker tests were

Re: Exposing executor container

Hi Whitney, Are you thinking an API to do that from within any executor or the command-executor in particular? The executor won't start before the fetcher has pulled all artifacts, so wouldn't it be too late to change the cgroups limits from whiten the executor? If not, you should be able to

Re: multi tenant setup

who is blocking the job. - Gurvinder On 07/31/2014 06:12 PM, Niklas Nielsen wrote: Hi Gurvinder, The frameworks competing for resources will get their (weighted) fair share of the cluster. The allocator in the master uses the Dominant Resource Fairness algorithm to do this (http

Re: multi tenant setup

Hi Gurvinder, The frameworks competing for resources will get their (weighted) fair share of the cluster. The allocator in the master uses the Dominant Resource Fairness algorithm to do this ( http://static.usenix.org/event/nsdi11/tech/full_papers/Ghodsi.pdf). Regarding FIFO, are you referring to

Re: Passing a pointer to an Object in task Info

I am not sure I completely understand the issue. Just passing a pointer won't work. The compiled protobuf code won't try to infer the size of the object. Also it will go over the wire, so you can't reference memory on the other node. In one way or another, you need to serialize the object to a

Re: Mesos language bindings in the wild

, Jul 10, 2014 at 3:57 PM, Niklas Nielsen nik...@mesosphere.io http://JAVASCRIPT-BLOCKED; wrote: I just wanted to clarify - native, meaning _no_ dependency to libmesos and native to its language (only Go, only Python and so on) i.e. use the low-level API. Sorry

Re: [VOTE] Release Apache Mesos 0.19.1 (rc1)

-1462 will make it into a later RC? On Wed, Jul 16, 2014 at 4:53 AM, Tom Arnfeld t...@duedil.com wrote: +1 (non binding) - Tested on Mac OSX mavericks - Tested on Ubuntu 12.04 LTS machines (spark and Hadoop run fine also) On 15 Jul 2014, at 19:48, Niklas Nielsen nik...@mesosphere.io wrote

Re: [VOTE] Release Apache Mesos 0.19.1 (rc1)

+1 (binding) Tested on: - OSX Mavericks w/ clang-503.0.40 LLVM 3.4 - Ubuntu 13.10 w/ gcc-4.8.1 (LogZooKeeperTest.WriteRead is still flaky on that VM) Thanks Ben! On 14 July 2014 21:39, Benjamin Hindman benjamin.hind...@gmail.com wrote: +1, thanks Ben! On Mon, Jul 14, 2014 at 6:20 PM,

Re: problem getting mesosphere mesos example running

Hi Nayeem, With regards to running and auto-scaling Rails - Mesos should be a great platform for that :-) We should be able to help you debug your problem too; can you provide a bit more detail about the problems you are seeing? Can you provide slave and/or deimos logs? Niklas On 14 July

Re: Mesos language bindings in the wild

Embraced language repos is a great path too. +1 for not having to tie automake into the respective language build systems. Ensuring that they all work together when Mesos is changing becomes a bit more difficult, but not worse than CI'ing builds of the respective bindings against HEAD (is bindings

Re: Mesos language bindings in the wild

need any native bindings. I can imagine having example frameworks or starter frameworks that use the low-level API (the wire protocol with protocol buffers for message passing), but nothing like we have that needs C or JNI, etc. On Thu, Jul 10, 2014 at 3:26 PM, Niklas Nielsen nik

Re: [VOTE] Release Apache Mesos 0.18.2 (rc1)

, Chengwei On Wed, May 14, 2014 at 12:06:44PM -0700, Niklas Nielsen wrote: Hi all, Please vote on releasing the following candidate as Apache Mesos 0.18.2. 0.18.2 includes the following: [MESOS-1313

[RESULT][VOTE] Release Apache Mesos 0.18.2 (rc1)

Hi all, The vote for Mesos 0.18.2 (rc1) has passed with the following votes. +1 (Binding) -- Jie Yu Vinod Kone Till Toenshoff +1 (Non-binding) -- Iven Hsu Adam Bordelon Tom Arnfeld Tomas Barton Chengwei Yang There were no 0 or -1 votes.

Assigning issues in JIRA

- Hey everyone, Folks on the list have had trouble assigning themselves to tickets. So I went to take a look at the JIRA permissions page and the Assign issue permission have (somehow) been restricted to: - - Project Role (PMC) - Project Role (Committers) - Project Role

Testing of 0.18.2-rc1

Hey everyone, I just tagged 0.18.2-rc1 as a bug fix release candidate which includes the fix for https://issues.apache.org/jira/browse/MESOS-1313 Can you help us out by testing this RC so we can put this release up for a vote? Thanks! Niklas

[VOTE] Release Apache Mesos 0.18.1 (rc2)

Hi all, Please vote on releasing the following candidate as Apache Mesos 0.18.1. 0.18.1 includes the following: [MESOS-1212] - Use maven to compile and package Mesos' Java files [MESOS-979] - Master segfault when

Re: Testing of 0.18.1-rc1

haven't heard any updates on the list for a few days. What's the status/timeline for this? Thanks, Dave On Fri, Apr 18, 2014 at 4:27 PM, Niklas Nielsen nik...@mesosphere.iowrote: Sure - I will keep an eye on your patch and wait for the shading patches to land too. Thanks! Niklas On 18

Re: External Containererization API

Hey Diptanu, MESOS-816 (and dependent patches) are still in the works but getting close to land. These reviews (https://reviews.apache.org/r/17567/ and https://reviews.apache.org/r/20080/) are (more or less) the last two outstanding pieces. The first external containerizer which use the new API

Re: External Containererization API

custom branch including r/17567) On Wed, Apr 23, 2014 at 4:08 PM, Niklas Nielsen nik...@mesosphere.iowrote: Hey Diptanu, MESOS-816 (and dependent patches) are still in the works but getting close to land. These reviews (https://reviews.apache.org/r/17567/ and https://reviews.apache.org/r

Testing of 0.18.1-rc1

Hey everyone, I just tagged 0.18.1-rc1 as a bug fix release candidate which includes fixes for MESOS-979, MESOS-1045 and MESOS-1078. Can you help us out by testing this RC so we can put this release up for a vote? Thanks! Niklas