Re: Mesos Python Daemon Launch

2017-07-20 Thread Timothy Chen
Are you using Docker containerizer or? Tim On Thu, Jul 20, 2017 at 10:50 PM, Chawla,Sumit wrote: > Any clue on this one? > > The python daemon is getting launched in different session and process > group. Not sure why its getting killed when the mesos slave is

Re: Welcome Gilbert Song as a new committer and PMC member!

2017-05-24 Thread Timothy Chen
Congrats! Rocking the containerizer world! Tim On Wed, May 24, 2017 at 11:23 AM, Zhitao Li wrote: > Congrats Gilbert! > > On Wed, May 24, 2017 at 11:08 AM, Yan Xu wrote: > >> Congrats! Well deserved! >> >> --- >> Jiang Yan Xu | @xujyan

Re: Welcome Kevin Klues as a Mesos Committer and PMC member!

2017-03-01 Thread Timothy Chen
Congrats Kevin! Tim On Wed, Mar 1, 2017 at 3:20 PM, Neil Conway wrote: > Congratulations Kevin! Very well-deserved. > > Neil > > On Wed, Mar 1, 2017 at 2:05 PM, Benjamin Mahler wrote: >> Hi all, >> >> Please welcome Kevin Klues as the newest committer

Re: Mesos Spark Fine Grained Execution - CPU count

2016-12-19 Thread Timothy Chen
; wrote: >>>>> >>>>> That makes sense. From the documentation it looks like the executors >>>>> are not supposed to terminate: >>>>> >>>>>

Re: [Proposal] Remove the default value for agent work_dir

2016-04-12 Thread Timothy Chen
+1 Tim On Wed, Apr 13, 2016 at 5:31 AM, Jie Yu wrote: > +1 > > On Tue, Apr 12, 2016 at 9:29 PM, James Peach wrote: > >> >> > On Apr 12, 2016, at 3:58 PM, Greg Mann wrote: >> > >> > Hey folks! >> > A number of situations have arisen in

Re: Apache Spark Over Mesos

2016-03-15 Thread Timothy Chen
You can launch the driver and executor in docker containers as well by setting spark.mesos.executor.docker.image to the image you want to use to launch them. Tim > On Mar 15, 2016, at 8:49 AM, Radoslaw Gruchalski wrote: > > Pradeep, > > You can mount a spark directory

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

2016-03-09 Thread Timothy Chen
Also like to include MESOS-4370 as it fixes IP Address look up logic and also unblocks users using custom Docker network. Tim On Wed, Mar 9, 2016 at 9:55 AM, Gilbert Song wrote: > Hi Kevin, > > Please remove the the patch below from the list: > Implemented runtime

Re: Mesos fetcher in dockerized slave

2016-01-08 Thread Timothy Chen
I can shepherd no problem. Tim > On Dec 25, 2015, at 4:32 PM, Shuai Lin wrote: > > I'll work on it. @Tim could you shepherd it? > >> On Sat, Dec 26, 2015 at 2:49 AM, Marica Antonacci >> wrote: >> Hi Tim and Shuai, >> >> thank you very

Re: Mesos .26 failing on centos7

2015-11-09 Thread Timothy Chen
My commits that caused the trouble are reverted now. And also 0.26 will not be based on master, it typically are cherry picked commits to specific tag. Tim > On Nov 9, 2015, at 6:37 AM, Plotka, Bartlomiej > wrote: > > I had the same issue (broken build) on

Re: spark mesos shuffle service failing under marathon

2015-11-07 Thread Timothy Chen
If you want to use Marathon start the mesos shuffle service, don't use the sbin script since it runs it as a daemon in background. Instead use spark-class script and run the MesosExternalShuffleService class directly so it runs in the foreground. Tim > On Nov 7, 2015, at 7:02 AM, Klaus Ma

Re: Recover docker containers when mesos-slave is contained in docker as well

2015-10-22 Thread Timothy Chen
Hi Grzegorz, Yes it's possible, but do require some configuration for the slave recover the running containers. This is needed to run Mesos on CoreOS as well, so it's made possible I believe around 0.24.1 or later. Basically to have the slave to recover the task containers, the executors that

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread Timothy Chen
Hi Jay, We just added health check support for docker tasks that's in master but not yet released. It will run docker exec with the command you provided as health checks. It should be in the next release. Thanks! Tim > On Oct 6, 2015, at 6:49 PM, Jay Taylor wrote: >

Re: Error: no resources available to schedule container

2015-09-25 Thread Timothy Chen
Hi Diana, This is a known bug that's in swarm. I'll be looking into this soon. Tim > On Sep 25, 2015, at 3:32 AM, Diana J Arroyo wrote: > > Hi, > I'm getting "ERRO[0038] HTTP error: no resources available to schedule > container status=500" when trying to deploy a

Re: [VOTE] Release Apache Mesos 0.24.0 (rc1)

2015-08-27 Thread Timothy Chen
That test is failing because of a wierd bug in CentOS 7 not naming the cgroups correctly (or at least not following the pattern every other OS). I filed a CentOS bug but no response so far, if we want to fix it we will have to work around this problem by hardcoding another cgroup name to test

Re: Change DOCKER_HOST for Mesos slave

2015-08-03 Thread Timothy Chen
Hi Andrii, We never intend to pick up local OS environment to be passed into containerizer, as we want to make sure all environment variables are intentionally specifies from the framework for the task. Does that docker.conf setting generate a new docker.conf file or? Tim On Aug 3, 2015,

Re: [VOTE] Release Apache Mesos 0.23.0 (rc4)

2015-07-22 Thread Timothy Chen
+1 The docker bridge network test failed because some iptable rules that was set on the environment. I will comment on the JIRA but not a blocker. Tim On Jul 22, 2015, at 1:07 PM, Benjamin Hindman wrote: +1 (binding) On Ubuntu 14.04: $ make check ...

Re: [VOTE] Release Apache Mesos 0.23.0 (rc3)

2015-07-16 Thread Timothy Chen
As Adam mention I also think this is not a blocker, as it only affects the way we test the cgroup on CentOS 7.x due to a CentOS bug and doesn't actually impact Mesos normal operations. My vote is +1 as well. Tim On Thu, Jul 16, 2015 at 12:10 PM, Vinod Kone wrote: Found a

Re: change docker rm command

2015-04-12 Thread Timothy Chen
Hi Mike, Can you create a jira for this? Currently there isn't s way to change that, but IMO it makes sense to change it since we delay removing the container already. Tim On Apr 12, 2015, at 12:10 PM, Mike Michel wrote: Hi, is there a way to change the options

Re: Spark on Mesos / Executor Memory

2015-04-11 Thread Timothy Chen
Hi James, You are right multiple frameworks becomes a different discussion how to adjust and allow more dynamic resource negotiation to happen, also factor in fairness and others. There are more work that is happening in mesos to try to address multiple framework like optimistic offer and

Re: Custom python executor with Docker

2015-04-07 Thread Timothy Chen
Hi Tom(s), Tom Arnfeld is right, if you want to launch your own docker container in your custom executor you will have to handle all the issues yourself and not able to use the Docker containerizer at all. Alternatively, you can actually launch your custom executor in a Docker container by

Re: Spark on Mesos Submitted from multiple users

2015-02-21 Thread Timothy Chen
Hi John, Having drivers launched on the cluster where you can query/kill is what I'm currently working on. As for sharing drivers I will let others chime in if that ever makes sense. Tim On Feb 21, 2015, at 11:29 AM, John Omernik wrote: So in my instance, instead having

Re: [VOTE] Release Apache Mesos 0.21.1 (rc2)

2015-02-17 Thread Timothy Chen
Hi Ben, Didn't realize I need to update this. I've added the date now. Tim On Feb 16, 2015, at 10:30 PM, Benjamin Mahler wrote: Hey Tim, Can you release 0.21.1 on JIRA with the correct date?

Re: [VOTE] Release Apache Mesos 0.21.1 (rc2)

2015-02-17 Thread Timothy Chen
Hi Vinod, Sorry I planned to do it, forgot to mention in the email. Tim On Tue, Feb 17, 2015 at 9:42 AM, Vinod Kone wrote: Tim, mind updating the release guide too? @vinodkone On Feb 17, 2015, at 8:19 AM, Timothy Chen wrote: Hi Ben, Didn't

Re: Optimal resource allocation

2015-02-05 Thread Timothy Chen
Hi Pradeep, First of all I think the notion of optimal is not just a single dimension of being task duration, but also considering lots of other dimensions such as throughput, fairness, latency, SLA and more. Mesos is a two level scheduler, which means it's not doing all the scheduling at a

Re: Subscribe

2015-02-02 Thread Timothy Chen
Please email On Feb 3, 2015, at 8:47 AM, Kartik Mehta wrote:

Re: *namespaces now in Docker for Mesos slave in a container parity.

2015-01-19 Thread Timothy Chen
This definitely sounds exciting. Do you happen to have link to more information about this? Tim Sent from my iPhone On Jan 19, 2015, at 11:18 AM, Tim St Clair wrote: Greetings folks - All of the namespace work should be in the next release of Docker(1.5?). This

Re: mesos and coreos?

2015-01-18 Thread Timothy Chen
I think CoreOS provides a good single node OS for executing containers and Fleet provides very simple scheduling and placement and etcd provides discovery primitives. I think Mesos besides being ore proven to scale and handle failure scenarios, it also provides more primitives for users to

Re: Rocket

2014-12-03 Thread Timothy Chen
Hi Tim, Definitely I agree, i think what I am getting at is that it's clear from the conversation that a open governance is what they want from day one. Apache is one of the options mentioned one the Issue, and I believe something along that line is most probable. As long as that's true it

Re: Rocket

2014-12-01 Thread Timothy Chen
Thanks Tobias for clarifying this, we can consider implement and help shape the spec that is easy for Mesos to integrate. Tim On Mon, Dec 1, 2014 at 9:39 PM, Tobias Knaup wrote: An important point to clarify is that two things were announced: a spec (App Container) and an

Re: Help needed

2014-11-22 Thread Timothy Chen
Hi Qiang, It depends on how your NFS is setup, but if you have it mounted at the same location on each slave you simply just map that volume into your docker container with Mesos. Tim Sent from my iPhone On Nov 22, 2014, at 9:40 AM, Qiang wrote: I having been

Re: A problem with resource offers

2014-11-06 Thread Timothy Chen
Hi Sharma, Can you try out the latest master and see if you can repro it? Tim Sent from my iPhone On Nov 6, 2014, at 7:41 PM, Sharma Podila wrote: ​​ I am on 0.18 still. I think I found a bug. I wrote a simple program to repeat this and there's a new twist as

Re: Why rely on url scheme for fetching?

2014-11-03 Thread Timothy Chen
with me while i get up to speed. -- Ankur On 1 Nov 2014, at 19:23, Timothy Chen wrote: Hi Ankur, Can you post on reviewboard? We can discuss more about the code there. Tim Sent from my iPhone On Nov 1, 2014, at 6:29 PM, Ankur Chauhan

Re: build failure on mac os x

2014-11-01 Thread Timothy Chen
Hi Ankur, Where does your lib subversion header live? Configure must have fonnd it but since we include the header without the path the path name may not match. Tim Sent from my iPhone On Nov 1, 2014, at 8:54 AM, Dominic Hamon wrote: libsubversion was added as a

Re: Why rely on url scheme for fetching?

2014-11-01 Thread Timothy Chen
Hi Ankur, Can you post on reviewboard? We can discuss more about the code there. Tim Sent from my iPhone On Nov 1, 2014, at 6:29 PM, Ankur Chauhan wrote: Hi Tim, I don't think there is an issue which is directly in line with what i wanted but the closest one that I

Re: args for Docker run surrounded by quotes

2014-10-29 Thread Timothy Chen
Hi Andrew, By default shell is enabled, which wraps your command in bin/sh and single quotes. Try passing shell false to marathon. Tim Sent from my iPhone On Oct 29, 2014, at 4:44 AM, Andrew Jones wrote: Hi, I'm trying to run a Docker image which has a

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Timothy Chen
Hi Tim, Thanks for doing the integration tests, that's something that I wanted to do but never got to yet. I have great interest ensuring spark and mesos work, and I know Brenden as well does. I have been tracking these spark mesos problems with spark jira and labeling them mesos. Can you

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Timothy Chen
-grained mode. We didn't even have to run any commands. RJ - Original Message - From: Timothy Chen To: Cc:, RJ Nowling, Erik Erlandson Sent: Tuesday, October 28, 2014 11:40:19 AM

Re: Mesos 0.20.1 still using -net=host when launching Docker containers

2014-10-01 Thread Timothy Chen
Sorry for the documentation, I didn't update the docs as part of 0.20.1 which we added the network modes. Please if you like submit a patch and I can help submit it. Tim On Oct 1, 2014, at 2:25 PM, Tim St Clair wrote: inline below - From: Andy Grove

Re: Limit on number of simultaneous Spark frameworks on Mesos?

2014-08-20 Thread Timothy Chen
Can you share your spark / mesos configurations and the spark job? I'd like to repro it. Tim On Aug 20, 2014, at 12:39 PM, Cody Koeninger wrote: I'm seeing situations where starting e.g. a 4th spark job on Mesos results in none of the jobs making progress. This happens

Re: [VOTE] Release Apache Mesos 0.19.1 (rc1)

2014-07-14 Thread Timothy Chen
+1 (non-binding). Tim On Mon, Jul 14, 2014 at 2:32 PM, Benjamin Mahler wrote: Hi all, Please vote on releasing the following candidate as Apache Mesos 0.19.1. 0.19.1 includes the following: