Re: Multi-agent machine

2016-12-09 Thread Charles Allen
Ok, thanks! On Fri, Dec 9, 2016 at 2:32 PM Benjamin Mahler wrote: > Maintenance should work in this case, it will just be applied to all > agents on the machine. > > On Fri, Dec 9, 2016 at 1:20 PM, Charles Allen < > charles.al...@metamarkets.com> wrote: > > Thanks for the

Quota

2016-12-09 Thread Vijay Srinivasaraghavan
I have a standalone DCOS setup (Single node Vagrant VM running DCOS v.1.9-dev build + Mesos 1.0.1 + Marathon 1.3.0). Both master and agent are running on same VM. Resource: 4 CPU, 16GB Memory, 20G Disk I have created a quota using new V1 API which creates a role "test" with resource

Re: Quota

2016-12-09 Thread Vijay
The dispatcher needs 1cpu and 1G memory. Regards, Vijay Sent from my iPhone > On Dec 9, 2016, at 4:51 PM, Vinod Kone wrote: > > And how many resources does spark need? > >> On Fri, Dec 9, 2016 at 4:05 PM, Vijay Srinivasaraghavan >> wrote: >>

Re: Quota

2016-12-09 Thread Vijay Srinivasaraghavan
Here is the slave state info. I see marathon is registered as "slave_public" role and is configured with "default_accepted_resource_roles" as "*" "slaves":[     {    "id":"69356344-e2c4-453d-baaf-22df4a4cc430-S0",  "pid":"slave(1)@xxx.xxx.xxx.100:5051",  

Re: Multi-agent machine

2016-12-09 Thread Benjamin Mahler
Maintenance should work in this case, it will just be applied to all agents on the machine. On Fri, Dec 9, 2016 at 1:20 PM, Charles Allen wrote: > Thanks for the insight. > > I take that to mean the maintenance primitives might not work right for > multi-agent

Re: Quota

2016-12-09 Thread Vinod Kone
How many resources does the agent register with the master? How many resources does spark task need? I'm guessing marathon is not registered with "test" role so it is only getting un-reserved resources which are not enough for spark task? On Fri, Dec 9, 2016 at 2:54 PM, Vijay Srinivasaraghavan <

Spark Mesos Architecture Details and Integration details

2016-12-09 Thread Chawla,Sumit
Hi All I am a new member of this group. Sorry if this question has already been asked. I am looking for some information regarding Spark Mesos Integration: 1. How does Mesos schedules and launch Spark Executors? (Any pointer to code will be helpful) 2. How does Mesos frontend the Spark

Re: Quota

2016-12-09 Thread Vinod Kone
And how many resources does spark need? On Fri, Dec 9, 2016 at 4:05 PM, Vijay Srinivasaraghavan < vijikar...@yahoo.com> wrote: > Here is the slave state info. I see marathon is registered as > "slave_public" role and is configured with "default_accepted_resource_roles" > as "*" > > "slaves":[ >

Command healthcheck failed but status KILLED

2016-12-09 Thread Tomek Janiszewski
Hi What is desired behavior when command health check failed? On Mesos 1.0.2 when health check fails task has state KILLED instead of FAILED with reason specifying it was killed due to failing health check. Thanks Tomek

Re: Duplicate task IDs

2016-12-09 Thread Joris Van Remoortere
Hey Neil, I concur that using duplicate task IDs is bad practice and asking for trouble. Could you please clarify *why* you want to use a hashmap? Is your goal to remove duplicate task IDs or is this just a side-effect and you have a different reason (e.g. performance) for using a hashmap? I'm

Multi-agent machine

2016-12-09 Thread Charles Allen
Is it possible to setup a machine such that multiple mesos agents are running on the same machine and registering with the same master? For example, with different cgroup roots or different default working directory.

Re: Multi-agent machine

2016-12-09 Thread Jie Yu
Charles, It should be possible. Here are the global 'object' that might conflict: 1) cgroup (you can use different cgroup root) 2) work_dir and runime_dir (you can set them to be different between agents) 3) network (e.g., iptables, if you use host network, should not be a problem. Otherwise, you

Re: Multi-agent machine

2016-12-09 Thread Charles Allen
Thanks for the insight. I take that to mean the maintenance primitives might not work right for multi-agent machines? aka, I can't do maintenance on one agent but not the others? On Fri, Dec 9, 2016 at 12:16 PM Jie Yu wrote: > Charles, > > It should be possible. Here are