How to get the Mesos Spark Framework to use multiple disks

2018-03-07 Thread Jeff Kubina
>From the spark documentation on spark.local.dir or SPARK_LOCAL_DIRS options it looks like the Mesos Spark Framework can be configured to use multiple disks. spark.local.dir Directory to use for "scratch" space in Spa

Re: Is it possible to configure a mesos agent to use multiple work directories?

2017-11-22 Thread Jeff Kubina
Thanks, that is what I thought. Why: To spread the I/O-workload of some frameworks across many disks. -- Jeff Kubina 410-988-4436 On Wed, Nov 22, 2017 at 2:21 PM, Vinod Kone wrote: > No. Why do you need that? > > On Wed, Nov 22, 2017 at 10:42 AM, Jeff Kubina > wrote: > >&

Is it possible to configure a mesos agent to use multiple work directories?

2017-11-22 Thread Jeff Kubina
Is it possible to configure a mesos agent to use multiple work directories (the work_dir parameter)?

Re: Format for attributes with no value

2017-07-24 Thread Jeff Kubina
https://issues.apache.org/jira/browse/MESOS-7824 -- Jeff Kubina 410-988-4436 On Fri, Jul 14, 2017 at 9:03 AM, James Peach wrote: > > > On Jul 13, 2017, at 1:41 PM, Jeff Kubina wrote: > > > > I want to know the format for an empty attribute in the list format

Re: Format for attributes with no value

2017-07-13 Thread Jeff Kubina
or does it not matter? -- Jeff Kubina 410-988-4436 On Tue, Jul 11, 2017 at 5:20 AM, Oeg Bizz wrote: > James, > If you need an empty attribute as default for mesos, just create an > empty file with the '?' in front of it and save it in the > /etc/mesos- directory.

Is there a way to get a dump of all the configuration settings of a master or agent?

2017-07-13 Thread Jeff Kubina
Is there a way to get a dump of all the configuration settings of a master or agent?

Format for attributes with no value

2017-07-07 Thread Jeff Kubina
When setting an attribute with no value of a mesos-agent is the colon needed, optional, or must it be omitted? It's not clear from the documentation. For example, which line or lines below are correct? att1:val1;att2;att3:val3 att1:val1;att2:;att3:val3

Question about mesos cgroups on centos 7.1

2016-10-27 Thread Jeff Kubina
I am running Mesos 0.28.1 on Centos 7.1 using --isolation=cgroups and noticed that mesos creates the cgroups: /sys/fs/cgroup/{resource}/docker /sys/fs/cgroup/{resource}/mesos /sys/fs/cgroup/{resource}/mesos_executors.slice Shouldn't these cgroups be in /sys/fs/cgroup/{resource}/user.slice/{docker