Re: minimum requirements for hdfs on mesos

2015-09-01 Thread Gabriel Hartmann
hdfs/example-conf/mesosphere-dcos/mesos-site.xml has some example values defined. For example: mesos.hdfs.namenode.cpus 0.25 Furthermore you need at least 5 private slaves to satisfy the restrictions on node collocation. In other words particular nodes are not allowed to run on the same

Re: tag disks resources

2017-02-01 Thread Gabriel Hartmann
This request has been made many times. Attributes on disks (or any resource) doesn't yet exist. On Wed, Feb 1, 2017 at 12:00 AM vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > It's OK for host selection but I am looking for a way to tag disks within > agents. One agent could have

Re: Welcome Neil Conway as Mesos Committer and PMC member!

2017-01-21 Thread Gabriel Hartmann
Congrats Neil. On Sat, Jan 21, 2017 at 7:08 AM Deepak Vij (A) wrote: > Congrats Neil. > > Deepak Vij > > Sent from HUAWEI AnyOffice > From:Vinod Kone > To:dev,user > Date:2017-01-20 23:04:30 > Subject:Welcome Neil Conway as Mesos Committer and PMC member! > > Hi folks, >

Re: Question on dynamic reservations

2017-01-24 Thread Gabriel Hartmann
suggested in the > related ticket which Neil filed a while back: > https://issues.apache.org/jira/browse/MESOS-4476 > > Povilas, also see this related ticket that Gabriel pointed me to: > https://issues.apache.org/jira/browse/MESOS-6939 > > It sounds like this is a r

Re: Question on dynamic reservations

2017-01-17 Thread Gabriel Hartmann
@Greg: The reason people use static reservation is to enforce that particular resources (usually disks) can only be consumed by a particular framework. They also don't know when the stateful service is going to be installed necessarily so they don't want to race with other frameworks to consume

Re: Messos do not assign all available resources

2017-03-02 Thread Gabriel Hartmann
Possibly the suppress/revive problem. On Thu, Mar 2, 2017 at 4:30 PM Benjamin Mahler wrote: > Can you upload the full logs somewhere and link to them here? > > How many frameworks are you running? Do they all run in the "*" role? > Are the tasks short lived or long lived? >

Re: Child process constraints

2017-04-07 Thread Gabriel Hartmann
They're both in the same cgroup. In fact the Executor is the unit of isolation. On Fri, Apr 7, 2017 at 2:21 PM Egor Ryashin wrote: > Hi all, > > Could someone share knowledge whether a child process of the launched task > has the same resource constraints? > For

Re: Framework change role

2017-07-05 Thread Gabriel Hartmann
You may register in multiple roles simultaneously. Register with the MULTI_ROLE capability ( https://github.com/apache/mesos/blob/master/include/mesos/mesos.proto#L345). Our frameworks all register with a role, but never the role '*'. We get Offers from all agents that don't have statically

Re: Framework change role

2017-07-05 Thread Gabriel Hartmann
Gabriel Hartmann <gabr...@mesosphere.io> wrote: > You may register in multiple roles simultaneously. Register with the > MULTI_ROLE capability ( > https://github.com/apache/mesos/blob/master/include/mesos/mesos.proto#L345). > Our frameworks all register with a role, but never the

Re: Persistent volumes

2017-11-28 Thread Gabriel Hartmann
I agree with pretty much everything Hendrik just said with the exception of the use of disk quota. The polling mechanism employed for enforcing disk usage implies that any breach of the disk usage limit by a Task also implies loss of access to that data forever. This is true for ROOT volumes at

Re: Docker image for fast e2e test with Mesos

2018-02-11 Thread Gabriel Hartmann
mini-mesos being so far behind is too bad. If it had a more modern version of Mesos working it would be useful. It's killer features as far as I'm concerned are the inclusion of mesos-dns and Marathon in that order. Having mesos-dns in this docker image would be valuable. On Sun, Feb 11, 2018