Re: implementing data locality via mesos resource offers

2015-01-16 Thread Douglas Voet
, it will also include all the attributes you've tagged. This currently is static information on launch, and I believe there is JIRA tickets to make this dynamic (updatable at runtime). Tim On Thu, Jan 15, 2015 at 7:23 PM, Douglas Voet dv...@broadinstitute.org wrote: Hello, I am

implementing data locality via mesos resource offers

2015-01-15 Thread Douglas Voet
Hello, I am evaluating mesos in the context of running analyses of many large files. I only want to download a file to a small subset of my nodes and route the related processing there. The mesos paper talks about using resource offers as a mechanism to achieve data locality but I can't find any

Dynamically sizing a mesos cluster.

2013-10-17 Thread Douglas Voet
Hi, Is there any functionality in Mesos to dynamically resize a cluster? I want to be able to add and remove slave nodes and maybe masters while the cluster is running. Thanks, Doug