Re: Specifying a preferred host with a Resource Request

2016-02-06 Thread Jagadish Venkatraman
Hi Guangya, Thanks for the response! Let me provide more background to this request. *Background:* I work on Apache Samza , a distributed stream processing framework. Currently Samza supports only Yarn as a resource manager. (there have been requests to run Samza with

Re: Specifying a preferred host with a Resource Request

2016-02-06 Thread Klaus Ma
Hi Jagadish, This the requirement for dynamic reservation and persistent volumes :). Here's the related document: Reservation: http://mesos.apache.org/documentation/latest/reservation/ Persistent Volume: http://mesos.apache.org/documentation/latest/persistent-volume/ Thanks Klaus On Sun, Feb

Specifying a preferred host with a Resource Request

2016-02-05 Thread Jagadish Venkatraman
I have fair experience in writing frameworks on Yarn. In the Yarn world, the amClient supports a method where I can specify the preferredHost with the resource request. Is there a way to specify a preferred host with the resource request in Mesos? I currently do: driver.requestResources

Re: Specifying a preferred host with a Resource Request

2016-02-05 Thread Guangya Liu
Hi Jagadish, Even though Mesos have the interface of "requestResources", it was not implemented in the built-in allocator at the moment, so the call of "driver.requestResources (resources);" will not work. Is it possible that you update your framework logic as this: 1) framework get resoruce