Hi Sharma, Is this how you collect the network info from the VMs?
First you get the resource offers from the Mesos and then you collect the network bandwidth info and then you use that for assigning for your tasks? Or The mesos-slave collects the resource information? But I don't see any code to that and also the existing mesos-slave does not collects these resource information by itself. Am I missing something here? Regards, Pradeep On 5 October 2015 at 18:28, Sharma Podila <spod...@netflix.com> wrote: > Pradeep, > > We recently open sourced Fenzo <https://github.com/Netflix/Fenzo> (wiki > <https://github.com/Netflix/Fenzo/wiki>) to handle these scenarios. We > add a custom attribute for network bandwidth for each agent's "mesos-slave" > command line. And we have Fenzo assign resources to tasks based on CPU, > memory, disk, ports, and network bandwidth requirements. With Fenzo you can > define affinity, locality, and any other custom scheduling objectives using > plugins. Some of the plugins are already built in. It is also easy to add > additional plugins to cover other objectives you care about. > > "Dependencies" can mean multiple things. Do you mean dependencies on > certain attributes of resources/agents? Dependencies on where other tasks > are assigned? All of these are covered. However, if you mean workflow type > of dependencies on completion of other tasks, then, there are no built in > plugins. You could write one using Fenzo. It is also common for such > workflow dependencies to be covered by an entity external to the scheduler. > Both techniques can be made to work. > > Fenzo has the concept of hard Vs soft constraints. You could specify, for > example, resource affinity and/or task locality as a soft constraint or a > hard constraint. See the wiki docs link I provided above for details. > > Sharma > > > On Mon, Oct 5, 2015 at 8:21 AM, Pradeep Kiruvale < > pradeepkiruv...@gmail.com> wrote: > >> Hi All, >> >> Are there any frameworks that exists with the Mesos to schedule the >> bigger apps? >> I mean to say scheduling a app which has many services and will not fit >> into one physical node. >> >> Is there any frame work that can be used to >> schedule tasks based on the underlying hardware constraints like Network >> bandwidth ? >> Schedule the tasks based on their dependencies and proximity to each >> other in a cluster or a rack? >> >> Thanks & Regards, >> Pradeep >> > >
