Is this specifically for YARN? If so, yes you can do this, MR does this for Maps vs Reduces. The API right now requires that the different sized containers have a different priority.
http://hadoop.apache.org/docs/r2.0.5-alpha/hadoop-yarn/hadoop-yarn-site/Wri tingYarnApplications.html Shows how to make a resource request. It also shows how to make a AllocateRequest. If you put in multiple ResourceRequests into the AllocateRequest it will allocate both of them. But remember that that the priority needs to be different, and the priority determines the order in which the containers will be allocated to your application. --Bobby On 6/13/13 10:41 AM, "Yuzhang Han" <[email protected]> wrote: >Hi, > >I am wondering if I can allocate different size of containers to the >tasks in a job. For example: Job = <Task1, Task2, Task3>, Task1 = Task2 >= 1024MB, Task3 = 2048MB. How can I achieve this? Many thanks. > >Yuzhang
