See: YARN-1042 add ability to specify affinity/anti-affinity in container requests
On Thu, Jan 9, 2014 at 8:48 AM, ricky l <[email protected]> wrote: > Hi all, > > Is it possible to express the job anti-affinity in the Yarn-based hadoop? > I have a job that is very IO-intensive, and I want to spread the tasks > across all available machines. In a default Yarn RM scheduler, it seems > many tasks are scheduled in one machine while others are idle. > > thanks. >
