Re: Tez containers and input splits

2016-10-28 Thread Hitesh Shah
That is similar to MR’s approach. When a task requests for containers, it will specify that it needs to be scheduled on a particular set of hosts/racks via a TaskLocationHint. The TaskLocationHint is converted to a container ask from YARN i.e. one container on any of the hosts or racks

Re: Tez containers and input splits

2016-10-28 Thread Madhusudan Ramanna
Hello Hitesh, Thanks for that explanation ! Could you clarify about how locality of input splits is used..  thanks,Madhu On Thursday, October 27, 2016 11:19 PM, Hitesh Shah wrote: Hello Madhusudan, I will start with how container allocations work and make my way