Arun, As we had discussed several years ago, there are many use cases where reducer scheduling control will be beneficial.
Suhendry, Currently it is not possible to specify hints for reducer scheduling, so patches welcome. - milind --- Milind Bhandarkar Greenplum Labs, EMC ((Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the views of any organization, past or present, the author might be affiliated with.) On 8/4/11 10:27 PM, "Arun C Murthy" <a...@hortonworks.com> wrote: >Nope, currently we don't do any smart scheduling for reduces since they >need to fetch map outputs from many nodes anyway. > >Arun > >On Aug 4, 2011, at 10:24 PM, Suhendry Effendy wrote: > >> I understand that we can decide which task run by which reducer in >>Hadoop by using custom partitioner, but is there anyway to decide which >>reducer run on which machine? >> >> >> Suhendry Effendy > >
