On Sep 24, 2008, at 2:24 AM, Devaraj Das wrote:
If you are on 0.18, it is possible to say that a combiner be invoked onceper partition per spill. Do job.setCombineOnlyOnce(true);
However, that functionality was introduced for backwards compatibility with versions prior to 0.18 and was removed from 0.19. The combiner should be viewed as a hint to framework for how to reduce the transient data size. Your application really shouldn't be doing transformations in the combiner.
-- Owen
