On Sep 24, 2008, at 2:24 AM, Devaraj Das wrote:

If you are on 0.18, it is possible to say that a combiner be invoked once
per partition per spill. Do
job.setCombineOnlyOnce(true);

However, that functionality was introduced for backwards compatibility with versions prior to 0.18 and was removed from 0.19. The combiner should be viewed as a hint to framework for how to reduce the transient data size. Your application really shouldn't be doing transformations in the combiner.

-- Owen

Reply via email to