Hey Mark, What problem do you see when you use JobConf#setOutputValueGroupingComparator(…) when writing jobs with the stable API?
I've used it many times and it does get applied. On Tue, Nov 1, 2011 at 10:38 PM, Mark Kerzner <[email protected]> wrote: > Hi, Hadoop experts, > > I've written my custom GroupComparator, and I want to tell Hadoop about it. > > Now, there is a call > > job.setGroupingComparatorClass(), > > but I only find it in mapreduce package of version 0.21. In prior versions, > I see a similar call > > conf.setOutputValueGroupingComparator(GroupComparator.class); > > but it does not cause my GroupComparator to be being used. > > So my question is, should I change the code to use the mapreduce package > (not a problem, since Cloudera has it backported to the current > distribution), or is there a different, simpler way? > > Thank you. Sincerely, > Mark > -- Harsh J
