[ http://issues.apache.org/jira/browse/HADOOP-403?page=comments#action_12425021 ] Milind Bhandarkar commented on HADOOP-403: ------------------------------------------
I just checked that this can be done without changing the mapper interface. We can hang the Reporter and OutputCollector off of JobConf which is passed to configure method. I will attach a patch soon. > close method in a Mapper should be provided with OutputCollector and a > Reporter > ------------------------------------------------------------------------------- > > Key: HADOOP-403 > URL: http://issues.apache.org/jira/browse/HADOOP-403 > Project: Hadoop > Issue Type: Improvement > Components: mapred > Affects Versions: 0.5.0 > Environment: all > Reporter: Milind Bhandarkar > Assigned To: Milind Bhandarkar > Fix For: 0.5.0 > > > For mappers with side-effects, or mappers that work as aggregators (i.e. no > output on individual key-value pairs, but an aggregate output at the end of > all key-value pairs), output should be performed in the close method. For > this purpose, we need to supply output collector and reporter to the close > method of Mapper. This involves interface change, though. Thoughts ? -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
