OutputFormat should have a "close" method called after all the reducers have
completed
--------------------------------------------------------------------------------------
Key: HADOOP-4886
URL: https://issues.apache.org/jira/browse/HADOOP-4886
Project: Hadoop Core
Issue Type: New Feature
Components: mapred
Reporter: Nathan Marz
Priority: Minor
It would be very useful for OutputFormat's to have a "close" method so that any
global logic for outputting can take place there. For example, to output a meta
data file along with all the reduce outputs. The close method should have the
following signature and be run after all the reducers have finished, but before
the "work output path" is renamed to the final output path:
void close(FileSystem fs, JobConf job, Progressable progress) throws IOException
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.