OutputFormat should have a "close" method called after all the reducers have 
completed
--------------------------------------------------------------------------------------

                 Key: HADOOP-4886
                 URL: https://issues.apache.org/jira/browse/HADOOP-4886
             Project: Hadoop Core
          Issue Type: New Feature
          Components: mapred
            Reporter: Nathan Marz
            Priority: Minor


It would be very useful for OutputFormat's to have a "close" method so that any 
global logic for outputting can take place there. For example, to output a meta 
data file along with all the reduce outputs. The close method should have the 
following signature and be run after all the reducers have finished, but before 
the "work output path" is renamed to the final output path:

void close(FileSystem fs, JobConf job, Progressable progress) throws IOException

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to