[
https://issues.apache.org/jira/browse/HADOOP-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HADOOP-904:
---------------------------------
Description:
The OutputFormat API should be changed to be more evolution proof:
public interface OutputFormatContext {
JobConf getJobConf();
Progressable getProgress();
}
public interface OutputFormat {
RecordWriter getRecordWriter(int reduce, OutputFormatContext context) throws
IOException;
void checkOutputSpecs(OutputFormatContext context) throws IOException;
}
And OutputFormatBase would be renamed:
public abstract class FileOutputFormat implements OutputFormat {
protected Path getOutputPath(int reduce, OutputFormatContext context) throws
IOException { ... }
... current OutputFormatBase methods ...
}
was:
The OutputFormat API should be changed to be more evolution proof:
public interface OutputFormatContext {
JobConf getJobConf();
Progressable getProgress();
}
public interface OutputFormat {
RecordReader getRecordReader(int reduce, OutputFormatContext context) throws
IOException;
void checkOutputSpecs(OutputFormatContext context) throws IOException;
}
And OutputFormatBase would be renamed:
public abstract class FileOutputFormat implements OutputFormat {
protected Path getOutputPath(int reduce, OutputFormatContext context) throws
IOException { ... }
... current OutputFormatBase methods ...
}
> OutputFormat should be given the reduce id directly rather than a filename
> --------------------------------------------------------------------------
>
> Key: HADOOP-904
> URL: https://issues.apache.org/jira/browse/HADOOP-904
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.10.1
> Reporter: Owen O'Malley
> Assigned To: Owen O'Malley
> Fix For: 0.11.0
>
>
> The OutputFormat API should be changed to be more evolution proof:
> public interface OutputFormatContext {
> JobConf getJobConf();
> Progressable getProgress();
> }
> public interface OutputFormat {
> RecordWriter getRecordWriter(int reduce, OutputFormatContext context)
> throws IOException;
> void checkOutputSpecs(OutputFormatContext context) throws IOException;
> }
> And OutputFormatBase would be renamed:
> public abstract class FileOutputFormat implements OutputFormat {
> protected Path getOutputPath(int reduce, OutputFormatContext context)
> throws IOException { ... }
> ... current OutputFormatBase methods ...
> }
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
