FileInputFormat may change the file system of an input path
-----------------------------------------------------------
Key: MAPREDUCE-1522
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1522
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Tsz Wo (Nicholas), SZE
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(Job job,
Path path) uses the default FileSystem but not the FileSystem specified in the
path.
{code}
//org.apache.hadoop.mapreduce.lib.input.FileInputFormat
public static void addInputPath(Job job,
Path path) throws IOException {
Configuration conf = job.getConfiguration();
FileSystem fs = FileSystem.get(conf);
path = path.makeQualified(fs); // the original FileSystem is lost.
...
}
{code}
There is a similar problem in FileInputFormat.setInputPaths(..).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
