Lance Amundsen wrote:
OK, that is encouraging. I'll take another pass at it. I succeeded
yesterday with an in-memory only InputFormat, but only after I commented
out some of the split referencing code, like the following in MapTask.java
if (instantiatedSplit instanceof FileSplit) {
FileSplit fileSplit = (FileSplit) instantiatedSplit;
job.set("map.input.file", fileSplit.getPath().toString());
job.setLong("map.input.start", fileSplit.getStart());
job.setLong("map.input.length", fileSplit.getLength());
}
Yes, that code should not exist, but it shouldn't affect you either.
You should be subclassing InputSplit, not FileSplit, so this code
shouldn't operate on your splits.
Doug