Lance Amundsen wrote:
OK, that is encouraging. I'll take another pass at it. I succeeded yesterday with an in-memory only InputFormat, but only after I commented out some of the split referencing code, like the following in MapTask.javaif (instantiatedSplit instanceof FileSplit) { FileSplit fileSplit = (FileSplit) instantiatedSplit; job.set("map.input.file", fileSplit.getPath().toString()); job.setLong("map.input.start", fileSplit.getStart()); job.setLong("map.input.length", fileSplit.getLength()); }
Yes, that code should not exist, but it shouldn't affect you either. You should be subclassing InputSplit, not FileSplit, so this code shouldn't operate on your splits.
Doug
