Bah - you're right. I don't know why I thought the real error was obscured, besides being distracted by "you should of" should be "you should have".
Thanks and apologies... Jeremy On Feb 9, 2011, at 6:10 PM, Andrew Hitchcock wrote: > "This file system object (hdfs://ip-10-114-89-36.ec2.internal:9000) > does not support access to the request path > 's3n://backlog.dev/1296648900000/32763897924550656' You possibly > called FileSystem.get(conf) when you should of called > FileSystem.get(uri, conf) to obtain a file system supporting your > path." > > That explains the error. You should always use the two parameter get > method when requesting FileSystem objects. > > Also, Elastic MapReduce is based on the Hadoop 0.20 branch. It has all > the patches from Hadoop 0.20.2 plus some additional ones from that > branch and other places. > > Andrew > > On Wed, Feb 9, 2011 at 3:23 PM, Jeremy Hanna <jeremy.hanna1...@gmail.com> > wrote: >> Anyone know why I would be getting an error doing a filesystem.open on a >> file with a s3n prefix? >> >> for the input path "s3n://backlog.dev/1296648900000/" - I get the following >> stacktrace: >> >> java.lang.IllegalArgumentException: This file system object >> (hdfs://ip-10-114-89-36.ec2.internal:9000) does not support access to the >> request path 's3n://backlog.dev/1296648900000/32763897924550656' You >> possibly called FileSystem.get(conf) when you should of called >> FileSystem.get(uri, conf) to obtain a file system supporting your path. >> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:351) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:178) >> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:396) >> at >> analytics.hadoop.socialdata.RawSignalFileInputFormat$MultiFileLineRecordReader.<init>(RawSignalFileInputFormat.java:53) >> at >> analytics.hadoop.socialdata.RawSignalFileInputFormat.getRecordReader(RawSignalFileInputFormat.java:22) >> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:343) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:312) >> at org.apache.hadoop.mapred.Child.main(Child.java:170) >> >> Incidentally, I'm using on elastic mapreduce with hadoop version 0.20 (which >> I assume is the latest 0.20 version).
