Hi,
Am running hadoop with both local and dfs:
local file system for input data
and
dfs for hadoop pipe binary to be shared by all slaves in addition to additional
lib
but i get this trace :
10/04/11 16:21:08 INFO mapred.JobClient: Task Id :
attempt_201003311822_0081_m_000005_0, Status : FAILED
java.io.IOException: pipe child exception
at
org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.IllegalArgumentException: Wrong FS:
file:/local/trad/pic_test/264913_64dd48bb10.jpg, expected:
hdfs://casso***********
at
org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:178)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:356)
at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:301)
at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:257)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:192)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:176)
at
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:88)
... 3 more
How to set up such configuration?
Regards
