[
https://issues.apache.org/jira/browse/MAPREDUCE-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antonio Piccolboni resolved MAPREDUCE-3766.
-------------------------------------------
Resolution: Not A Problem
Seems to be reading each part just fine. Maybe it should get a more getmerge
like functionality, maybe it should be documented, but most likely this is not
a bug.
> dumptb fails with filenotfound
> ------------------------------
>
> Key: MAPREDUCE-3766
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3766
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.20.2
> Environment: AWS, ubuntu, cdh3u3
> Reporter: Antonio Piccolboni
>
> dumptb can't find an existing file
> antonio@ip-10-9-65-123:~$ hadoop jar
> /usr/lib/hadoop/contrib/streaming/hadoop-streaming-0.20.2-cdh3u3.jar dumptb
> /tmp/Rtmp5h8lIO/file179e4fc
> 12/01/31 00:27:48 INFO security.UserGroupInformation: JAAS Configuration
> already set up for Hadoop, not re-installing.
> 12/01/31 00:27:49 WARN snappy.LoadSnappy: Snappy native library is available
> 12/01/31 00:27:49 INFO util.NativeCodeLoader: Loaded the native-hadoop library
> 12/01/31 00:27:49 INFO snappy.LoadSnappy: Snappy native library loaded
> Exception in thread "main" java.io.FileNotFoundException: File does not
> exist: /tmp/Rtmp5h8lIO/file179e4fc/_logs
> at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1822)
> at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1813)
> at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:544)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:456)
> at
> org.apache.hadoop.streaming.AutoInputFormat.getRecordReader(AutoInputFormat.java:56)
> at
> org.apache.hadoop.streaming.DumpTypedBytes.dumpTypedBytes(DumpTypedBytes.java:102)
> at
> org.apache.hadoop.streaming.DumpTypedBytes.run(DumpTypedBytes.java:83)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at
> org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:41)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
> But the file is there
> antonio@ip-10-9-65-123:~$ hadoop dfs -ls /tmp/Rtmp5h8lIO/file179e4fc/_logs
> 12/01/31 00:28:47 INFO security.UserGroupInformation: JAAS Configuration
> already set up for Hadoop, not re-installing.
> Found 1 items
> drwxrwxrwx - antonio supergroup 0 2012-01-31 00:18
> /tmp/Rtmp5h8lIO/file179e4fc/_logs/history
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
