Unable to retrieve application logs via "yarn logs" or "mapred job -logs"
-------------------------------------------------------------------------
Key: MAPREDUCE-3744
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3744
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.1, 0.24.0
Reporter: Jason Lowe
Priority: Critical
Trying to retrieve application logs via the "yarn logs" shell command results
in an error similar to this:
Exception in thread "main" java.io.FileNotFoundException: File
/tmp/logs/application_1327694122989_0001 does not exist.
at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:226)
at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:217)
at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:192)
at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:192)
at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1371)
at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1)
at
org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1373)
at
org.apache.hadoop.yarn.logaggregation.LogDumper.dumpAllContainersLogs(LogDumper.java:191)
at
org.apache.hadoop.yarn.logaggregation.LogDumper.run(LogDumper.java:107)
at
org.apache.hadoop.yarn.logaggregation.LogDumper.main(LogDumper.java:226)
Trying to grab the logs via the "mapred jobs -logs" command results in this
error:
2012-01-27 14:05:52,040 INFO mapred.ClientServiceDelegate
(ClientServiceDelegate.java:getProxy(246)) - Application state is completed.
FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2012-01-27 14:05:52,041 WARN mapred.ClientServiceDelegate
(ClientServiceDelegate.java:checkAndGetHSProxy(257)) - Job History Server is
not configured.
Unable to get log information for job: job_1327694122989_0001
Even though the historyserver process is running.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
