[
https://issues.apache.org/jira/browse/MAPREDUCE-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213704#comment-13213704
]
Daryn Sharp commented on MAPREDUCE-3889:
----------------------------------------
Yes, this particular bug happens when tasks fail. We probably need another
jira for the underlying error that trips this bug:
{noformat}
2012-02-21 23:13:51,600 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error
running child :
java.lang.NoSuchMethodError:
org.apache.hadoop.tools.DistCp.checkAndClose(Ljava/io/Closeable;)Z
at
org.apache.hadoop.tools.DistCp$CopyFilesMapper.doCopyFile(DistCp.java:465)
at org.apache.hadoop.tools.DistCp$CopyFilesMapper.copy(DistCp.java:519)
at
org.apache.hadoop.tools.DistCp$CopyFilesMapper.copyWithRetries(DistCp.java:594)
at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:650)
at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:324)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:399)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:334)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:147)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:142)
{noformat}
It's bizarre, because the caller is in the same class as the supposedly missing
method.
> job client tries to use /tasklog interface, but that doesn't exist anymore
> --------------------------------------------------------------------------
>
> Key: MAPREDUCE-3889
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3889
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Thomas Graves
> Priority: Critical
>
> if you specify -Dmapreduce.client.output.filter=SUCCEEDED option when
> running a job it tries to fetch task logs to print out on the client side
> from a url like:
> http://nodemanager:8080/tasklog?plaintext=true&attemptid=attempt_1329857083014_0003_r_000000_0&filter=stdout
> It always errors on this request with: Required param job, map and reduce
> We saw this error when using distcp and the distcp failed. I'm not sure if it
> is mandatory for distcp or just informational purposes. I'm guessing the
> latter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
