[
https://issues.apache.org/jira/browse/MAPREDUCE-3911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217224#comment-13217224
]
Daryn Sharp commented on MAPREDUCE-3911:
----------------------------------------
{{DelegationTokenRenewal}} is used to renew the job's tokens. It will attempt
an immediate renewal, but the problem is the first renewal is performed in a
background thread that ignores renewal failures. If the first renewal is
performed in the job's thread context, then an invalid token will abort the job.
I posted a patch a few months ago that fixed this very issue. Unfortunately
I'm having trouble finding the jira.
> Pending Jobs Metric can get off if job is submitted with invalid HDFS
> delegation token.
> ---------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3911
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3911
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv1
> Affects Versions: 1.0.0
> Reporter: Robert Joseph Evans
>
> If a job is submitted, but the HDFS delegation token is invalid, The pending
> jobs counter will be incremented, then an exception will be thrown when we
> cannot get an instance of FileSystem to read the jobs configuration. The
> error is returned, but the pending counter is never decremented.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
