[
https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150616#comment-15150616
]
Thomas Graves commented on SPARK-12316:
---------------------------------------
[~hshreedharan] I think what you are saying also makes sense but is a much
bigger change. as I mention on the Pr we just checked for the credentials file
so if it didn't get renewed then something strange happened anyway so delaying
1 minute to retry seems reasonable.
We can definitely add in more logic around this too. For instance only retry a
certain number of tries or if the staging dir is gone rather then no files
within it, immediately exit but I think that can be done separately.
Please comment on the PR if you have alternate ideas.
> Stack overflow with endless call of `Delegation token thread` when
> application end.
> -----------------------------------------------------------------------------------
>
> Key: SPARK-12316
> URL: https://issues.apache.org/jira/browse/SPARK-12316
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: SaintBacchus
> Assignee: SaintBacchus
> Attachments: 20151210045149.jpg, 20151210045533.jpg
>
>
> When application end, AM will clean the staging dir.
> But if the driver trigger to update the delegation token, it will can't find
> the right token file and then it will endless cycle call the method
> 'updateCredentialsIfRequired'.
> Then it lead to StackOverflowError.
> !https://issues.apache.org/jira/secure/attachment/12779495/20151210045149.jpg!
> !https://issues.apache.org/jira/secure/attachment/12779496/20151210045533.jpg!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
