Jason Lowe commented on YARN-4041:

Maybe.  The synchronous recovery was added as part of YARN-2010, and I don't 
recall from that JIRA why it was crucial for the token renewal process to be 
performed synchronously during recovery.  [~jianhe] or [~kasha] do you see any 
issues with making the delegation token renewal asynchronous for active 
applications during RM recovery?

> Slow delegation token renewal can severely prolong RM recovery
> --------------------------------------------------------------
>                 Key: YARN-4041
>                 URL: https://issues.apache.org/jira/browse/YARN-4041
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.6.0
>            Reporter: Jason Lowe
> When the RM does a work-preserving restart it synchronously tries to renew 
> delegation tokens for every active application.  If a token server happens to 
> be down or is running slow and a lot of the active apps were using tokens 
> from that server then it can have a huge impact on the time it takes the RM 
> to process the restart.

This message was sent by Atlassian JIRA

Reply via email to