Xianyin Xin created YARN-5302:
---------------------------------
Summary: Yarn Application log Aggreagation fails due to NM can not
get correct HDFS delegation token II
Key: YARN-5302
URL: https://issues.apache.org/jira/browse/YARN-5302
Project: Hadoop YARN
Issue Type: Bug
Components: yarn
Reporter: Xianyin Xin
Different with YARN-5089, this happens at NM side. When NM recovers,
credentials are read from NMStateStore. When initialize app aggregators,
exception happens because of the overdue tokens.
{code:title=LogAggregationService.java}
protected void initAppAggregator(final ApplicationId appId, String user,
Credentials credentials, ContainerLogsRetentionPolicy logRetentionPolicy,
Map<ApplicationAccessType, String> appAcls,
LogAggregationContext logAggregationContext) {
// Get user's FileSystem credentials
final UserGroupInformation userUgi =
UserGroupInformation.createRemoteUser(user);
if (credentials != null) {
userUgi.addCredentials(credentials);
}
...
try {
// Create the app dir
createAppDir(user, appId, userUgi);
} catch (Exception e) {
appLogAggregator.disableLogAggregation();
if (!(e instanceof YarnRuntimeException)) {
appDirException = new YarnRuntimeException(e);
} else {
appDirException = (YarnRuntimeException)e;
}
appLogAggregators.remove(appId);
closeFileSystems(userUgi);
throw appDirException;
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
