[
https://issues.apache.org/jira/browse/YARN-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994501#comment-15994501
]
stefanlee edited comment on YARN-3269 at 5/3/17 8:59 AM:
---------------------------------------------------------
thanks for this jira, but when we do not config
*yarn.nodemanager.remote-app-log-dir*, it will be */tmp/logs* and NM or mr
historyserver will check */tmp/logs* 's scheme when write log to HDFS or
read log from HDFS,then they will throw exception of {{No AbstractFileSystem
for scheme: null}} in class *AbstractFileSystem.java* ,so i suggest that when
*yarn.nodemanager.remote-app-log-dir* is default value(scheme is null ), we
still use *FileContext.getFileContext(conf)* in *AggregatedLogFormat.java*,
else we can use *FileContext.getFileContext(remoteAppLogFile.toUri(), conf)* ,
am i wrong with this question? my hadoop version is 2.4.0 [~xgong] [~zhz]
was (Author: imstefanlee):
thanks for this jira, but when we do not config
*yarn.nodemanager.remote-app-log-dir*, it will be */tmp/logs* and NM or mr
historyserver will check */tmp/logs* 's scheme when write log to HDFS or
read log from HDFS,then they will throw exception of {{No AbstractFileSystem
for scheme: null}} in class *AbstractFileSystem.java* ,so i suggest that when
*yarn.nodemanager.remote-app-log-dir* is default value(scheme is null ), we
still use *FileContext.getFileContext(conf)* in *AggregatedLogFormat.java*,
else we can use *FileContext.getFileContext(remoteAppLogFile.toUri(), conf)* ,
am i wrong with this question? [~xgong] [~zhz]
> Yarn.nodemanager.remote-app-log-dir could not be configured to fully
> qualified path
> -----------------------------------------------------------------------------------
>
> Key: YARN-3269
> URL: https://issues.apache.org/jira/browse/YARN-3269
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Xuan Gong
> Assignee: Xuan Gong
> Fix For: 2.8.0, 2.7.4, 3.0.0-alpha1
>
> Attachments: YARN-3269.1.patch, YARN-3269.2.patch
>
>
> Log aggregation currently is always relative to the default file system, not
> an arbitrary file system identified by URI. So we can't put an arbitrary
> fully-qualified URI into yarn.nodemanager.remote-app-log-dir.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
