[
https://issues.apache.org/jira/browse/YARN-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113748#comment-14113748
]
Jason Lowe commented on YARN-2460:
----------------------------------
Same cautions here as I mentioned in MAPREDUCE-6057. Please do not remove any
properties that are referenced by the code, even if they aren't referenced by
YarnConfiguration.
I'm surprised to see mapreduce.job.* properties here rather than
mapred-default.xml, and that seems like a mistake. The
yarn.nodemanager.aux-services.mapreduce_shuffle.class is necessary to avoid
having users specify the handler for the mapreduce_shuffle aux service, but we
still make them explicitly configure yarn.nodemanager.aux-services to have
mapreduce_shuffle if they want to run MapReduce jobs.
yarn.nodemanage.hostname is referenced by other yarn-default.xml entries.
yarn.nodemanager.resourcemanager.connect.* should be renamed to
yarn.resourcemanager.connect.*. This appears to have been overlooked when
YARN-1056 was fixed.
> Remove obsolete entries from yarn-default.xml
> ---------------------------------------------
>
> Key: YARN-2460
> URL: https://issues.apache.org/jira/browse/YARN-2460
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.5.0
> Reporter: Ray Chiang
> Priority: Minor
> Labels: newbie
>
> The following properties are defined in yarn-default.xml, but do not exist in
> YarnConfiguration.
> mapreduce.job.hdfs-servers
> mapreduce.job.jar
> yarn.ipc.exception.factory.class
> yarn.ipc.serializer.type
> yarn.nodemanager.aux-services.mapreduce_shuffle.class
> yarn.nodemanager.hostname
> yarn.nodemanager.resourcemanager.connect.retry_interval.secs
> yarn.nodemanager.resourcemanager.connect.wait.secs
> yarn.resourcemanager.amliveliness-monitor.interval-ms
> yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs
> yarn.resourcemanager.container.liveness-monitor.interval-ms
> yarn.resourcemanager.nm.liveness-monitor.interval-ms
> yarn.timeline-service.hostname
> yarn.timeline-service.http-authentication.simple.anonymous.allowed
> yarn.timeline-service.http-authentication.type
> Presumably, the mapreduce.* properties are okay. Similarly, the
> yarn.timeline-service.* properties are for the future TimelineService.
> However, the rest are likely fully deprecated.
> Submitting bug for comment/feedback about which other properties should be
> kept in yarn-default.xml.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
