Jason Lowe commented on YARN-2460:

Same cautions here as I mentioned in MAPREDUCE-6057.  Please do not remove any 
properties that are referenced by the code, even if they aren't referenced by 

I'm surprised to see mapreduce.job.* properties here rather than 
mapred-default.xml, and that seems like a mistake.  The 
yarn.nodemanager.aux-services.mapreduce_shuffle.class is necessary to avoid 
having users specify the handler for the mapreduce_shuffle aux service, but we 
still make them explicitly configure yarn.nodemanager.aux-services to have 
mapreduce_shuffle if they want to run MapReduce jobs.

yarn.nodemanage.hostname is referenced by other yarn-default.xml entries.

yarn.nodemanager.resourcemanager.connect.* should be renamed to 
yarn.resourcemanager.connect.*.  This appears to have been overlooked when 
YARN-1056 was fixed.

> Remove obsolete entries from yarn-default.xml
> ---------------------------------------------
>                 Key: YARN-2460
>                 URL: https://issues.apache.org/jira/browse/YARN-2460
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.5.0
>            Reporter: Ray Chiang
>            Priority: Minor
>              Labels: newbie
> The following properties are defined in yarn-default.xml, but do not exist in 
> YarnConfiguration.
>   mapreduce.job.hdfs-servers
>   mapreduce.job.jar
>   yarn.ipc.exception.factory.class
>   yarn.ipc.serializer.type
>   yarn.nodemanager.aux-services.mapreduce_shuffle.class
>   yarn.nodemanager.hostname
>   yarn.nodemanager.resourcemanager.connect.retry_interval.secs
>   yarn.nodemanager.resourcemanager.connect.wait.secs
>   yarn.resourcemanager.amliveliness-monitor.interval-ms
>   yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs
>   yarn.resourcemanager.container.liveness-monitor.interval-ms
>   yarn.resourcemanager.nm.liveness-monitor.interval-ms
>   yarn.timeline-service.hostname
>   yarn.timeline-service.http-authentication.simple.anonymous.allowed
>   yarn.timeline-service.http-authentication.type
> Presumably, the mapreduce.* properties are okay.  Similarly, the 
> yarn.timeline-service.* properties are for the future TimelineService.  
> However, the rest are likely fully deprecated.
> Submitting bug for comment/feedback about which other properties should be 
> kept in yarn-default.xml.

This message was sent by Atlassian JIRA

Reply via email to