yarn.log-aggregation-enable true Whether to enable log aggregation yarn.resourcemanager.hostname resourcemanager.137.195.143.131 The hostname of the RM. yarn.resourcemanager.address 137.195.143.131:8032 ResourceManager host and port yarn.resourcemanager.scheduler.address 137.195.143.131:8030 ResourceManager host:port for ApplicationMasters to talk to Scheduler ResourceManager host:port for NodeManagers. yarn.resourcemanager.resource-tracker.address 137.195.143.131:8031 yarn.resourcemanager.admin.address 137.195.143.131:8033 ResourceManager host:port for administrative commands. yarn.resourcemanager.webapp.address 137.195.143.131:8088 ResourceManager web-ui host:port. yarn.resourcemanager.scheduler.class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler ResourceManager Scheduler class. yarn.scheduler.minimum-allocation-mb 1024 Minimum limit of memory to allocate to each container request at the Resource Manager. yarn.scheduler.maximum-allocation-mb 8192 Maximum limit of memory to allocate to each container request at the Resource Manager. yarn.nodemanager.resource.memory-mb 8192 Physical memory, in MB, to be made available to running containers yarn.nodemanager.vmem-pmem-ratio 2.1 yarn.nodemanager.remote-app-log-dir 10800 Default time (in seconds) to retain log files on the NodeManager - Only applicable if log-aggregation is disabled. yarn.nodemanager.log.retain-seconds /tmp/logs HDFS directory where the application logs are moved on application completion. Need to set appropriate permissions. Only applicable if log-aggregation is enabled. yarn.nodemanager.remote-app-log-dir-suffix logs Suffix appended to the remote log dir. Logs will be aggregated to. yarn.nodemanager.aux-services mapreduce_shuffle Shuffle service that needs to be set for Map Reduce applications. yarn.log-aggregation.retain-seconds -1 How long to keep aggregation logs before deleting them. -1 disables. Be careful, set this too small and you will spam the name node. yarn.log-aggregation.retain-check-interval-seconds -1 Time between checks for aggregated log retention. If set to 0 or a negative value then the value is computed as one-tenth of the aggregated log retention time. Be careful, set this too small and you will spam the name node.