-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21291/
-----------------------------------------------------------
Review request for Ambari and Mahadev Konar.
Bugs: AMBARI-5607
https://issues.apache.org/jira/browse/AMBARI-5607
Repository: ambari
Description
-------
Yarn Nodemanager Metrics take far too long between updates.
To demonstrate:
Run Terasort or anything that runs mapreduce:
{code}
hdfs dfs -mkdir -p benchmarks/terasort
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen
-Dmapred.map.tasks=72 -Dmapred.reduce.tasks=36 1000000
benchmarks/terasort/input
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort
-Dmapred.map.tasks=72 -Dmapred.reduce.tasks=36 benchmarks/terasort/input
benchmarks/terasort/output
hdfs dfs -rm -R -skipTrash benchmarks/terasort
{code}
Then repeatedly probe the API at:
{noformat}https://<server>:8081/api/v1/clusters/c1/services/YARN/components/NODEMANAGER?fields=host_components/metrics/yarn{noformat}
It usually takes 2-3 minutes to see the metrics update, very repeatable.
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/GANGLIA/package/files/rrd.py
3fe6901
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/GANGLIA/package/files/rrd.py
3fe6901
Diff: https://reviews.apache.org/r/21291/diff/
Testing
-------
Manually, on newly deployed cluster.
Thanks,
Dmytro Sen
