Dmytro Sen created AMBARI-17914:
-----------------------------------
Summary: Request for HBase metrics making a call to Namenode and
Nimbus for that metric
Key: AMBARI-17914
URL: https://issues.apache.org/jira/browse/AMBARI-17914
Project: Ambari
Issue Type: Bug
Components: ambari-metrics, ambari-server
Affects Versions: 2.4.0
Reporter: Dmytro Sen
Assignee: Dmytro Sen
Priority: Critical
Fix For: 2.4.0
While investigating a slow API call on perf cluster found that we are
requesting wrong metrics from AMS which wastes a network round trip and will
not have any data.
API call:
{code}
http://server1:8080/api/v1/clusters/cl1/components/?ServiceComponentInfo/component_name=APP_TIMELINE_SERVER|ServiceComponentInfo/category=MASTER&fields=ServiceComponentInfo/service_name,host_components/HostRoles/display_name,host_components/HostRoles/host_name,host_components/HostRoles/state,host_components/HostRoles/maintenance_state,host_components/HostRoles/stale_configs,host_components/HostRoles/ha_state,host_components/HostRoles/desired_admin_state,,host_components/metrics/jvm/memHeapUsedM,host_components/metrics/jvm/HeapMemoryMax,host_components/metrics/jvm/HeapMemoryUsed,host_components/metrics/jvm/memHeapCommittedM,host_components/metrics/mapred/jobtracker/trackers_decommissioned,host_components/metrics/cpu/cpu_wio,host_components/metrics/rpc/client/RpcQueueTime_avg_time,host_components/metrics/dfs/FSNamesystem/*,host_components/metrics/dfs/namenode/Version,host_components/metrics/dfs/namenode/LiveNodes,host_components/metrics/dfs/namenode/DeadNodes,host_components/metrics/dfs/namenode/DecomNodes,host_components/metrics/dfs/namenode/TotalFiles,host_components/metrics/dfs/namenode/UpgradeFinalized,host_components/metrics/dfs/namenode/Safemode,host_components/metrics/runtime/StartTime,host_components/metrics/hbase/master/IsActiveMaster,host_components/metrics/hbase/master/MasterStartTime,host_components/metrics/hbase/master/MasterActiveTime,host_components/metrics/hbase/master/AverageLoad,host_components/metrics/master/AssignmentManger/ritCount,host_components/metrics/yarn/Queue,host_components/metrics/yarn/ClusterMetrics/NumActiveNMs,host_components/metrics/yarn/ClusterMetrics/NumLostNMs,host_components/metrics/yarn/ClusterMetrics/NumUnhealthyNMs,host_components/metrics/yarn/ClusterMetrics/NumRebootedNMs,host_components/metrics/yarn/ClusterMetrics/NumDecommissionedNMs&minimal_response=true&_=1469047954755
{code}
Ambari UI makes this call every 10 seconds and hence this is relevant change.
AMS calls:
{code}
21 Jul 2016 23:43:20,840 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
21 Jul 2016 23:43:20,869 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=NAMENODE
21 Jul 2016 23:43:20,890 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-3&appId=HOST
21 Jul 2016 23:43:20,931 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-3&appId=NIMBUS
21 Jul 2016 23:43:20,948 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
21 Jul 2016 23:43:21,076 DEBUG [ambari-client-thread-27]
MetricsRequestHelper:72 - Metrics request url =
http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=AMS-HBASE
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
