[
https://issues.apache.org/jira/browse/AMBARI-17512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15402482#comment-15402482
]
Aravindan Vijayan commented on AMBARI-17512:
--------------------------------------------
Can you please share the Metrics collector logs ?
/var/log/ambari-metrics-collector/*
> Failed to Check Ambari Metrics
> ------------------------------
>
> Key: AMBARI-17512
> URL: https://issues.apache.org/jira/browse/AMBARI-17512
> Project: Ambari
> Issue Type: Bug
> Components: ambari-agent, ambari-metrics, ambari-server
> Affects Versions: 2.2.2
> Reporter: Xing
>
> stderr:
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py",
> line 172, in <module>
> AMSServiceCheck().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 219, in execute
> method(env)
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
> line 89, in thunk
> return fn(*args, **kwargs)
> File
> "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py",
> line 100, in service_check
> raise Fail("Metrics were not saved. Service check has failed. "
> resource_management.core.exceptions.Fail: Metrics were not saved. Service
> check has failed.
> Connection failed.
> stdout:
> 2016-06-30 07:15:36,288 - Using hadoop conf dir:
> /usr/hdp/current/hadoop-client/conf
> 2016-06-30 07:15:36,297 - Ambari Metrics service check was started.
> 2016-06-30 07:15:36,304 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285336000,
> "starttime": 1467285336000,
> "metrics": {
> "1467285336000": 0.415144595584,
> "1467285337000": 1467285336000
> }
> }
> ]
> }
> 2016-06-30 07:15:36,304 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:15:51,319 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:15:51,322 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285351000,
> "starttime": 1467285351000,
> "metrics": {
> "1467285351000": 0.415144595584,
> "1467285352000": 1467285351000
> }
> }
> ]
> }
> 2016-06-30 07:15:51,323 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:16:06,338 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:16:06,341 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285366000,
> "starttime": 1467285366000,
> "metrics": {
> "1467285366000": 0.415144595584,
> "1467285367000": 1467285366000
> }
> }
> ]
> }
> 2016-06-30 07:16:06,341 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:16:21,350 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:16:21,353 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285381000,
> "starttime": 1467285381000,
> "metrics": {
> "1467285381000": 0.415144595584,
> "1467285382000": 1467285381000
> }
> }
> ]
> }
> 2016-06-30 07:16:21,353 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:16:36,369 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:16:36,372 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285396000,
> "starttime": 1467285396000,
> "metrics": {
> "1467285396000": 0.415144595584,
> "1467285397000": 1467285396000
> }
> }
> ]
> }
> 2016-06-30 07:16:36,372 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:16:51,388 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:16:51,391 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285411000,
> "starttime": 1467285411000,
> "metrics": {
> "1467285411000": 0.415144595584,
> "1467285412000": 1467285411000
> }
> }
> ]
> }
> 2016-06-30 07:16:51,391 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:17:06,404 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:17:06,407 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285426000,
> "starttime": 1467285426000,
> "metrics": {
> "1467285426000": 0.415144595584,
> "1467285427000": 1467285426000
> }
> }
> ]
> }
> 2016-06-30 07:17:06,407 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:17:21,410 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:17:21,413 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285441000,
> "starttime": 1467285441000,
> "metrics": {
> "1467285441000": 0.415144595584,
> "1467285442000": 1467285441000
> }
> }
> ]
> }
> 2016-06-30 07:17:21,413 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:17:36,429 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:17:36,432 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285456000,
> "starttime": 1467285456000,
> "metrics": {
> "1467285456000": 0.415144595584,
> "1467285457000": 1467285456000
> }
> }
> ]
> }
> 2016-06-30 07:17:36,432 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:17:51,447 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:17:51,451 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285471000,
> "starttime": 1467285471000,
> "metrics": {
> "1467285471000": 0.415144595584,
> "1467285472000": 1467285471000
> }
> }
> ]
> }
> 2016-06-30 07:17:51,451 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:18:06,463 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:18:06,468 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285486000,
> "starttime": 1467285486000,
> "metrics": {
> "1467285486000": 0.415144595584,
> "1467285487000": 1467285486000
> }
> }
> ]
> }
> 2016-06-30 07:18:06,469 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:18:21,486 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:18:21,489 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285501000,
> "starttime": 1467285501000,
> "metrics": {
> "1467285501000": 0.415144595584,
> "1467285502000": 1467285501000
> }
> }
> ]
> }
> 2016-06-30 07:18:21,489 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:18:36,505 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:18:36,508 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285516000,
> "starttime": 1467285516000,
> "metrics": {
> "1467285516000": 0.415144595584,
> "1467285517000": 1467285516000
> }
> }
> ]
> }
> 2016-06-30 07:18:36,508 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:18:51,524 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:18:51,527 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285531000,
> "starttime": 1467285531000,
> "metrics": {
> "1467285531000": 0.415144595584,
> "1467285532000": 1467285531000
> }
> }
> ]
> }
> 2016-06-30 07:18:51,527 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:19:06,541 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:19:06,546 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285546000,
> "starttime": 1467285546000,
> "metrics": {
> "1467285546000": 0.415144595584,
> "1467285547000": 1467285546000
> }
> }
> ]
> }
> 2016-06-30 07:19:06,546 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:19:21,561 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:19:21,564 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285561000,
> "starttime": 1467285561000,
> "metrics": {
> "1467285561000": 0.415144595584,
> "1467285562000": 1467285561000
> }
> }
> ]
> }
> 2016-06-30 07:19:21,564 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:19:36,566 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:19:36,572 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285576000,
> "starttime": 1467285576000,
> "metrics": {
> "1467285576000": 0.415144595584,
> "1467285577000": 1467285576000
> }
> }
> ]
> }
> 2016-06-30 07:19:36,572 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:19:51,587 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:19:51,590 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285591000,
> "starttime": 1467285591000,
> "metrics": {
> "1467285591000": 0.415144595584,
> "1467285592000": 1467285591000
> }
> }
> ]
> }
> 2016-06-30 07:19:51,590 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:20:06,603 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:20:06,607 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285606000,
> "starttime": 1467285606000,
> "metrics": {
> "1467285606000": 0.415144595584,
> "1467285607000": 1467285606000
> }
> }
> ]
> }
> 2016-06-30 07:20:06,607 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:20:21,619 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:20:21,623 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285621000,
> "starttime": 1467285621000,
> "metrics": {
> "1467285621000": 0.415144595584,
> "1467285622000": 1467285621000
> }
> }
> ]
> }
> 2016-06-30 07:20:21,623 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:20:36,638 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:20:36,641 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285636000,
> "starttime": 1467285636000,
> "metrics": {
> "1467285636000": 0.415144595584,
> "1467285637000": 1467285636000
> }
> }
> ]
> }
> 2016-06-30 07:20:36,641 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:20:51,645 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:20:51,648 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285651000,
> "starttime": 1467285651000,
> "metrics": {
> "1467285651000": 0.415144595584,
> "1467285652000": 1467285651000
> }
> }
> ]
> }
> 2016-06-30 07:20:51,648 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:21:06,657 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:21:06,660 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285666000,
> "starttime": 1467285666000,
> "metrics": {
> "1467285666000": 0.415144595584,
> "1467285667000": 1467285666000
> }
> }
> ]
> }
> 2016-06-30 07:21:06,660 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:21:21,664 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:21:21,669 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285681000,
> "starttime": 1467285681000,
> "metrics": {
> "1467285681000": 0.415144595584,
> "1467285682000": 1467285681000
> }
> }
> ]
> }
> 2016-06-30 07:21:21,669 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:21:36,684 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:21:36,687 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285696000,
> "starttime": 1467285696000,
> "metrics": {
> "1467285696000": 0.415144595584,
> "1467285697000": 1467285696000
> }
> }
> ]
> }
> 2016-06-30 07:21:36,687 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:21:51,697 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:21:51,700 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285711000,
> "starttime": 1467285711000,
> "metrics": {
> "1467285711000": 0.415144595584,
> "1467285712000": 1467285711000
> }
> }
> ]
> }
> 2016-06-30 07:21:51,700 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:22:06,715 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:22:06,718 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285726000,
> "starttime": 1467285726000,
> "metrics": {
> "1467285726000": 0.415144595584,
> "1467285727000": 1467285726000
> }
> }
> ]
> }
> 2016-06-30 07:22:06,719 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:22:21,734 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:22:21,739 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285741000,
> "starttime": 1467285741000,
> "metrics": {
> "1467285741000": 0.415144595584,
> "1467285742000": 1467285741000
> }
> }
> ]
> }
> 2016-06-30 07:22:21,739 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:22:36,754 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:22:36,757 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285756000,
> "starttime": 1467285756000,
> "metrics": {
> "1467285756000": 0.415144595584,
> "1467285757000": 1467285756000
> }
> }
> ]
> }
> 2016-06-30 07:22:36,758 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
> 2016-06-30 07:22:51,760 - Connection failed. Next retry in 15 seconds.
> 2016-06-30 07:22:51,764 - Generated metrics:
> {
> "metrics": [
> {
> "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
> "appid": "amssmoketestfake",
> "hostname": "host-172-16-1-204",
> "timestamp": 1467285771000,
> "starttime": 1467285771000,
> "metrics": {
> "1467285771000": 0.415144595584,
> "1467285772000": 1467285771000
> }
> }
> ]
> }
> 2016-06-30 07:22:51,764 - Connecting (POST) to
> host-172-16-1-204:6188/ws/v1/timeline/metrics/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
