Xing created AMBARI-17512:
-----------------------------
Summary: Failed to Check Ambari Metrics
Key: AMBARI-17512
URL: https://issues.apache.org/jira/browse/AMBARI-17512
Project: Ambari
Issue Type: Bug
Components: ambari-agent, ambari-metrics, ambari-server
Affects Versions: 2.2.2
Reporter: Xing
stderr:
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py",
line 172, in <module>
AMSServiceCheck().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 219, in execute
method(env)
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
line 89, in thunk
return fn(*args, **kwargs)
File
"/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/service_check.py",
line 100, in service_check
raise Fail("Metrics were not saved. Service check has failed. "
resource_management.core.exceptions.Fail: Metrics were not saved. Service check
has failed.
Connection failed.
stdout:
2016-06-30 07:15:36,288 - Using hadoop conf dir:
/usr/hdp/current/hadoop-client/conf
2016-06-30 07:15:36,297 - Ambari Metrics service check was started.
2016-06-30 07:15:36,304 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285336000,
"starttime": 1467285336000,
"metrics": {
"1467285336000": 0.415144595584,
"1467285337000": 1467285336000
}
}
]
}
2016-06-30 07:15:36,304 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:15:51,319 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:15:51,322 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285351000,
"starttime": 1467285351000,
"metrics": {
"1467285351000": 0.415144595584,
"1467285352000": 1467285351000
}
}
]
}
2016-06-30 07:15:51,323 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:16:06,338 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:16:06,341 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285366000,
"starttime": 1467285366000,
"metrics": {
"1467285366000": 0.415144595584,
"1467285367000": 1467285366000
}
}
]
}
2016-06-30 07:16:06,341 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:16:21,350 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:16:21,353 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285381000,
"starttime": 1467285381000,
"metrics": {
"1467285381000": 0.415144595584,
"1467285382000": 1467285381000
}
}
]
}
2016-06-30 07:16:21,353 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:16:36,369 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:16:36,372 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285396000,
"starttime": 1467285396000,
"metrics": {
"1467285396000": 0.415144595584,
"1467285397000": 1467285396000
}
}
]
}
2016-06-30 07:16:36,372 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:16:51,388 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:16:51,391 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285411000,
"starttime": 1467285411000,
"metrics": {
"1467285411000": 0.415144595584,
"1467285412000": 1467285411000
}
}
]
}
2016-06-30 07:16:51,391 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:17:06,404 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:17:06,407 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285426000,
"starttime": 1467285426000,
"metrics": {
"1467285426000": 0.415144595584,
"1467285427000": 1467285426000
}
}
]
}
2016-06-30 07:17:06,407 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:17:21,410 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:17:21,413 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285441000,
"starttime": 1467285441000,
"metrics": {
"1467285441000": 0.415144595584,
"1467285442000": 1467285441000
}
}
]
}
2016-06-30 07:17:21,413 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:17:36,429 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:17:36,432 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285456000,
"starttime": 1467285456000,
"metrics": {
"1467285456000": 0.415144595584,
"1467285457000": 1467285456000
}
}
]
}
2016-06-30 07:17:36,432 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:17:51,447 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:17:51,451 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285471000,
"starttime": 1467285471000,
"metrics": {
"1467285471000": 0.415144595584,
"1467285472000": 1467285471000
}
}
]
}
2016-06-30 07:17:51,451 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:18:06,463 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:18:06,468 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285486000,
"starttime": 1467285486000,
"metrics": {
"1467285486000": 0.415144595584,
"1467285487000": 1467285486000
}
}
]
}
2016-06-30 07:18:06,469 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:18:21,486 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:18:21,489 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285501000,
"starttime": 1467285501000,
"metrics": {
"1467285501000": 0.415144595584,
"1467285502000": 1467285501000
}
}
]
}
2016-06-30 07:18:21,489 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:18:36,505 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:18:36,508 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285516000,
"starttime": 1467285516000,
"metrics": {
"1467285516000": 0.415144595584,
"1467285517000": 1467285516000
}
}
]
}
2016-06-30 07:18:36,508 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:18:51,524 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:18:51,527 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285531000,
"starttime": 1467285531000,
"metrics": {
"1467285531000": 0.415144595584,
"1467285532000": 1467285531000
}
}
]
}
2016-06-30 07:18:51,527 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:19:06,541 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:19:06,546 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285546000,
"starttime": 1467285546000,
"metrics": {
"1467285546000": 0.415144595584,
"1467285547000": 1467285546000
}
}
]
}
2016-06-30 07:19:06,546 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:19:21,561 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:19:21,564 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285561000,
"starttime": 1467285561000,
"metrics": {
"1467285561000": 0.415144595584,
"1467285562000": 1467285561000
}
}
]
}
2016-06-30 07:19:21,564 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:19:36,566 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:19:36,572 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285576000,
"starttime": 1467285576000,
"metrics": {
"1467285576000": 0.415144595584,
"1467285577000": 1467285576000
}
}
]
}
2016-06-30 07:19:36,572 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:19:51,587 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:19:51,590 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285591000,
"starttime": 1467285591000,
"metrics": {
"1467285591000": 0.415144595584,
"1467285592000": 1467285591000
}
}
]
}
2016-06-30 07:19:51,590 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:20:06,603 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:20:06,607 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285606000,
"starttime": 1467285606000,
"metrics": {
"1467285606000": 0.415144595584,
"1467285607000": 1467285606000
}
}
]
}
2016-06-30 07:20:06,607 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:20:21,619 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:20:21,623 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285621000,
"starttime": 1467285621000,
"metrics": {
"1467285621000": 0.415144595584,
"1467285622000": 1467285621000
}
}
]
}
2016-06-30 07:20:21,623 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:20:36,638 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:20:36,641 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285636000,
"starttime": 1467285636000,
"metrics": {
"1467285636000": 0.415144595584,
"1467285637000": 1467285636000
}
}
]
}
2016-06-30 07:20:36,641 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:20:51,645 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:20:51,648 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285651000,
"starttime": 1467285651000,
"metrics": {
"1467285651000": 0.415144595584,
"1467285652000": 1467285651000
}
}
]
}
2016-06-30 07:20:51,648 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:21:06,657 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:21:06,660 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285666000,
"starttime": 1467285666000,
"metrics": {
"1467285666000": 0.415144595584,
"1467285667000": 1467285666000
}
}
]
}
2016-06-30 07:21:06,660 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:21:21,664 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:21:21,669 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285681000,
"starttime": 1467285681000,
"metrics": {
"1467285681000": 0.415144595584,
"1467285682000": 1467285681000
}
}
]
}
2016-06-30 07:21:21,669 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:21:36,684 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:21:36,687 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285696000,
"starttime": 1467285696000,
"metrics": {
"1467285696000": 0.415144595584,
"1467285697000": 1467285696000
}
}
]
}
2016-06-30 07:21:36,687 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:21:51,697 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:21:51,700 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285711000,
"starttime": 1467285711000,
"metrics": {
"1467285711000": 0.415144595584,
"1467285712000": 1467285711000
}
}
]
}
2016-06-30 07:21:51,700 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:22:06,715 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:22:06,718 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285726000,
"starttime": 1467285726000,
"metrics": {
"1467285726000": 0.415144595584,
"1467285727000": 1467285726000
}
}
]
}
2016-06-30 07:22:06,719 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:22:21,734 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:22:21,739 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285741000,
"starttime": 1467285741000,
"metrics": {
"1467285741000": 0.415144595584,
"1467285742000": 1467285741000
}
}
]
}
2016-06-30 07:22:21,739 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:22:36,754 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:22:36,757 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285756000,
"starttime": 1467285756000,
"metrics": {
"1467285756000": 0.415144595584,
"1467285757000": 1467285756000
}
}
]
}
2016-06-30 07:22:36,758 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
2016-06-30 07:22:51,760 - Connection failed. Next retry in 15 seconds.
2016-06-30 07:22:51,764 - Generated metrics:
{
"metrics": [
{
"metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "host-172-16-1-204",
"timestamp": 1467285771000,
"starttime": 1467285771000,
"metrics": {
"1467285771000": 0.415144595584,
"1467285772000": 1467285771000
}
}
]
}
2016-06-30 07:22:51,764 - Connecting (POST) to
host-172-16-1-204:6188/ws/v1/timeline/metrics/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)