Hi, I am facing an issue while setting up Ambari Metrics in distributed mode. I am setting up HDP 2.3.x using Ambari 2.1.x. Initially when I was setting up the cluster, I was shown a warning message that the volume / directory for metrics service is same as the one used by datanode and hence I was recommended to change it. So I went ahead and pointed it to hdfs, trying to setting up metrics service in distributed mode.
However, Ambari Metrics service is not set up properly and it timed out while setting up the cluster, showing a warning that Ambari Metrics service hasn’t started. I restarted the Metrics collector service multiple times, but it would stop again in a few seconds. On further observation, I realised that in the ams-site.xml file, timeline.metrics.service.operation.mode was still pointing to “embedded", where as hbase-site.xml had all the required properties set correctly. So I changed the timeline.metrics.service.operation.mode property to “distributed” and restarted the required services as recommended by Ambari. However, the restart process is stuck at 68% and eventually timed out. Its not able to restart the Metrics Collector service. However, all the metrics monitor services are re-started without any issues. Can anyone please throw light on why this happening and what is the solution to fix this? Thanks Vijay -- The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you receive this e-mail in error please delete it from your system immediately and notify us either by e-mail or telephone. You should not copy, forward or otherwise disclose the content of the e-mail. The views expressed in this communication may not necessarily be the view held by WHISHWORKS.
