[ 
https://issues.apache.org/jira/browse/AMBARI-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609389#comment-15609389
 ] 

Aravindan Vijayan commented on AMBARI-18705:
--------------------------------------------

{code}
[INFO]
[INFO] ambari-metrics .................................... SUCCESS [1.239s]
[INFO] Ambari Metrics Common ............................. SUCCESS [3.362s]
[INFO] Ambari Metrics Hadoop Sink ........................ SUCCESS [4.724s]
[INFO] Ambari Metrics Flume Sink ......................... SUCCESS [2.462s]
[INFO] Ambari Metrics Kafka Sink ......................... SUCCESS [3.099s]
[INFO] Ambari Metrics Storm Sink ......................... SUCCESS [1.458s]
[INFO] Ambari Metrics Storm Sink (Legacy) ................ SUCCESS [1.474s]
[INFO] Ambari Metrics Collector .......................... SUCCESS [2:57.670s]
[INFO] Ambari Metrics Monitor ............................ SUCCESS [3.653s]
[INFO] Ambari Metrics Grafana ............................ SUCCESS [5.429s]
[INFO] Ambari Metrics Assembly ........................... SUCCESS [25.214s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
{code}

> All host metrics not being collected by AMS if user does not have permissions 
> to read mount point.
> --------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-18705
>                 URL: https://issues.apache.org/jira/browse/AMBARI-18705
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>    Affects Versions: 2.4.2
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Critical
>             Fix For: 2.4.2
>
>         Attachments: AMBARI-18705.patch
>
>
> PROBLEM
> Host metrics are not being collected by AMS in certain environments with 
> restrictive disks. 
> This is because the metrics monitor process which collects the host metrics 
> has insufficient  permissions to read a mountpoint. It fails rather than 
> sending other metrics.
> {code}
> Traceback (most recent call last):
>   File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner
>     self.run()
>   File "/usr/lib64/python2.7/threading.py", line 1083, in run
>     self.function(*self.args, **self.kwargs)
>   File 
> "/usr/lib/python2.6/site-packages/resource_monitoring/core/metric_collector.py",
>  line 45, in process_event
>     self.process_host_collection_event(event)
>   File 
> "/usr/lib/python2.6/site-packages/resource_monitoring/core/metric_collector.py",
>  line 76, in process_host_collection_event
>     metrics.update(self.host_info.get_combined_disk_usage())
>   File 
> "/usr/lib/python2.6/site-packages/resource_monitoring/core/host_info.py", 
> line 188, in get_combined_disk_usage
>     usage = psutil.disk_usage(part.mountpoint)
>   File 
> "/usr/lib/python2.6/site-packages/resource_monitoring/psutil/build/lib.linux-x86_64-2.7/psutil/__init__.py",
>  line 1690, in disk_usage
>     return _psplatform.disk_usage(path)
>   File 
> "/usr/lib/python2.6/site-packages/resource_monitoring/psutil/build/lib.linux-x86_64-2.7/psutil/_psposix.py",
>  line 121, in disk_usage
>     st = os.statvfs(path)
> OSError: [Errno 13] Permission denied: '/abc/def/mountpoint'
> {code}
> {code}
> [root@ctr-e45-1475874954070-13451-01-000004 ~]# ls -lrt /abc/def/mountpoint
> total 4
> drwx--x--- 4 nobody 3004   36 Oct 26 07:20 filecache
> drwxr-s--- 5 nobody 3004 4096 Oct 26 07:21 
> container_e45_1475874954070_13451_01_000004
> {code}
> FIX
> In AMS monitor, tolerate this failure and send other host metrics.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to