[
https://issues.apache.org/jira/browse/AMBARI-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409200#comment-15409200
]
jean carlo rivera ura commented on AMBARI-15100:
------------------------------------------------
Hi [~dsen], it is this error also related to this ticket?
{noformat}
2016-07-24 03:10:52,472 WARN util.ProcfsBasedProcessTree
(ProcfsBasedProcessTree.java:constructProcessInfo(563)) - Unexpected: procfs
stat file is not in the expected format for process with pid 3626
2016-07-24 03:10:58,953 INFO monitor.ContainersMonitorImpl
(ContainersMonitorImpl.java:run(458)) - Memory usage of ProcessTree 2546 for
container-id container_e11_1464178993574_41866_01_000001: 429.5 MB of 2 GB
physical memory used; 2.2 GB of 4.2 GB virtual memory used
2016-07-24 03:11:25,673 FATAL yarn.YarnUncaughtExceptionHandler
(YarnUncaughtExceptionHandler.java:uncaughtException(51)) - Thread
Thread[timeline,5,main] threw an Error. Shutting down now...
java.lang.OutOfMemoryError: GC overhead limit exceeded
at
org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache$TimelineMetricHolder.put(TimelineMetricsCache.java:118)
at
org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache.putTimelineMetric(TimelineMetricsCache.java:154)
at
org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache.putTimelineMetric(TimelineMetricsCache.java:177)
at
org.apache.hadoop.metrics2.sink.timeline.HadoopTimelineMetricsSink.putMetrics(HadoopTimelineMetricsSink.java:193)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:186)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:43)
at
org.apache.hadoop.metrics2.impl.SinkQueue.consumeAll(SinkQueue.java:87)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetricsFromQueue(MetricsSinkAdapter.java:134)
at
org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.run(MetricsSinkAdapter.java:88)
{noformat}
> OOM on TimelineMetricCache in Nodemanager
> -----------------------------------------
>
> Key: AMBARI-15100
> URL: https://issues.apache.org/jira/browse/AMBARI-15100
> Project: Ambari
> Issue Type: Bug
> Components: ambari-metrics
> Affects Versions: 2.1.0
> Reporter: Siddharth Wagle
> Assignee: Dmytro Sen
> Priority: Critical
> Fix For: 2.2.2
>
> Attachments: AMBARI-15100-trunk_4.patch
>
>
> Reported on ambari user group:
> {code}
> 2016-02-16 18:04:24,510 WARN impl.MetricsSystemImpl
> (MetricsSystemImpl.java:run(373)) - java.util.ConcurrentModificationException
> 2016-02-16 18:04:34,509 WARN impl.MetricsSystemImpl
> (MetricsSystemImpl.java:run(373)) - java.util.ConcurrentModificationException
> 2016-02-16 18:04:44,510 WARN impl.MetricsSystemImpl
> (MetricsSystemImpl.java:run(373)) - java.util.ConcurrentModificationException
> 2016-02-16 18:04:59,424 FATAL yarn.YarnUncaughtExceptionHandler
> (YarnUncaughtExceptionHandler.java:uncaughtException(51)) - Thread
> Thread[timeline,5,main] threw an Error. Shutting down now...
> java.lang.OutOfMemoryError: Java heap space
> at java.util.HashMap.resize(HashMap.java:703)
> at java.util.HashMap.putVal(HashMap.java:662)
> at java.util.HashMap.put(HashMap.java:611)
> at
> org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache$TimelineMetricHolder.put(TimelineMetricsCache.java:123)
> at
> org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache.putTimelineMetric(TimelineMetricsCache.java:154)
> at
> org.apache.hadoop.metrics2.sink.timeline.cache.TimelineMetricsCache.putTimelineMetric(TimelineMetricsCache.java:177)
> at
> org.apache.hadoop.metrics2.sink.timeline.HadoopTimelineMetricsSink.putMetrics(HadoopTimelineMetricsSink.java:195)
> at
> org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:186)
> at
> org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:43)
> at
> org.apache.hadoop.metrics2.impl.SinkQueue.consumeAll(SinkQueue.java:87)
> at
> org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetricsFromQueue(MetricsSinkAdapter.java:134)
> at
> org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.run(MetricsSinkAdapter.java:88)
> 2016-02-16 18:04:59,433 INFO util.ExitUtil (ExitUtil.java:halt(147)) - Halt
> with status -1 Message: HaltException
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
