[
https://issues.apache.org/jira/browse/AMBARI-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308741#comment-15308741
]
Hudson commented on AMBARI-16757:
---------------------------------
SUCCESS: Integrated in Ambari-trunk-Commit #4969 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/4969/])
AMBARI-16757. Spark History Server heap size is not exposed (History (sgunturi:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=29fe46f55462bd3b2e9b2d91c69d706c48c632c3])
*
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py
> Spark History Server heap size is not exposed (History Server crashed with
> OOM)
> -------------------------------------------------------------------------------
>
> Key: AMBARI-16757
> URL: https://issues.apache.org/jira/browse/AMBARI-16757
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.0.0
> Reporter: Weiqing Yang
> Assignee: Weiqing Yang
> Priority: Minor
> Fix For: 2.4.0
>
> Attachments: AMBARI-16757-1.patch, AMBARI-16757-2.patch,
> AMBARI-16757-3.patch, AMBARI-16757.ADDENDUM.patch
>
>
> Ambari is not exposing the heap size parameter for Spark History Server.
> The workaround is to modify spark-env and add "SPARK_DAEMON_MEMORY=2g" for
> example.
> The newer versions of Spark defaults this to 1g, but on the older versions,
> it was defaulting to 512m it seems, and it was causing OOM.
> So in the patch, "SPARK_DAEMON_MEMORY=1G" is added in the spark-env template
> (default: 1G).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
