[jira] [Commented] (AMBARI-16757) Spark History Server heap size is not exposed (History Server crashed with OOM)
[ https://issues.apache.org/jira/browse/AMBARI-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308741#comment-15308741 ] Hudson commented on AMBARI-16757: - SUCCESS: Integrated in Ambari-trunk-Commit #4969 (See [https://builds.apache.org/job/Ambari-trunk-Commit/4969/]) AMBARI-16757. Spark History Server heap size is not exposed (History (sgunturi: [http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=29fe46f55462bd3b2e9b2d91c69d706c48c632c3]) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py > Spark History Server heap size is not exposed (History Server crashed with > OOM) > --- > > Key: AMBARI-16757 > URL: https://issues.apache.org/jira/browse/AMBARI-16757 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.0.0 >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.4.0 > > Attachments: AMBARI-16757-1.patch, AMBARI-16757-2.patch, > AMBARI-16757-3.patch, AMBARI-16757.ADDENDUM.patch > > > Ambari is not exposing the heap size parameter for Spark History Server. > The workaround is to modify spark-env and add "SPARK_DAEMON_MEMORY=2g" for > example. > The newer versions of Spark defaults this to 1g, but on the older versions, > it was defaulting to 512m it seems, and it was causing OOM. > So in the patch, "SPARK_DAEMON_MEMORY=1G" is added in the spark-env template > (default: 1G). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-16757) Spark History Server heap size is not exposed (History Server crashed with OOM)
[ https://issues.apache.org/jira/browse/AMBARI-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301397#comment-15301397 ] Hudson commented on AMBARI-16757: - FAILURE: Integrated in Ambari-trunk-Commit #4926 (See [https://builds.apache.org/job/Ambari-trunk-Commit/4926/]) AMBARI-16757. Spark History Server heap size is not exposed (History (sgunturi: [http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=8059a6392747292fd2b180577cd5cd93a9392b57]) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/configuration/spark-env.xml > Spark History Server heap size is not exposed (History Server crashed with > OOM) > --- > > Key: AMBARI-16757 > URL: https://issues.apache.org/jira/browse/AMBARI-16757 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.0.0 >Reporter: Weiqing Yang >Priority: Minor > Fix For: 2.4.0 > > Attachments: AMBARI-16757-1.patch, AMBARI-16757-2.patch, > AMBARI-16757-3.patch > > > Ambari is not exposing the heap size parameter for Spark History Server. > The workaround is to modify spark-env and add "SPARK_DAEMON_MEMORY=2g" for > example. > The newer versions of Spark defaults this to 1g, but on the older versions, > it was defaulting to 512m it seems, and it was causing OOM. > So in the patch, "SPARK_DAEMON_MEMORY=1G" is added in the spark-env template > (default: 1G). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
