[
https://issues.apache.org/jira/browse/AMBARI-24532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Bhardwaj updated AMBARI-24532:
-----------------------------------
Description:
Service check for Spark2 fails when History server is running on https fails
when a custom port is set via spark.ssl.historyServer.port. By default, when
enabling SSL on the Spark2 History Server, the instance will start on port
configured with 'spark.history.ui.port' (port for HTTP) + 400. However, since
https://issues.apache.org/jira/browse/SPARK-17874 it is possible to specify the
port to use for HTTPS using the property 'spark.ssl.historyServer.port'. Ambari
however does not read spark.ssl.historyServer.port property to find the correct
SSL port while performing service check.
\{code}
# spark-defaults params
ui_ssl_enabled = default("configurations/spark2-defaults/spark.ssl.enabled",
False)
spark_yarn_historyServer_address = default(spark_history_server_host,
"localhost")
spark_history_scheme = "http"
spark_history_ui_port =
config['configurations']['spark2-defaults']['spark.history.ui.port']
if ui_ssl_enabled:
spark_history_ui_port = str(int(spark_history_ui_port) + 400)
spark_history_scheme = "https"
{code}
was:
Service check for Spark2 fails when History server is running on https fails
when a custom port is set via spark.ssl.historyServer.port. By default, when
enabling SSL on the Spark2 History Server, the instance will start on port
configured with 'spark.history.ui.port' (port for HTTP) + 400. However, since
https://issues.apache.org/jira/browse/SPARK-17874 it is possible to specify the
port to use for HTTPS using the property 'spark.ssl.historyServer.port'. Ambari
however does not read spark.ssl.historyServer.port property to find the correct
SSL port while performing service check.
{code}
{color:#333333}/var/lib/ambari-server/resources/common-services/SPARK2/2.0.0/package/{color}{color:#333333}scripts/params.py{color}:
#
{color:#0c70aa}# spark-defaults params{color}
#
{color:#333333}ui_ssl_enabled {color}{color:#333333}={color}
{color:#205081}default{color}{color:#333333}({color}{color:#c42b44}"configurations/spark2-defaults/spark.ssl.enabled"{color}{color:#333333},{color}
{color:#205081}False{color}{color:#333333}){color}
#
#
{color:#333333}spark_yarn_historyServer_address {color}{color:#333333}={color}
{color:#205081}default{color}{color:#333333}({color}{color:#333333}spark_history_server_host{color}{color:#333333},{color}
{color:#c42b44}"localhost"{color}{color:#333333}){color}
#
{color:#333333}spark_history_scheme {color}{color:#333333}={color}
{color:#c42b44}"http"{color}
#
{color:#333333}spark_history_ui_port
{color}{color:#333333}={color}{color:#333333}
config{color}{color:#333333}[{color}{color:#c42b44}'configurations'{color}{color:#333333}][{color}{color:#c42b44}'spark2-defaults'{color}{color:#333333}][{color}{color:#c42b44}'spark.history.ui.port'{color}{color:#333333}]{color}
#
#
{color:#205081}if{color}{color:#333333}
ui_ssl_enabled{color}{color:#333333}:{color}
#
{color:#333333} spark_history_ui_port
{color}{color:#333333}={color}{color:#333333}
str{color}{color:#333333}({color}{color:#205081}int{color}{color:#333333}({color}{color:#333333}spark_history_ui_port{color}{color:#333333}){color}
{color:#333333}+{color} {color:#ad5100}400{color}{color:#333333}){color}
#
{color:#333333} spark_history_scheme {color}{color:#333333}={color}
{color:#c42b44}"https"{color}
{code}
> Service Check for Spark2 fails when ssl enabled in spark
> --------------------------------------------------------
>
> Key: AMBARI-24532
> URL: https://issues.apache.org/jira/browse/AMBARI-24532
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.6.2
> Reporter: Ravi Bhardwaj
> Priority: Major
>
> Service check for Spark2 fails when History server is running on https fails
> when a custom port is set via spark.ssl.historyServer.port. By default, when
> enabling SSL on the Spark2 History Server, the instance will start on port
> configured with 'spark.history.ui.port' (port for HTTP) + 400. However, since
> https://issues.apache.org/jira/browse/SPARK-17874 it is possible to specify
> the port to use for HTTPS using the property 'spark.ssl.historyServer.port'.
> Ambari however does not read spark.ssl.historyServer.port property to find
> the correct SSL port while performing service check.
> \{code}
> # spark-defaults params
> ui_ssl_enabled = default("configurations/spark2-defaults/spark.ssl.enabled",
> False)
> spark_yarn_historyServer_address = default(spark_history_server_host,
> "localhost")
> spark_history_scheme = "http"
> spark_history_ui_port =
> config['configurations']['spark2-defaults']['spark.history.ui.port']
> if ui_ssl_enabled:
> spark_history_ui_port = str(int(spark_history_ui_port) + 400)
> spark_history_scheme = "https"
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
