Mengkui gong created SPARK-15609:
------------------------------------
Summary: Can't access spark web UI with given randon port
Key: SPARK-15609
URL: https://issues.apache.org/jira/browse/SPARK-15609
Project: Spark
Issue Type: Bug
Environment: Mesos: Version:0.28.0
Marathon: Version 0.1.5.2
Reporter: Mengkui gong
I deployed the spark in my Mesos-marathon environment by using a docker image
"mesosphere/spark:1.0.0-1.6.1-2". The installation looks fine. But I cannot
access the spark UI link from Mesos UI page http://mesos-slave-1:31882. I
think the issue might be from that randon port 31882. How to define it to 4040?
My spark Json file for Marathon:
[root@mesos-master-1 ~]# cat spark.json
{
"id": "spark",
"cpus": 1,
"mem": 1024,
"cmd": "/sbin/init.sh",
"instances": 1,
"env": {
"DCOS_SERVICE_NAME": "spark",
"SPARK_USER": "root",
"SPARK_DISPATCHER_MESOS_ROLE": "*",
"SPARK_DISPATCHER_MESOS_PRINCIPAL": "",
"SPARK_DISPATCHER_MESOS_SECRET": "",
"ENABLE_HISTORY_SERVER": "false",
"HISTORY_CLEANER_ENABLED": "false",
"HISTORY_CLEANER_INTERVAL": "1d",
"HISTORY_CLEANER_MAXAGE": "7d",
"HISTORY_KRB_PRINCIPAL": "",
"HISTORY_KRB_KEYTAB": ""
},
"ports": [
0,
0,
0,
0
],
"container": {
"type": "DOCKER",
"docker": {
"image": "mesosphere/spark:1.0.0-1.6.1-2",
"network": "HOST",
"forcePullImage": true
}
}
}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
