[
https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795322#comment-15795322
]
Thomas commented on SPARK-11782:
--------------------------------
Did you manage to solve this, [~j4nu5]?
I have the same issue as described, here, with Spark 2.1.0.
Here are the detailed steps to reproduce it:
* On node1, launch master:
{code}
./bin/start-master.sh
{code}
The Master UI is available at http://node1:8080 and shows spark://node1:7077 as
master URL and spark://node1:6066 as master REST URL.
* On node2, launch worker:
{code}
./bin/start-slave.sh spark://node1:7077
{code}
* Upload myapp.jar to both nodes.
* On *node1*, submit a job in standalone cluster mode:
{code}
./bin/spark-submit --master spark://node1:6066 --deploy-mode cluster
--supervise --class myMainClass --total-executor-cores 1 myapp.jar
{code}
What I get is:
* A driver associated with my job, running on node2 (as expected in cluster
mode).
* The Application UI accessible on http://node2:4040
The two following links are wrong:
* On the Master UI, under "Running Application", column "Name" link on
"myMainClass" points to http://node1:4040
* On the Master UI, under "Running Application", column "Application ID", on
the page of my application ID (http://node1:8080/app/?appId=myAppId), the
"Application Detail UI" link also points to http://node1:4040
The problem is that http://node1:4040 does not lead anywhere. The expected
behaviour would be to replace those two links by http://node2:4040 (which is
where the Application UI actually is).
> Master Web UI should link to correct Application UI in cluster mode
> -------------------------------------------------------------------
>
> Key: SPARK-11782
> URL: https://issues.apache.org/jira/browse/SPARK-11782
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.4.1
> Reporter: Matthias Niehoff
> Priority: Minor
>
> - Running a standalone cluster, with node1 as master
> - Submit an application to cluster with deploy-mode=cluster
> - Application driver is on node other than node1 (i.e. node3)
> => master WebUI links to node1:4040 for Application Detail UI and not to
> node3:4040
> As the master knows on which worker the driver is running, it should be
> possible to show the correct link to the Application Detail UI
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
