[
https://issues.apache.org/jira/browse/SPARK-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-4313:
-----------------------------
Assignee: Shixiong Zhu
> "Thread Dump" link is broken in yarn-cluster mode
> -------------------------------------------------
>
> Key: SPARK-4313
> URL: https://issues.apache.org/jira/browse/SPARK-4313
> Project: Spark
> Issue Type: Bug
> Components: Web UI, YARN
> Affects Versions: 1.2.0
> Reporter: Shixiong Zhu
> Assignee: Shixiong Zhu
> Priority: Minor
> Fix For: 1.2.0
>
>
> In yarn-cluster mode, the Web UI is running behind a yarn proxy server. Some
> features(or bugs?) of yarn proxy server will break the links for thread dump.
> 1. Yarn proxy server will do http redirect internally, so if opening
> "http://example.com:8088/cluster/app/application_1415344371838_0012/executors";,
> it will fetch
> "http://example.com:8088/cluster/app/application_1415344371838_0012/executors/";
> and return the content but won't change the link in the browser. Then when a
> user clicks "Thread Dump", it will jump to
> "http://example.com:8088/proxy/application_1415344371838_0012/threadDump/?executorId=2";.
> This is a wrong link. The correct link should be
> "http://example.com:8088/proxy/application_1415344371838_0012/executors/threadDump/?executorId=2";.
> 2. Yarn proxy server has a bug about the URL encode/decode. When a user
> accesses
> "http://example.com:8088/proxy/application_1415344371838_0006/executors/threadDump/?executorId=%3Cdriver%3E";,
> the yarn proxy server will require
> "http://example.com:36429/executors/threadDump/?executorId=%25253Cdriver%25253E";.
> But Spark web server expects
> "http://example.com:36429/executors/threadDump/?executorId=%3Cdriver%3E";. I
> will report this issue to Hadoop community later.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
