[
https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srinivasa Reddy Vundela updated SPARK-11484:
--------------------------------------------
Description:
Customer reported a strange UI when running spark application through Oozie in
Uber mode (Issue was observed only in yarn-client mode).
When debugging the sparkUI through chrome developer console, figured out that
CSS files are looked for in different applicationId (Oozie mapreduce
application) instead of actual spark application. (Please see the attached
screenshot for more information).
Looking into the live sparkUI code, it seems that proxyBase is taken from
APPLICATION_WEB_PROXY_BASE instead of spark property spark.ui.proxyBase
(Pointing to the actual spark application). This issue might be reproducible if
the above specified env is set manually or set by other job.
Fix would be giving precedence to spark property (which might be correct in
most cases when it was set).
was:
Customer reported a strange UI when running spark application through Oozie in
Uber mode (Issue was observed only in yarn-client mode).
When debugging the sparkUI through chrome developer console, figured out that
CSS files are looked for in different applicationId (Oozie mapreduce
application) instead of actual spark application. (Please see the attached
screenshot for more information).
Looking into the live sparkUI it seems that proxyBase is taken from
APPLICATION_WEB_PROXY_BASE instead of spark property spark.ui.proxyBase
(Pointing to the actual spark application).
This fix gives precedence to spark property (which should be correct in most
cases when it was set), which should fix the issue.
> Giving precedence to proxyBase set by spark instead of env
> ----------------------------------------------------------
>
> Key: SPARK-11484
> URL: https://issues.apache.org/jira/browse/SPARK-11484
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Reporter: Srinivasa Reddy Vundela
> Priority: Minor
> Attachments: Screen Shot 2015-10-29 at 9.06.46 AM.png
>
>
> Customer reported a strange UI when running spark application through Oozie
> in Uber mode (Issue was observed only in yarn-client mode).
> When debugging the sparkUI through chrome developer console, figured out that
> CSS files are looked for in different applicationId (Oozie mapreduce
> application) instead of actual spark application. (Please see the attached
> screenshot for more information).
> Looking into the live sparkUI code, it seems that proxyBase is taken from
> APPLICATION_WEB_PROXY_BASE instead of spark property spark.ui.proxyBase
> (Pointing to the actual spark application). This issue might be reproducible
> if the above specified env is set manually or set by other job.
> Fix would be giving precedence to spark property (which might be correct in
> most cases when it was set).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
