[
https://issues.apache.org/jira/browse/SPARK-22995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318726#comment-16318726
]
Jhon Cardenas commented on SPARK-22995:
---------------------------------------
!_Internal address meaning the interface that's not publicly routable?_ *yes*
_Are you saying the UI is binding to one host/IP but rendering links to
another?_ *yes, the links are pointing to the executor address directly (see
link.jpeg)*
I have tried setting SPARK_PUBLIC_DNS and SPARK_LOCAL_IP variables so they
contains the master ip address. I also tried with this properties:
spark.yarn.appMasterEnv.SPARK_LOCAL_IP and
spark.yarn.appMasterEnv.SPARK_PUBLIC_DNS but it does not seem to work.
I will put this on mailing list too.
> Spark UI stdout/stderr links point to executors internal address
> ----------------------------------------------------------------
>
> Key: SPARK-22995
> URL: https://issues.apache.org/jira/browse/SPARK-22995
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.2.1
> Environment: AWS EMR, yarn cluster.
> Reporter: Jhon Cardenas
> Attachments: link.jpeg
>
>
> On Spark ui, in Environment and Executors tabs, the links of stdout and
> stderr point to the internal address of the executors. This would imply to
> expose the executors so that links can be accessed. Shouldn't those links be
> pointed to master then handled internally serving the master as a proxy for
> these files instead of exposing the internal machines?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
