[GitHub] [spark] ornew commented on pull request #31774: [SPARK-34659] Fix that Web UI always correctly get appId

[GitBox]

ornew commented on pull request #31774:
URL: https://github.com/apache/spark/pull/31774#issuecomment-799982981


   @dongjoon-hyun @gengliangwang Thank you for your reply.
   
   > @ornew could you show reproduce steps on Spark? It seems that the 
jupyterhub is using a different Spark UI URL from Spark.
   
   It's easy. Please run JupyterHub with 
[jupyter-server-proxy](https://github.com/jupyterhub/jupyter-server-proxy), and 
PySpark.
   
   I build Jupyter Hub on Kubernetes and provide a sandbox for a large number 
of users. Accessing the Spark UI requires some kind of proxy. JupyterHub's 
Server Proxy allows you to access ports in your sandbox environment without 
user interaction.
   
   ```python
   from pyspark import *
   from pyspark.sql import *
   
   spark = SparkSession.builder.getOrCreate()
   ```
   
   <img width="651" alt="スクリーンショット 2021-03-16 14 58 57" 
src="https://user-images.githubusercontent.com/19766770/111263381-21b30300-8669-11eb-92b2-0008be233ea7.png";>
   
   When accessing the Spark UI by port, the Jupyter Server Proxy path contains 
`proxy`, which causes incorrect parsing.
   
   <img width="637" alt="スクリーンショット 2021-03-16 15 01 56" 
src="https://user-images.githubusercontent.com/19766770/111263218-d8fb4a00-8668-11eb-9d63-2a427db49b32.png";>
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org