Re: Add option to Spark UI to proxy to the executors?

Hey Holden I can probably help you with that. We should probably pass the same configs to the application also,for the reverse proxy to work. Try setting the spark.ui.reverseProxy=true while running your application. I hope this will solve your issue. Best Regards Ankit Prakash Gupta On Thu,

Re: Add option to Spark UI to proxy to the executors?

So I tried turning on the Spark exec UI proxy but it broke the Spark UI (in 3.1.2) and regardless of what URL I requested everything came back as text/html of the jobs page. Is anyone actively using this feature in prod? On Sun, Aug 22, 2021 at 5:58 PM Holden Karau wrote: > Oh cool. I’ll have

Re: Add option to Spark UI to proxy to the executors?

Oh cool. I’ll have to dig down into why that’s not working with my K8s deployment then. On Sat, Aug 21, 2021 at 11:54 PM Gengliang Wang wrote: > Hi Holden, > > FYI there are already some related features in Spark: > >- Spark Master UI to reverse proxy Application and Workers UI >

Re: Add option to Spark UI to proxy to the executors?

Hi Holden, FYI there are already some related features in Spark: - Spark Master UI to reverse proxy Application and Workers UI - Support Spark UI behind front-end reverse proxy using a path prefix Revert proxy URL

Re: Add option to Spark UI to proxy to the executors?

Yes I can see your point. Will that work in kubernetes deployment? Mich view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property

Add option to Spark UI to proxy to the executors?

Hi Folks, I'm wondering what people think about the idea of having the Spark UI (optionally) act as a proxy to the executors? This could help with exec UI access in some deployment environments. Cheers, Holden :) -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High