Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread bo yang
tes with S3, there is no YARN. The reverse >> proxy here is to behave like that Web Application Proxy. It will >> simplify settings to access Spark UI on Kubernetes. >> >> >> On Mon, May 16, 2022 at 11:46 PM wilson wrote: >> >>> what's the advantage of usin

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
2022 at 11:46 PM wilson wrote: > >> what's the advantage of using reverse proxy for spark UI? >> >> Thanks >> >> On Tue, May 17, 2022 at 1:47 PM bo yang wrote: >> >>> Hi Spark Folks, >>> >>> I built a web reverse proxy to access Spark UI

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread bo yang
is to behave like that Web Application Proxy. It will simplify settings to access Spark UI on Kubernetes. On Mon, May 16, 2022 at 11:46 PM wilson wrote: > what's the advantage of using reverse proxy for spark UI? > > Thanks > > On Tue, May 17, 2022 at 1:47 PM bo yang wrote: >

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread bo yang
Thanks Holden :) On Mon, May 16, 2022 at 11:12 PM Holden Karau wrote: > Oh that’s rad  > > On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > >> Hi Spark Folks, >> >> I built a web reverse proxy to access Spark UI on Kubernetes (working >> together with >&

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread wilson
what's the advantage of using reverse proxy for spark UI? Thanks On Tue, May 17, 2022 at 1:47 PM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-opera

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Oh that’s rad  On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). > Want to share here in case other people ha

Reverse proxy for Spark UI on Kubernetes

2022-05-16 Thread bo yang
Hi Spark Folks, I built a web reverse proxy to access Spark UI on Kubernetes (working together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). Want to share here in case other people have similar need. The reverse proxy code is here: https://github.com/datapunchorg/spark-ui

proxy on spark UI

2017-06-27 Thread Soheila S.
Hi all, I am using Hadoop 2.6.5 and spark 2.1.0 and run a job using spark-submit and master is set to "yarn". When spark starts, I can load Spark UI page using port 4040 but no job is shown in the page. After the following logs (registering application master on yarn) spark UI is not accessible