Could we make it do the same sort of history server fallback approach? On Tue, May 17, 2022 at 10:41 PM bo yang <bobyan...@gmail.com> wrote:
> It is like Web Application Proxy in YARN ( > https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), > to provide easy access for Spark UI when the Spark application is running. > > When running Spark on Kubernetes with S3, there is no YARN. The reverse > proxy here is to behave like that Web Application Proxy. It will > simplify settings to access Spark UI on Kubernetes. > > > On Mon, May 16, 2022 at 11:46 PM wilson <wil...@4shield.net> wrote: > >> what's the advantage of using reverse proxy for spark UI? >> >> Thanks >> >> On Tue, May 17, 2022 at 1:47 PM bo yang <bobyan...@gmail.com> wrote: >> >>> Hi Spark Folks, >>> >>> I built a web reverse proxy to access Spark UI on Kubernetes (working >>> together with >>> https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). Want to >>> share here in case other people have similar need. >>> >>> The reverse proxy code is here: >>> https://github.com/datapunchorg/spark-ui-reverse-proxy >>> >>> Let me know if anyone wants to use or would like to contribute. >>> >>> Thanks, >>> Bo >>> >>> -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
