Chandu Kavar created SPARK-27061:
------------------------------------

             Summary: Expose 4040 port on driver service to access logs using 
service
                 Key: SPARK-27061
                 URL: https://issues.apache.org/jira/browse/SPARK-27061
             Project: Spark
          Issue Type: Task
          Components: Kubernetes
    Affects Versions: 2.4.0
            Reporter: Chandu Kavar


Currently, we can access the driver logs using 

{{kubectl port-forward <driver-pod-name> 4040:4040}}

mentioned in 
[https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]

We have users who submit spark jobs to Kubernetes, but they don't have access 
to the cluster. so, they can't user kubectl port-forward command.

If we can expose 4040 port on driver service, we can easily relay these logs to 
UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to