jpugliesi commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-805294600
@jahstreet One question about configuring the Spark UI in livy/sparkmagic - with this current implementation, it seems that a sparkmagic notebook's `Spark UI` link will link to the Kubernetes ingress host configured if `livy.server.kubernetes.ingress.create=true`. Unfortunately, this link will not be updated to point to the url of the history server upon spark session completion. Have you figured out a way to construct this notebook link to point to a proxy that will either: 1. Route to Spark driver's Spark UI, if the driver/ingress still exists, or 2. Route to the Spark history server for the spark app id, in case the the session is no longer in progress Appreciate your help -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
