wangyum commented on PR #41630: URL: https://github.com/apache/spark/pull/41630#issuecomment-1698515891
@cloud-fan At the beginning, I also would like to achieve it by changing the config of `SparkContext`, but changing the config of `SparkContext` cannot overwrite the configuration already contained in [initialSessionOptions](https://github.com/apache/spark/blob/071feabbd4325504332679dfa620bc5ee4359370/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala#L257). The advantage of the UI feature over the REST API is that it can display configurations that have been overridden. @yaooqinn Spark UI is not only for monitoring, it can also kill jobs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
