Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21898#discussion_r207822218
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1930,6 +1930,12 @@ class SparkContext(config: SparkConf) extends
Logging {
Utils.tryLogNonFatalError {
_executorAllocationManager.foreach(_.stop())
}
+ if (_dagScheduler != null) {
--- End diff --
This is to fix
https://github.com/apache/spark/pull/21898#issuecomment-410499090 , previously
LiveListenerBus was stopped before we stop DAGScheduler.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
