HeartSaVioR commented on issue #25808: [SPARK-29104][CORE][TESTS] Fix PipedRDDSuite to wait messages before checking thread termination URL: https://github.com/apache/spark/pull/25808#issuecomment-532039225 I meant the flow doesn't seem to deal with listenerBus in SparkContext. These listeners are registered to TaskContext instead of listenerBus, and Task will directly update the status to listeners. https://github.com/apache/spark/blob/95073fb62b646c3e8394941c5835a396b9d48c0f/core/src/main/scala/org/apache/spark/scheduler/Task.scala#L126-L167 Here both `TaskContext.markTaskFailed` and `TaskContext.markTaskCompleted` is called from `Task.run`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
