Repository: spark Updated Branches: refs/heads/master fef081309 -> fbbe37ed4
[SPARK-19358][CORE] LiveListenerBus shall log the event name when dropping them due to a fully filled queue ## What changes were proposed in this pull request? Some dropped event will make the whole application behaves unexpectedly, e.g. some UI problem...we shall log the dropped event name to facilitate the debugging ## How was this patch tested? Existing tests Author: CodingCat <[email protected]> Closes #16697 from CodingCat/SPARK-19358. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fbbe37ed Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fbbe37ed Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fbbe37ed Branch: refs/heads/master Commit: fbbe37ed416f2ca9d8fc713a135b335b8a0247bf Parents: fef0813 Author: CodingCat <[email protected]> Authored: Fri Jul 7 20:10:24 2017 +0800 Committer: Wenchen Fan <[email protected]> Committed: Fri Jul 7 20:10:24 2017 +0800 ---------------------------------------------------------------------- .../src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala | 1 + 1 file changed, 1 insertion(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/fbbe37ed/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala b/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala index f0887e0..0dd63d4 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala @@ -232,6 +232,7 @@ private[spark] class LiveListenerBus(conf: SparkConf) extends SparkListenerBus { "This likely means one of the SparkListeners is too slow and cannot keep up with " + "the rate at which tasks are being started by the scheduler.") } + logTrace(s"Dropping event $event") } } --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
