Repository: spark Updated Branches: refs/heads/master 6adf67dd1 -> 6308c65f0
[SPARK-21953] Show both memory and disk bytes spilled if either is present As written now, there must be both memory and disk bytes spilled to show either of them. If there is only one of those types of spill recorded, it will be hidden. Author: Andrew Ash <and...@andrewash.com> Closes #19164 from ash211/patch-3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6308c65f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6308c65f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6308c65f Branch: refs/heads/master Commit: 6308c65f08b507408033da1f1658144ea8c1491f Parents: 6adf67d Author: Andrew Ash <and...@andrewash.com> Authored: Mon Sep 18 10:42:24 2017 +0800 Committer: Wenchen Fan <wenc...@databricks.com> Committed: Mon Sep 18 10:42:24 2017 +0800 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/6308c65f/core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala b/core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala index d9c87f6..5acec0d 100644 --- a/core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala +++ b/core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala @@ -110,7 +110,7 @@ private[spark] object UIData { def hasOutput: Boolean = outputBytes > 0 def hasShuffleRead: Boolean = shuffleReadTotalBytes > 0 def hasShuffleWrite: Boolean = shuffleWriteBytes > 0 - def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 && diskBytesSpilled > 0 + def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 || diskBytesSpilled > 0 } /** --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
