Merge pull request #207 from henrydavidge/master Log a warning if a task's serialized size is very big
As per Reynold's instructions, we now create a warning level log entry if a task's serialized size is too big. "Too big" is currently defined as 100kb. This warning message is generated at most once for each stage. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/330ada17 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/330ada17 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/330ada17 Branch: refs/heads/master Commit: 330ada1766c1f8a7274b5566fa66b796329d7054 Parents: 615213f 5757993 Author: Matei Zaharia <[email protected]> Authored: Tue Nov 26 19:08:33 2013 -0800 Committer: Matei Zaharia <[email protected]> Committed: Tue Nov 26 19:08:33 2013 -0800 ---------------------------------------------------------------------- .../org/apache/spark/scheduler/DAGScheduler.scala | 15 +++++++++++++++ .../scala/org/apache/spark/scheduler/StageInfo.scala | 1 + .../scala/org/apache/spark/scheduler/TaskInfo.scala | 2 ++ .../scheduler/cluster/ClusterTaskSetManager.scala | 1 + 4 files changed, 19 insertions(+) ----------------------------------------------------------------------
