Github user shahidki31 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22526#discussion_r219844417
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ---
@@ -685,7 +685,15 @@ private[ui] class TaskDataSource(
private var _tasksToShow: Seq[TaskData] = null
- override def dataSize: Int = taskCount(stage)
+ override def dataSize: Int = {
+ val storedTasks = store.taskCount(stage.stageId, stage.attemptId).toInt
+ val totalTasks = taskCount(stage)
+ if (totalTasks > storedTasks) {
--- End diff --
Thanks. I have updated the PR by returning only storedTasks. Kindly look
into the updated code.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
