Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/2574#discussion_r18596525
--- Diff:
core/src/main/scala/org/apache/spark/ui/jobs/JobProgressPage.scala ---
@@ -70,11 +72,11 @@ private[ui] class JobProgressPage(parent:
JobProgressTab) extends WebUIPage("")
</li>
<li>
<a href="#completed"><strong>Completed Stages:</strong></a>
- {completedStages.size}
+ {totalCompletedStages}
--- End diff --
@uncleGen The web UI only remembers information on a fixed number of stages
in order to limit its memory usage, so it's possible that the displayed number
of completed stages will be much higher than the number of rows displayed in
the stage table. I think Reynold's suggestion was to make this more explicit
by adding "(only showing yy)" to emphasize that some garbage-collected stage
information ins't being displayed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
