Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/2574#issuecomment-58702467
Hi @uncleGen,
I don't think this is quite what Reynold and I had in mind. Right now, it
looks like the displayed number is essentially `min(#displayed stages, #total
stages)`. I think we were hoping to always display "total stages" and add
additional text to indicate that fewer stages are being displayed in the table.
For instance, if I configure the web UI to only remember information on 100
stages but I have run 300 stages to date, then the UI would say "Completed
Stages: 300 (only showing 100)". But, if all stages were displayed (e.g.
totalStages <= maxStagesRetained), then we would simply show "Completed Stages:
50" in order to avoid redundancy.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
