Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/3009#issuecomment-63129947
The other thing is I find it a little confusing that the total number of
tasks keeps increasing as more stages get submitted. One way to fix this is to
change the SparkListenerJobStart event to take the number of tasks for each
stage so the progress bar can be correct from the beginning of time -- but that
involves changing the developer API. Happy to defer to whatever you and
@pwendell think is best here (or to do that in a separate PR, that will also go
into 1.2, so people can start playing around with this).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]