GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/5177
[SPARK-5771] Master UI inconsistently displays application cores
If the user calls `sc.stop()`, then the number of cores under "Completed
Applications" will be 0. If the user does not call `sc.stop()`, then the number
of cores will be however many cores were being used before the application
exited. This PR makes both cases have the behavior of the latter.
Note that there have been a series of PR that attempted to fix this. For
the full discussion, please refer to #4841.
Tested this locally with and without calling `sc.stop()`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark master-ui-cores
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5177.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5177
----
commit 62449d16489c04cc34a8a8e37219fe39ae5efc7b
Author: Andrew Or <[email protected]>
Date: 2015-03-25T00:18:59Z
Freeze application state before finishing it
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
