GitHub user moutai opened a pull request:
https://github.com/apache/spark/pull/4721
Add a note for context termination for History server on Yarn
The history server on Yarn only shows completed jobs. This adds a note
concerning the needed explicit context termination at the end of a spark job
which is a best practice anyway.
Related to SPARK-2972 and SPARK-3458
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/moutai/spark
add-history-server-note-for-closing-the-spark-context
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4721.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4721
----
commit 3ad3db4fcb47d33892334cab953daaeecb556502
Author: moussa taifi <[email protected]>
Date: 2015-02-22T19:16:14Z
Add context termination for History server on Yarn
The history server on Yarn only shows completed jobs. This adds a note
concerning the needed explicit context termination at the end of a spark job
which is a best practice anyway.
Related to SPARK-2972 and SPARK-3458
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
