GitHub user uncleGen opened a pull request:
https://github.com/apache/spark/pull/4135
[SPARK-5205][Streaming]:Inconsistent behaviour between Streaming job and
others, when click kill link in WebUI
The "kill" link is used to kill a stage in job. It works in any kinds of
Spark job but Spark Streaming. To be specific, we can only kill the stage which
is used to run "Receiver", but not kill the "Receivers". Well, the stage can be
killed and cleaned from the ui, but the receivers are still alive and receiving
data. I think it dose not fit with the common sense. IMHO, killing the
"receiver" stage means kill the "receivers" and stopping receiving data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uncleGen/spark master-clean-150121
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4135.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4135
----
commit c90a288ca6fde01008ff3ab5d04970c8f120c4b1
Author: uncleGen <[email protected]>
Date: 2015-01-21T08:58:10Z
BUG FIX: Inconsistent behaviour between Streaming job and others, when
click kill link in WebUI
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
