GitHub user uncleGen reopened a pull request:
https://github.com/apache/spark/pull/4135
[SPARK-5205][Streaming]:Inconsistent behaviour between Streaming job and
others, when click kill link in WebUI
The "kill" link is used to kill a stage in job. It works in any kinds of
Spark job but Spark Streaming. To be specific, we can only kill the stage which
is used to run "Receiver", but not kill the "Receivers". Well, the stage can be
killed and cleaned from the ui, but the receivers are still alive and receiving
data. I think it dose not fit with the common sense. IMHO, killing the
"receiver" stage means kill the "receivers" and stopping receiving data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uncleGen/spark master-clean-150121
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4135.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4135
----
commit c90a288ca6fde01008ff3ab5d04970c8f120c4b1
Author: uncleGen <[email protected]>
Date: 2015-01-21T08:58:10Z
BUG FIX: Inconsistent behaviour between Streaming job and others, when
click kill link in WebUI
commit fc3be2c0d3cd3e8f2f15a4a4f0fa504b28164d38
Author: uncleGen <[email protected]>
Date: 2015-01-21T09:16:12Z
fix
commit d85dede41dce4a32748037871241da1620ada564
Author: uncleGen <[email protected]>
Date: 2015-01-21T09:23:59Z
style fix
commit f3162618d3eb1de3e6690e1403bf1943145d316a
Author: uncleGen <[email protected]>
Date: 2015-02-03T02:36:52Z
resolve merge conflicts
commit 168115cb364285867bc9e7af400d48922712c71c
Author: uncleGen <[email protected]>
Date: 2015-03-02T03:46:42Z
resolve merge conflicts
commit 047931c531b7d307de201ba74ed5dcb7da7c6559
Author: uncleGen <[email protected]>
Date: 2015-03-02T05:24:18Z
resolve merge conflicts
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
