GitHub user uncleGen reopened a pull request:
https://github.com/apache/spark/pull/4135
[SPARK-5205][Streaming]:Inconsistent behaviour between Streaming job and
others, when click kill link in WebUI
The "kill" link is used to kill a stage in job. It works in any kinds of
Spark job but Spark Streaming. To be specific, we can only kill the stage which
is used to run "Receiver", but not kill the "Receivers". Well, the stage can be
killed and cleaned from the ui, but the receivers are still alive and receiving
data. I think it dose not fit with the common sense. IMHO, killing the
"receiver" stage means kill the "receivers" and stopping receiving data.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/uncleGen/spark master-clean-150121
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4135.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4135
----
commit c90a288ca6fde01008ff3ab5d04970c8f120c4b1
Author: uncleGen <[email protected]>
Date: 2015-01-21T08:58:10Z
BUG FIX: Inconsistent behaviour between Streaming job and others, when
click kill link in WebUI
commit fc3be2c0d3cd3e8f2f15a4a4f0fa504b28164d38
Author: uncleGen <[email protected]>
Date: 2015-01-21T09:16:12Z
fix
commit d85dede41dce4a32748037871241da1620ada564
Author: uncleGen <[email protected]>
Date: 2015-01-21T09:23:59Z
style fix
commit f3162618d3eb1de3e6690e1403bf1943145d316a
Author: uncleGen <[email protected]>
Date: 2015-02-03T02:36:52Z
resolve merge conflicts
commit 168115cb364285867bc9e7af400d48922712c71c
Author: uncleGen <[email protected]>
Date: 2015-03-02T03:46:42Z
resolve merge conflicts
commit 047931c531b7d307de201ba74ed5dcb7da7c6559
Author: uncleGen <[email protected]>
Date: 2015-03-02T05:24:18Z
resolve merge conflicts
commit d8b57dfff760ce7a3b2413c3dcada3e1572fb7e8
Author: uncleGen <[email protected]>
Date: 2015-03-09T03:28:37Z
Merge branch 'master-clean' into master-clean-150121
commit 4417ff06aeeea63b1a2f4e8a12d736a050abf057
Author: uncleGen <[email protected]>
Date: 2015-03-09T08:19:02Z
update
commit 963556d4b64c81e56913a2860f596c6b25b1286d
Author: uncleGen <[email protected]>
Date: 2015-03-10T03:14:15Z
add unit test
commit f997698a0233d351941fd7ddd9577a659806281e
Author: uncleGen <[email protected]>
Date: 2015-03-10T03:42:03Z
fix unit test
commit 705118453ab6f9869ac090ca2bac009f167869cd
Author: uncleGen <[email protected]>
Date: 2015-03-10T08:57:21Z
minor fix
commit 92fb864e384e298eead53f10844365ea1887a929
Author: uncleGen <[email protected]>
Date: 2015-03-12T11:41:33Z
roll back
commit 98166e7e8b43d1a912b2b6a468eb6d8f1f0297f2
Author: uncleGen <[email protected]>
Date: 2015-03-12T11:44:41Z
minor fix
commit baa175898df8d36b36ec9b9494ebbd117acfae87
Author: uncleGen <[email protected]>
Date: 2015-03-12T11:47:23Z
minor fix
commit fe3e5d52bf8680a021b00dd598cdc5a3f1c7df7e
Author: uncleGen <[email protected]>
Date: 2015-03-12T11:51:11Z
minor fix
commit fb9716d3feee4523a3ee4cddd0a9c0926e228099
Author: uncleGen <[email protected]>
Date: 2015-03-12T11:52:33Z
minor fix
commit 02bf9a936f798b7eb40dcd1183ea14b5c2125deb
Author: uncleGen <[email protected]>
Date: 2015-03-12T12:17:46Z
minor fix
commit 2bac6564a0a1153ec1366bfa4da085a6e89d07d5
Author: uncleGen <[email protected]>
Date: 2015-03-12T13:49:21Z
minor fix
commit 2544f8e5ad0e205e4043bd47646f57d5ed1f42a8
Author: uncleGen <[email protected]>
Date: 2015-03-17T13:52:36Z
roll back to original approach
commit b5237d86ddfcfd0b1b9b5bcd6952902ee1d843b6
Author: uncleGen <[email protected]>
Date: 2015-03-17T14:03:10Z
resolve merge conflict
commit 96f21820250bec9c7286489baa0f7dbd96758df6
Author: uncleGen <[email protected]>
Date: 2015-03-18T02:38:58Z
resolve scala style error
commit b2916fb7cdb6047eb618c2da767d18eb5a4e0caf
Author: uncleGen <[email protected]>
Date: 2015-03-18T09:20:55Z
minor fix
commit 77df65a1d96bb98ee7617590825d63c8ee6a26f9
Author: uncleGen <[email protected]>
Date: 2015-03-31T06:30:53Z
Merge branch 'master-clean-tmp' into master-clean-150121
Conflicts:
streaming/src/main/scala/org/apache/spark/streaming/receiver/ReceiverSupervisor.scala
streaming/src/test/scala/org/apache/spark/streaming/ReceiverSuite.scala
commit e6724ecac594e818973a6d813c4d012fca1bd06d
Author: uncleGen <[email protected]>
Date: 2015-03-31T06:40:01Z
minor fix
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
