GitHub user EmergentOrder opened a pull request:
https://github.com/apache/spark/pull/20478
[SPARK-8835][Streaming] Provide pluggable Congestion Strategies for
Receiver-based Streams. Take 2 / Spark 2.X merge
## What changes were proposed in this pull request?
Looks like the [PR](https://github.com/apache/spark/pull/9200) for this
([SPARK-8835](https://issues.apache.org/jira/browse/SPARK-8835)) got dropped
quite some time ago, due to build failures. I've merged up to the current
master and am re-submitting it (to be clear, I am not the original author).
## How was this patch tested?
Built and tested locally.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/EmergentOrder/spark
feature/CongestionStrategiesTake2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20478.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20478
----
commit df1d1a6af6be0f0c9bf24c3b9496d220954afaf2
Author: François Garillot <francois@...>
Date: 2015-10-20T14:18:38Z
[SPARK-8835] Removes variable-less interpolation.
commit 013ac377eed81385b40af6753f5ba4a834c38144
Author: François Garillot <francois@...>
Date: 2015-10-20T15:18:06Z
[SPARK-8835] Make no-update of rate limiter with 0 explicit.
commit 7ee7f3aded65da728214faddae15888fa905743b
Author: François Garillot <francois@...>
Date: 2015-10-21T13:56:53Z
[SPARK-8835] Adds strategies for dealing with congestion on Receiver-based
streams
commit 50954a60cc2f7cfb83c706c39c2e714c0c9dc628
Author: François Garillot <francois@...>
Date: 2015-10-21T15:12:42Z
[SPARK-8835] Adds tests for congestion strategies
Folds in the block generator throttling test from ReceiverSuite
commit b2dd6b87865eed5519d8ad278e09ba17c1334c6c
Author: François Garillot <francois@...>
Date: 2015-10-21T15:15:36Z
[SPARK-8835] TUrn off block generator throttling tests for long runtime
THe previous commit (with tests) should pass PR validation though
commit cfbf29dae54caaae3f261525926b54a7e6f6a99a
Author: Alex Merritt <lecaran@...>
Date: 2018-02-01T16:43:05Z
[SPARK-8835][Streaming] Provide pluggable Congestion Strategies for
Receiver-based Streams. Take 2 / Spark 2.X merge
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
