GitHub user huitseeker opened a pull request:
https://github.com/apache/spark/pull/9200
[SPARK-8835] Provide pluggable Congestion Strategies for Receiver-based
Streams
The new (destructive) strategies avoid leaving elements in the TCP buffer,
leading to breakages at the sender level when this buffer finally drops them.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/huitseeker/spark feature/CongestionStrategies
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9200.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9200
----
commit df1d1a6af6be0f0c9bf24c3b9496d220954afaf2
Author: François Garillot <[email protected]>
Date: 2015-10-20T14:18:38Z
[SPARK-8835] Removes variable-less interpolation.
commit 013ac377eed81385b40af6753f5ba4a834c38144
Author: François Garillot <[email protected]>
Date: 2015-10-20T15:18:06Z
[SPARK-8835] Make no-update of rate limiter with 0 explicit.
commit 6268c2cf89a4ce1cda0650b184e6d85826f2af7c
Author: François Garillot <[email protected]>
Date: 2015-10-21T13:56:53Z
[SPARK-8835] Adds strategies for dealing with congestion on Receiver-based
streams
commit 8cbadacb3b492ebbdd8283379fe99ce8534ad896
Author: François Garillot <[email protected]>
Date: 2015-10-21T15:12:42Z
[SPARK-8835] Adds tests for congestion strategies
Folds in the block generator throttling test from ReceiverSuite
commit 2e8e5deeacdca0bce3c24ea62c85811fef70a9b4
Author: François Garillot <[email protected]>
Date: 2015-10-21T15:15:36Z
[SPARK-8835] TUrn off block generator throttling tests for long runtime
THe previous commit (with tests) should pass PR validation though
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
