GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/5385
[SPARK-6691][Streaming][WIP] Add a dynamic RateLimiter for Spark Streaming
This proposal add a dynamic RateLimiter for Spark Streaming's both receiver
and direct based input streams. The details can be seen in
[SPARK-6691](https://issues.apache.org/jira/browse/SPARK-6691).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark dynamic-rate-limiter
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5385.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5385
----
commit 293958ebc91ad4b0374714463a4eb84fc5d7240a
Author: jerryshao <[email protected]>
Date: 2015-04-02T09:59:56Z
Initial commit
commit b8b0d6b2762657049da2b85ce5a1b79d98003a50
Author: jerryshao <[email protected]>
Date: 2015-04-03T07:10:17Z
Add the slow start configuration and improve the code
commit 8891e4e24754a9d11216ecfe368bc22d87e18a63
Author: jerryshao <[email protected]>
Date: 2015-04-03T09:32:00Z
Code polish
commit 9235598b5fcacbaa4f7ea1ca6bbc16ff1011d6d7
Author: jerryshao <[email protected]>
Date: 2015-04-07T06:01:56Z
Add unit test
commit d2382dc8dd301422530e1433687b8d9954cbd25f
Author: jerryshao <[email protected]>
Date: 2015-04-07T06:20:28Z
Fix some bugs
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
