GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/12154
Streaming dynamic allocation
## What changes were proposed in this pull request?
Added a new Executor Allocation Manager for the Streaming scheduler for
doing Streaming Dynamic Allocation.
## How was this patch tested
Unit tests, and cluster tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark streaming-dynamic-allocation
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12154.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12154
----
commit 26c0c18d6a411171be36049bec8631b670c9cba4
Author: Tathagata Das <[email protected]>
Date: 2015-12-04T01:46:14Z
Implement streaming dynamic allocation
commit 0e78bd2dea8a1f510e396ba9daf14177eb90b539
Author: Tathagata Das <[email protected]>
Date: 2016-03-16T01:42:59Z
Some change
commit 60b7a2262664fc8ef6c4aa394e2e246f3fd8cb2d
Author: Tathagata Das <[email protected]>
Date: 2016-04-04T09:14:17Z
Fixed bugs and updated tests
commit 39ed35a85224cdb73414a33a5a6f352e3ae221ea
Author: Tathagata Das <[email protected]>
Date: 2016-04-04T20:28:56Z
Added enabling key and unit tests
commit 81ad1dd3ce7a87f81f317ff330cca215e8d4fc3a
Author: Tathagata Das <[email protected]>
Date: 2016-04-04T20:50:56Z
Added docs
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
