GitHub user StephanEwen opened a pull request:
https://github.com/apache/flink/pull/718
[FLINK-2084] [core] Add an option to start Flink in streaming mode
The streaming mode subsumes the batch mode, as it allows to run both kinds
of programs. Batch programs will most likely run slightly less efficient than
in pure batch mode, due to lazy memory allocation (see below)
Adds new startup options to the JobManager and TaskManager.
Adds additional scripts `bin/start-cluster-streaming.sh` and
`start-local-streaming.sh`.
Currently, streaming mode only sets the memory manager to lazy memory
allocation to ensure heap is not blocked by batch memory manager
Includes [FLINK-2085] To support on-demand memory allocation in the memory
manager.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/StephanEwen/incubator-flink streaming_mode
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/718.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #718
----
commit 7b58e2d49521e955ddacfa5586659df01fe57c57
Author: Stephan Ewen <[email protected]>
Date: 2015-05-22T16:35:40Z
[FLINK-2085] [runtime] Add an option to let the MemoryManager allocate and
release memory as needed.
This is an alternative mode to the current mode that pre-allocates all
memory.
The default remains to pre-allocate all memory.
commit 43978cd979114858ad2f200f04bd1723693c2c3e
Author: Stephan Ewen <[email protected]>
Date: 2015-05-22T15:12:45Z
[FLINK-2084] [core] Add an option to start Flink in streaming mode
- Streaming mode sets the memory manager to lazy memory allocation to
ensure
heap is not blocked by batch memory manager
commit 1df1f12e367b4b89b56e9e47dbe5a7a11e5e1583
Author: Stephan Ewen <[email protected]>
Date: 2015-05-22T15:24:19Z
[tests] Adjust tests for dedicated streaming mode and clean up test bases.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
