bupt_ljy created FLINK-12668:
--------------------------------
Summary: Introduce fromParallelElements for generating
DataStreamSource
Key: FLINK-12668
URL: https://issues.apache.org/jira/browse/FLINK-12668
Project: Flink
Issue Type: Improvement
Affects Versions: 1.8.0
Reporter: bupt_ljy
Assignee: bupt_ljy
Fix For: 1.9.0
We've already have fromElements function in StreamExecutionEnvironment to
generate a non-parallel DataStreamSource. We should introduce a similar
fromParallelElements function because:
1. The current implementations of ParallelSourceFunction are mostly bound to
external resources like kafka source. And we need a more lightweight parallel
source function that can be easily created. The SplittableIterator is too heavy
by the way.
2. It's very useful if we want to verify or test something in a parallel
processing environment.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
