[
https://issues.apache.org/jira/browse/FLINK-16517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061327#comment-17061327
]
Ethan Li edited comment on FLINK-16517 at 3/18/20, 2:25 AM:
------------------------------------------------------------
Thanks [~aljoscha] I put up a pull request to add the new unbounded source.
I did not deal with FileProcessingMode in this pr because it seems to require
some changes in "[readTextFile|#L1085]] and that might impact other
components/code. I am willing to file a separate issue/PR if you think it makes
sense to do so.
was (Author: ethanli):
Thanks [~aljoscha] I put up a pull request to add the new unbounded source.
I did not deal with FileProcessingMode in this pr because it seems to require
some changes in
"[readTextFile|[https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java#L1085]]
and that might impact other components/code. I am willing to file a separate
issue/PR if you think it makes sense to do so.
> Add a long running WordCount example
> ------------------------------------
>
> Key: FLINK-16517
> URL: https://issues.apache.org/jira/browse/FLINK-16517
> Project: Flink
> Issue Type: Improvement
> Components: Examples
> Reporter: Ethan Li
> Assignee: Ethan Li
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> As far as I know, flink doesn't have a long running WordCount example for
> users to start with or doing some simple tests.
> The closest one is SocketWindowWordCount. But it requires setting up a server
> (nc -l ), which is not hard, but still tedious for simple use cases. And it
> requires human input for the job to actually run.
> I propose to add or modify current WordCount example to have a SourceFunction
> that randomly generates input data based on a set of sentences, so the
> WordCount job can run forever. The generation ratio will be configurable.
> This will be the easiest way to start a long running flink job and can be
> useful for new users to start using flink quickly, or for developers to test
> flink easily.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
