Josh Lemer created FLINK-9396:
---------------------------------
Summary: Allow streaming sources (especially Files, Kafka) to set
max queued input elements
Key: FLINK-9396
URL: https://issues.apache.org/jira/browse/FLINK-9396
Project: Flink
Issue Type: Task
Components: DataStream API
Reporter: Josh Lemer
In some applications, there can be situations where a file source queues up so
many files, that when it is time for a checkpoint to start, the checkpoint
takes way too long. It would be nice if we could limit the total queued files
to read to some number, to place an upper bound on how long checkpoints take.
See
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fwd-Decrease-initial-source-read-speed-td20207.html
for previous questions about this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
