Timo Walther created FLINK-20060:
------------------------------------
Summary: Add a Collector to KinsesisDeserializationSchema
Key: FLINK-20060
URL: https://issues.apache.org/jira/browse/FLINK-20060
Project: Flink
Issue Type: New Feature
Components: Connectors / Kinesis
Reporter: Timo Walther
We did not add support for a collector in the KinesisDeserializationSchema.
The problem with that connector lays in the threading model, where there is a
pool of threads that read and deserialize records and then they handover the
deserialized messages through a queue to the main thread. The problem is that
we would need to create many temporary collections to put the deserialized
records into the handover queue, which potentially would significantly affect
performance, especially in the usual case of deserializing a single record from
a single message.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
