[
https://issues.apache.org/jira/browse/FLINK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228392#comment-17228392
]
Dawid Wysakowicz commented on FLINK-17307:
------------------------------------------
Sorry that's my mistake. I did not update the description of the issue.
Unfortunately you are correct that we did not add support for a collector in
the {{KinesisDeserializationSchema}}.
The problem with that connector lays in the threading model, where there is a
pool of threads that read and deserialize records and then they handover the
deserialized messages through a queue to the main thread. The problem is that
we would need to create many temporary collections to put the deserialized
records into the handover queue, which potentially would significantly affect
performance, especially in the usual case of deserializing a single record from
a single message.
> Add collector to DeserializationSchema
> --------------------------------------
>
> Key: FLINK-17307
> URL: https://issues.apache.org/jira/browse/FLINK-17307
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / Common
> Reporter: Dawid Wysakowicz
> Assignee: Dawid Wysakowicz
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.11.0
>
>
> Additionally add support in connectors:
> * Kafka
> * -Kinesis-
> * PubSub
> * RabbitMq
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
