[
https://issues.apache.org/jira/browse/FLINK-18515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Cranmer updated FLINK-18515:
----------------------------------
Description:
*Background*
The user application will determine whether to use Polling or FanOut
consumption via the connector properties. EFO consumption will use
{{SubscribeToShard}} to retrieve data from KDS.
*Scope*
Add Fan Out Publisher to Flink Kinesis Connector, including:
- {{FanOutRecordPublisher}}
- {{FanOutRecordPublisherFactory}}
- {{SubscribeToShard}} within the {{KinesisProxyV2}}
- Metric logging
was:
*Background*
In order to utilise an EFO subscription a consumer must register and acquire a
ConsumerARN. Subsequently the ConsumerARN can be used to request a subscription
and start receiving data. The user application will determine whether to use
Polling or FanOut consumption via the connector properties.
*Scope*
Add EFO support by implementing the following items:
* Stream Consumer Registration
* Fan Out Record Consumption ({{FanOutRecordPublisher)}}
* Stream Consumer De-registration
> [Kinesis][EFO] FanOutRecordPublisher and EFO support
> ----------------------------------------------------
>
> Key: FLINK-18515
> URL: https://issues.apache.org/jira/browse/FLINK-18515
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / Kinesis
> Reporter: Danny Cranmer
> Assignee: Danny Cranmer
> Priority: Major
>
> *Background*
> The user application will determine whether to use Polling or FanOut
> consumption via the connector properties. EFO consumption will use
> {{SubscribeToShard}} to retrieve data from KDS.
> *Scope*
> Add Fan Out Publisher to Flink Kinesis Connector, including:
> - {{FanOutRecordPublisher}}
> - {{FanOutRecordPublisherFactory}}
> - {{SubscribeToShard}} within the {{KinesisProxyV2}}
> - Metric logging
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
