Danny Cranmer created FLINK-18512:
-------------------------------------
Summary: [KINESIS][EFO] Introduce RecordPublisher Interface
Key: FLINK-18512
URL: https://issues.apache.org/jira/browse/FLINK-18512
Project: Flink
Issue Type: Sub-task
Reporter: Danny Cranmer
*Background*
In order to add support for EFO in the {{FlinkKinesisConsumer}} we are
abstracting out the record consumption from Kinesis {{ShardConsumer}} and
introducing an interface.
*Scope*
Introduce the {{RecordPublisher}} interface and refactor the existing polling
implementation to implement it:
* Add {{PollingRecordPublisher}} that is functional equivalent to the existing
implementation
* Support adaptive throughput via an extension,
{{AdaptivePollingRecordSubscriber}}
* Split out the {{ShardMetricReporter}} into separate classes such that each
component can report it's own metrics:
** {{ShardConsumer}}
** {{PollingRecordConsumer}}
** {{FanOutRecordConsumer}} (later)
* All the existing unit test will continue to pass, and be functionally
equivalent (there may be minor compilation tweaks)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
