Hi Aqib Flink uses FlinkKinesisConsumer as the source connector to read from kinesis sources. You can refer to this part of the documentation <https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/connectors/datastream/kinesis/#polling-default-record-publisher-1>on how to configure FlinkKinesisConsumer for a certain GetRecords limit.
Regards Ahmed Hamdy On Wed, 25 May 2022 at 10:44, Aqib Mehmood <aqib.mehm...@retailo.co> wrote: > Dear Support Team, > > We were setting up a Kinesis-Flink pipeline on our cluster and we seem to > be running into an issue. > > It seems that a Kinesis Data Stream GetRecords limit is 5 requests/second > and we were wondering if Flink surpasses this limit by default. > > Is there any metric that we can use to figure out how many API calls Flink > is making under the hood to the Kinesis Data Stream per second to get data? > > Thank you in advance. > > Regards > Aqib Mehmood > Data Engineer > Retailo >
