Hi all,

I would like to start a discussion on FLIP-394: Add Metrics for Connector
Agnostic Autoscaling [1].

This FLIP recommends adding two metrics to make autoscaling work for
bounded split source implementations like IcebergSource. These metrics are
required by the Flink Kubernetes Operator autoscaler algorithm [2] to
retrieve information for the backlog and the maximum source parallelism.
The changes would affect the `@PublicEvolving` `SplitEnumeratorMetricGroup`
API of the source connector framework.

Best,
Mason

[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-394%3A+Add+Metrics+for+Connector+Agnostic+Autoscaling
[2]
https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/autoscaler/#limitations

Reply via email to