Hi all, I would like to start a discussion on FLIP-394: Add Metrics for Connector Agnostic Autoscaling [1].
This FLIP recommends adding two metrics to make autoscaling work for bounded split source implementations like IcebergSource. These metrics are required by the Flink Kubernetes Operator autoscaler algorithm [2] to retrieve information for the backlog and the maximum source parallelism. The changes would affect the `@PublicEvolving` `SplitEnumeratorMetricGroup` API of the source connector framework. Best, Mason [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-394%3A+Add+Metrics+for+Connector+Agnostic+Autoscaling [2] https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/autoscaler/#limitations