Hello, We are exploring running multiple Flink clusters within a Kubernetes cluster such that each Flink cluster can run with a specified Flink image version. Since the Flink Job Graph needs to be compatible with the Flink version running in the Flink cluster, this brings a challenge in how we ensure that the SQL job graph or Flink job jars are compatible with the Flink cluster users want to run them on.
E.g. if the Flink cluster is running version 1.12.1, the job graph generated from the SQL must be created using compatible 1.12.1 Flink libraries. Otherwise, we see issues with deserialization etc. Is there a recommended way to handle this scenario today? Thanks, Sonam