Hi Flink devs, Flink supports overriding "hadoop" and "yarn" configuration. As part of the override mechanism, users have to prefix `hadoop` configs with " flink.hadoop." and the prefix will be removed, while with `yarn` configs users have to prefix it with "flink.yarn." but "flink." only is removed, not "flink.yarn.".
Following is an example: 1. "*Hadoop*" config Hadoop config key = hadoop.tmp.dir => Flink config = flink.hadoop.hadoop.tmp.dir => Hadoop's configuration object would have hadoop.tmp.dir*.* *2. "YARN" config* YARN config key = yarn.application.classpath => Flink config = flink.yarn.yarn.application.classpath => YARN's configuration object would have yarn.yarn.application.classpath*.* Although this is documented <https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/deployment/config/#flink-yarn-%3Ckey%3E> properly, it feels unintuitive and it tripped me, took quite a while to understand why the above YARN configuration override was not working as expected. Is this something that should be fixed? The problem with fixing it is, it will become backwards incompatible. Therefore, can this be addressed as part of Flink-2.0? Any thoughts? Regards Venkata krishnan