[
https://issues.apache.org/jira/browse/FLINK-25413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qiunan updated FLINK-25413:
---------------------------
Summary: Use append dfs.nameservices hadoop config to replace overwrite
(was: Use append yarn and hadoop config to replace overwrite)
> Use append dfs.nameservices hadoop config to replace overwrite
> --------------------------------------------------------------
>
> Key: FLINK-25413
> URL: https://issues.apache.org/jira/browse/FLINK-25413
> Project: Flink
> Issue Type: Improvement
> Reporter: qiunan
> Priority: Major
>
> In [FLINK-16005][flink-yarn] Support yarn and hadoop config override.
> However, I think we should append methods to better meet our production
> needs. For example, the HDFS cluster in production has its own configuration.
> We only need to add hdfs that cannot be written to. At the same time, there
> are many clusters in production. We cannot cover all the configurations.
> In flink-conf.yaml
> flink.hadoop.dfs.nameservices: nameservice1
> The problem now is, if flink.hadoop.dfs.nameservices: nameservice1 we can
> only write to the cluster of nameservice1, all other clusters cannot be
> written, we need to add the configuration of each cluster to write.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)